Class cascading.JoinFieldedPipesPlatformTest

32

tests

0

failures

0

ignored

12m35.00s

duration

100%

successful

Tests

Test Duration Result
testCross 14.636s passed
testJoin 16.281s passed
testJoinAfterEvery 47.363s passed
testJoinAroundJoinLeftMost 33.759s passed
testJoinAroundJoinRightMost 16.525s passed
testJoinAroundJoinRightMostSwapped 33.132s passed
testJoinDiffFields 16.620s passed
testJoinFilteredBranch 38.038s passed
testJoinGroupBy 21.336s passed
testJoinGroupByJoin 31.261s passed
testJoinInner 16.603s passed
testJoinInnerOuter 16.379s passed
testJoinInnerSingleField 29.192s passed
testJoinMergeGroupBy 39.561s passed
testJoinMixed 0s passed
testJoinNone 16.571s passed
testJoinOuter 0s passed
testJoinOuterInner 0s passed
testJoinSamePipe 16.608s passed
testJoinSamePipe2 16.400s passed
testJoinSamePipe3 16.523s passed
testJoinSamePipeAroundGroupBy 37.752s passed
testJoinSamePipeName 17.762s passed
testJoinSameSourceIntoJoin 49.286s passed
testJoinSelf 32.743s passed
testJoinWithHasher 18.002s passed
testJoinWithUnknowns 16.882s passed
testJoinsIntoCoGroup 23.458s passed
testJoinsIntoCoGroupLhs 39.133s passed
testJoinsIntoCoGroupLhsSwappedJoin 20.817s passed
testJoinsIntoCoGroupRhs 38.616s passed
testJoinsIntoGroupBy 23.760s passed

Standard output

2015-03-13 10:04:16,867 INFO  platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(187)) - found 1 test platforms from classpath
2015-03-13 10:04:16,903 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(237)) - installing platform: hadoop2-mr1
2015-03-13 10:04:16,903 INFO  platform.PlatformRunner (PlatformRunner.java:addPlatform(238)) - running test: cascading.JoinFieldedPipesPlatformTest
2015-03-13 10:04:16,920 INFO  hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(117)) - using cluster
2015-03-13 10:04:17,461 WARN  util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Formatting using clusterid: testClusterID
2015-03-13 10:04:17,510 INFO  namenode.HostFileManager (HostFileManager.java:refresh(304)) - read includes:
HostSet(
)
2015-03-13 10:04:17,511 INFO  namenode.HostFileManager (HostFileManager.java:refresh(311)) - read excludes:
HostSet(
)
2015-03-13 10:04:17,513 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.configured.node.mapping is deprecated. Instead, use net.topology.configured.node.mapping
2015-03-13 10:04:17,513 INFO  blockmanagement.DatanodeManager (DatanodeManager.java:<init>(210)) - dfs.block.invalidate.limit=1000
2015-03-13 10:04:17,517 INFO  util.GSet (LightWeightGSet.java:computeCapacity(328)) - Computing capacity for map BlocksMap
2015-03-13 10:04:17,517 INFO  util.GSet (LightWeightGSet.java:computeCapacity(329)) - VM type       = 64-bit
2015-03-13 10:04:17,518 INFO  util.GSet (LightWeightGSet.java:computeCapacity(330)) - 2.0% max memory = 672 MB
2015-03-13 10:04:17,518 INFO  util.GSet (LightWeightGSet.java:computeCapacity(332)) - capacity      = 2^21 = 2097152 entries
2015-03-13 10:04:17,524 INFO  blockmanagement.BlockManager (BlockManager.java:createBlockTokenSecretManager(314)) - dfs.block.access.token.enable=false
2015-03-13 10:04:17,525 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(300)) - defaultReplication         = 3
2015-03-13 10:04:17,525 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(301)) - maxReplication             = 512
2015-03-13 10:04:17,526 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(302)) - minReplication             = 1
2015-03-13 10:04:17,527 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(303)) - maxReplicationStreams      = 2
2015-03-13 10:04:17,527 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(304)) - shouldCheckForEnoughRacks  = false
2015-03-13 10:04:17,528 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(305)) - replicationRecheckInterval = 3000
2015-03-13 10:04:17,528 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(306)) - encryptDataTransfer        = false
2015-03-13 10:04:17,536 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(612)) - fsOwner             = soberoi (auth:SIMPLE)
2015-03-13 10:04:17,537 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(613)) - supergroup          = supergroup
2015-03-13 10:04:17,537 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(614)) - isPermissionEnabled = true
2015-03-13 10:04:17,538 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(628)) - HA Enabled: false
2015-03-13 10:04:17,541 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(665)) - Append Enabled: true
2015-03-13 10:04:17,827 INFO  util.GSet (LightWeightGSet.java:computeCapacity(328)) - Computing capacity for map INodeMap
2015-03-13 10:04:17,827 INFO  util.GSet (LightWeightGSet.java:computeCapacity(329)) - VM type       = 64-bit
2015-03-13 10:04:17,827 INFO  util.GSet (LightWeightGSet.java:computeCapacity(330)) - 1.0% max memory = 672 MB
2015-03-13 10:04:17,828 INFO  util.GSet (LightWeightGSet.java:computeCapacity(332)) - capacity      = 2^20 = 1048576 entries
2015-03-13 10:04:17,829 INFO  namenode.NameNode (FSDirectory.java:<init>(173)) - Caching file names occuring more than 10 times
2015-03-13 10:04:17,832 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(4362)) - dfs.namenode.safemode.threshold-pct = 0.9990000128746033
2015-03-13 10:04:17,832 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(4363)) - dfs.namenode.safemode.min.datanodes = 0
2015-03-13 10:04:17,833 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(4364)) - dfs.namenode.safemode.extension     = 0
2015-03-13 10:04:17,834 INFO  namenode.FSNamesystem (FSNamesystem.java:initRetryCache(725)) - Retry cache on namenode is enabled
2015-03-13 10:04:17,835 INFO  namenode.FSNamesystem (FSNamesystem.java:initRetryCache(733)) - Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis
2015-03-13 10:04:17,837 INFO  util.GSet (LightWeightGSet.java:computeCapacity(328)) - Computing capacity for map Namenode Retry Cache
2015-03-13 10:04:17,837 INFO  util.GSet (LightWeightGSet.java:computeCapacity(329)) - VM type       = 64-bit
2015-03-13 10:04:17,837 INFO  util.GSet (LightWeightGSet.java:computeCapacity(330)) - 0.029999999329447746% max memory = 672 MB
2015-03-13 10:04:17,837 INFO  util.GSet (LightWeightGSet.java:computeCapacity(332)) - capacity      = 2^15 = 32768 entries
2015-03-13 10:04:17,876 INFO  common.Storage (NNStorage.java:format(527)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name1 has been successfully formatted.
2015-03-13 10:04:17,877 INFO  common.Storage (NNStorage.java:format(527)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name2 has been successfully formatted.
2015-03-13 10:04:17,886 INFO  namenode.FSImage (FSImageFormat.java:save(976)) - Saving image file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name1/current/fsimage.ckpt_0000000000000000000 using no compression
2015-03-13 10:04:17,886 INFO  namenode.FSImage (FSImageFormat.java:save(976)) - Saving image file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name2/current/fsimage.ckpt_0000000000000000000 using no compression
2015-03-13 10:04:17,895 INFO  namenode.FSImage (FSImageFormat.java:save(1004)) - Image file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name1/current/fsimage.ckpt_0000000000000000000 of size 199 bytes saved in 0 seconds.
2015-03-13 10:04:17,895 INFO  namenode.FSImage (FSImageFormat.java:save(1004)) - Image file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name2/current/fsimage.ckpt_0000000000000000000 of size 199 bytes saved in 0 seconds.
2015-03-13 10:04:17,902 INFO  namenode.NNStorageRetentionManager (NNStorageRetentionManager.java:getImageTxIdToRetain(177)) - Going to retain 1 images with txid >= 0
2015-03-13 10:04:17,933 WARN  impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
2015-03-13 10:04:17,975 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:startTimer(344)) - Scheduled snapshot period at 10 second(s).
2015-03-13 10:04:17,976 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:start(183)) - NameNode metrics system started
2015-03-13 10:04:18,018 INFO  mortbay.log (Slf4jLog.java:info(67)) - Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
2015-03-13 10:04:18,055 INFO  http.HttpServer (HttpServer.java:addGlobalFilter(525)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2015-03-13 10:04:18,057 INFO  http.HttpServer (HttpServer.java:addFilter(503)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context hdfs
2015-03-13 10:04:18,058 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-03-13 10:04:18,058 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-03-13 10:04:18,069 INFO  http.HttpServer (WebHdfsFileSystem.java:isEnabled(157)) - dfs.webhdfs.enabled = false
2015-03-13 10:04:18,080 INFO  http.HttpServer (HttpServer.java:start(687)) - Jetty bound to port 60684
2015-03-13 10:04:18,080 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2015-03-13 10:04:18,101 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-hdfs/2.2.0/9f20694a2b243f5511f1da3c2812bbb27cef24aa/hadoop-hdfs-2.2.0-tests.jar!/webapps/hdfs to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_localhost_60684_hdfs____.4wjvdq/webapp
2015-03-13 10:04:18,333 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@localhost:60684
2015-03-13 10:04:18,334 INFO  namenode.NameNode (NameNode.java:setHttpServerAddress(439)) - Web-server up at: localhost:60684
2015-03-13 10:04:18,336 INFO  namenode.HostFileManager (HostFileManager.java:refresh(304)) - read includes:
HostSet(
)
2015-03-13 10:04:18,336 INFO  namenode.HostFileManager (HostFileManager.java:refresh(311)) - read excludes:
HostSet(
)
2015-03-13 10:04:18,337 INFO  blockmanagement.DatanodeManager (DatanodeManager.java:<init>(210)) - dfs.block.invalidate.limit=1000
2015-03-13 10:04:18,337 INFO  util.GSet (LightWeightGSet.java:computeCapacity(328)) - Computing capacity for map BlocksMap
2015-03-13 10:04:18,337 INFO  util.GSet (LightWeightGSet.java:computeCapacity(329)) - VM type       = 64-bit
2015-03-13 10:04:18,337 INFO  util.GSet (LightWeightGSet.java:computeCapacity(330)) - 2.0% max memory = 672 MB
2015-03-13 10:04:18,338 INFO  util.GSet (LightWeightGSet.java:computeCapacity(332)) - capacity      = 2^21 = 2097152 entries
2015-03-13 10:04:18,339 INFO  blockmanagement.BlockManager (BlockManager.java:createBlockTokenSecretManager(314)) - dfs.block.access.token.enable=false
2015-03-13 10:04:18,340 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(300)) - defaultReplication         = 3
2015-03-13 10:04:18,340 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(301)) - maxReplication             = 512
2015-03-13 10:04:18,340 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(302)) - minReplication             = 1
2015-03-13 10:04:18,341 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(303)) - maxReplicationStreams      = 2
2015-03-13 10:04:18,341 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(304)) - shouldCheckForEnoughRacks  = false
2015-03-13 10:04:18,342 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(305)) - replicationRecheckInterval = 3000
2015-03-13 10:04:18,342 INFO  blockmanagement.BlockManager (BlockManager.java:<init>(306)) - encryptDataTransfer        = false
2015-03-13 10:04:18,342 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(612)) - fsOwner             = soberoi (auth:SIMPLE)
2015-03-13 10:04:18,343 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(613)) - supergroup          = supergroup
2015-03-13 10:04:18,343 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(614)) - isPermissionEnabled = true
2015-03-13 10:04:18,344 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(628)) - HA Enabled: false
2015-03-13 10:04:18,344 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(665)) - Append Enabled: true
2015-03-13 10:04:18,344 INFO  util.GSet (LightWeightGSet.java:computeCapacity(328)) - Computing capacity for map INodeMap
2015-03-13 10:04:18,345 INFO  util.GSet (LightWeightGSet.java:computeCapacity(329)) - VM type       = 64-bit
2015-03-13 10:04:18,345 INFO  util.GSet (LightWeightGSet.java:computeCapacity(330)) - 1.0% max memory = 672 MB
2015-03-13 10:04:18,345 INFO  util.GSet (LightWeightGSet.java:computeCapacity(332)) - capacity      = 2^20 = 1048576 entries
2015-03-13 10:04:18,346 INFO  namenode.NameNode (FSDirectory.java:<init>(173)) - Caching file names occuring more than 10 times
2015-03-13 10:04:18,347 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(4362)) - dfs.namenode.safemode.threshold-pct = 0.9990000128746033
2015-03-13 10:04:18,347 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(4363)) - dfs.namenode.safemode.min.datanodes = 0
2015-03-13 10:04:18,347 INFO  namenode.FSNamesystem (FSNamesystem.java:<init>(4364)) - dfs.namenode.safemode.extension     = 0
2015-03-13 10:04:18,348 INFO  namenode.FSNamesystem (FSNamesystem.java:initRetryCache(725)) - Retry cache on namenode is enabled
2015-03-13 10:04:18,348 INFO  namenode.FSNamesystem (FSNamesystem.java:initRetryCache(733)) - Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis
2015-03-13 10:04:18,348 INFO  util.GSet (LightWeightGSet.java:computeCapacity(328)) - Computing capacity for map Namenode Retry Cache
2015-03-13 10:04:18,349 INFO  util.GSet (LightWeightGSet.java:computeCapacity(329)) - VM type       = 64-bit
2015-03-13 10:04:18,349 INFO  util.GSet (LightWeightGSet.java:computeCapacity(330)) - 0.029999999329447746% max memory = 672 MB
2015-03-13 10:04:18,349 INFO  util.GSet (LightWeightGSet.java:computeCapacity(332)) - capacity      = 2^15 = 32768 entries
2015-03-13 10:04:18,353 INFO  common.Storage (Storage.java:tryLock(665)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name1/in_use.lock acquired by nodename 54873@Edinburgh.local
2015-03-13 10:04:18,356 INFO  common.Storage (Storage.java:tryLock(665)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name2/in_use.lock acquired by nodename 54873@Edinburgh.local
2015-03-13 10:04:18,359 INFO  namenode.FileJournalManager (FileJournalManager.java:recoverUnfinalizedSegments(305)) - Recovering unfinalized segments in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name1/current
2015-03-13 10:04:18,360 INFO  namenode.FileJournalManager (FileJournalManager.java:recoverUnfinalizedSegments(305)) - Recovering unfinalized segments in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name2/current
2015-03-13 10:04:18,361 INFO  namenode.FSImage (FSImage.java:loadFSImage(627)) - No edit log streams selected.
2015-03-13 10:04:18,364 INFO  namenode.FSImage (FSImageFormat.java:load(330)) - Loading image file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name1/current/fsimage_0000000000000000000 using no compression
2015-03-13 10:04:18,365 INFO  namenode.FSImage (FSImageFormat.java:load(333)) - Number of files = 1
2015-03-13 10:04:18,368 INFO  namenode.FSImage (FSImageFormat.java:loadFilesUnderConstruction(815)) - Number of files under construction = 0
2015-03-13 10:04:18,368 INFO  namenode.FSImage (FSImageFormat.java:load(365)) - Image file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name1/current/fsimage_0000000000000000000 of size 199 bytes loaded in 0 seconds.
2015-03-13 10:04:18,369 INFO  namenode.FSImage (FSImage.java:loadFSImage(837)) - Loaded image for txid 0 from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name1/current/fsimage_0000000000000000000
2015-03-13 10:04:18,372 INFO  namenode.FSEditLog (FSEditLog.java:startLogSegment(1010)) - Starting log segment at 1
2015-03-13 10:04:18,424 INFO  namenode.NameCache (NameCache.java:initialized(143)) - initialized with 0 entries 0 lookups
2015-03-13 10:04:18,424 INFO  namenode.FSNamesystem (FSNamesystem.java:loadFromDisk(571)) - Finished loading FSImage in 74 msecs
2015-03-13 10:04:18,550 INFO  namenode.NameNode (NameNodeRpcServer.java:<init>(271)) - RPC server is binding to localhost:0
2015-03-13 10:04:18,563 INFO  ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 60685
2015-03-13 10:04:18,578 INFO  namenode.FSNamesystem (FSNamesystem.java:registerMBean(5310)) - Registered FSNamesystemState MBean
2015-03-13 10:04:18,592 INFO  namenode.FSNamesystem (FSNamesystem.java:getCompleteBlocksTotal(4965)) - Number of blocks under construction: 0
2015-03-13 10:04:18,592 INFO  namenode.FSNamesystem (FSNamesystem.java:getCompleteBlocksTotal(4965)) - Number of blocks under construction: 0
2015-03-13 10:04:18,592 INFO  namenode.FSNamesystem (FSNamesystem.java:initializeReplQueues(4475)) - initializing replication queues
2015-03-13 10:04:18,600 INFO  blockmanagement.BlockManager (BlockManager.java:processMisReplicatedBlocks(2316)) - Total number of blocks            = 0
2015-03-13 10:04:18,600 INFO  blockmanagement.BlockManager (BlockManager.java:processMisReplicatedBlocks(2317)) - Number of invalid blocks          = 0
2015-03-13 10:04:18,601 INFO  blockmanagement.BlockManager (BlockManager.java:processMisReplicatedBlocks(2318)) - Number of under-replicated blocks = 0
2015-03-13 10:04:18,601 INFO  blockmanagement.BlockManager (BlockManager.java:processMisReplicatedBlocks(2319)) - Number of  over-replicated blocks = 0
2015-03-13 10:04:18,601 INFO  blockmanagement.BlockManager (BlockManager.java:processMisReplicatedBlocks(2321)) - Number of blocks being written    = 0
2015-03-13 10:04:18,601 INFO  hdfs.StateChange (FSNamesystem.java:initializeReplQueues(4480)) - STATE* Replication Queue initialization scan for invalid, over- and under-replicated blocks completed in 8 msec
2015-03-13 10:04:18,602 INFO  hdfs.StateChange (FSNamesystem.java:leave(4444)) - STATE* Leaving safe mode after 0 secs
2015-03-13 10:04:18,602 INFO  hdfs.StateChange (FSNamesystem.java:leave(4455)) - STATE* Network topology has 0 racks and 0 datanodes
2015-03-13 10:04:18,602 INFO  hdfs.StateChange (FSNamesystem.java:leave(4458)) - STATE* UnderReplicatedBlocks has 0 blocks
2015-03-13 10:04:18,618 INFO  ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:04:18,618 INFO  ipc.Server (Server.java:run(688)) - IPC Server listener on 60685: starting
2015-03-13 10:04:18,620 INFO  namenode.NameNode (NameNode.java:startCommonServices(570)) - NameNode RPC up at: localhost/127.0.0.1:60685
2015-03-13 10:04:18,621 INFO  namenode.FSNamesystem (FSNamesystem.java:startActiveServices(886)) - Starting services required for active state
2015-03-13 10:04:18,742 INFO  hdfs.MiniDFSCluster (MiniDFSCluster.java:startDataNodes(1159)) - Starting DataNode 0 with dfs.datanode.data.dir: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1,file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2
2015-03-13 10:04:18,808 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - DataNode metrics system started (again)
2015-03-13 10:04:18,809 INFO  datanode.DataNode (DataNode.java:<init>(258)) - Configured hostname is 127.0.0.1
2015-03-13 10:04:18,813 INFO  datanode.DataNode (DataNode.java:initDataXceiver(482)) - Opened streaming server at /127.0.0.1:60686
2015-03-13 10:04:18,816 INFO  datanode.DataNode (DataXceiverServer.java:<init>(73)) - Balancing bandwith is 1048576 bytes/s
2015-03-13 10:04:18,817 INFO  http.HttpServer (HttpServer.java:addGlobalFilter(525)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2015-03-13 10:04:18,818 INFO  http.HttpServer (HttpServer.java:addFilter(503)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context datanode
2015-03-13 10:04:18,818 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-03-13 10:04:18,819 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-03-13 10:04:18,820 INFO  datanode.DataNode (DataNode.java:startInfoServer(312)) - Opened info server at localhost:0
2015-03-13 10:04:18,821 INFO  datanode.DataNode (WebHdfsFileSystem.java:isEnabled(157)) - dfs.webhdfs.enabled = false
2015-03-13 10:04:18,822 INFO  http.HttpServer (HttpServer.java:start(687)) - Jetty bound to port 60687
2015-03-13 10:04:18,822 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2015-03-13 10:04:18,826 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-hdfs/2.2.0/9f20694a2b243f5511f1da3c2812bbb27cef24aa/hadoop-hdfs-2.2.0-tests.jar!/webapps/datanode to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_localhost_60687_datanode____.zf60v2/webapp
2015-03-13 10:04:18,930 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@localhost:60687
2015-03-13 10:04:18,938 INFO  ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 60688
2015-03-13 10:04:18,943 INFO  datanode.DataNode (DataNode.java:initIpcServer(384)) - Opened IPC server at /127.0.0.1:60688
2015-03-13 10:04:18,951 INFO  datanode.DataNode (BlockPoolManager.java:refreshNamenodes(148)) - Refresh request received for nameservices: null
2015-03-13 10:04:18,956 INFO  datanode.DataNode (BlockPoolManager.java:doRefreshNamenodes(193)) - Starting BPOfferServices for nameservices: <default>
2015-03-13 10:04:18,961 INFO  datanode.DataNode (BPServiceActor.java:run(658)) - Block pool <registering> (storage id unknown) service to localhost/127.0.0.1:60685 starting to offer service
2015-03-13 10:04:18,963 INFO  ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:04:18,963 INFO  ipc.Server (Server.java:run(688)) - IPC Server listener on 60688: starting
2015-03-13 10:04:18,966 INFO  hdfs.MiniDFSCluster (MiniDFSCluster.java:startDataNodes(1159)) - Starting DataNode 1 with dfs.datanode.data.dir: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3,file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4
2015-03-13 10:04:18,990 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - DataNode metrics system started (again)
2015-03-13 10:04:18,990 INFO  datanode.DataNode (DataNode.java:<init>(258)) - Configured hostname is 127.0.0.1
2015-03-13 10:04:18,991 INFO  datanode.DataNode (DataNode.java:initDataXceiver(482)) - Opened streaming server at /127.0.0.1:60689
2015-03-13 10:04:18,991 INFO  datanode.DataNode (DataXceiverServer.java:<init>(73)) - Balancing bandwith is 1048576 bytes/s
2015-03-13 10:04:18,993 INFO  http.HttpServer (HttpServer.java:addGlobalFilter(525)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2015-03-13 10:04:18,994 INFO  http.HttpServer (HttpServer.java:addFilter(503)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context datanode
2015-03-13 10:04:18,995 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-03-13 10:04:18,995 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-03-13 10:04:18,996 INFO  datanode.DataNode (DataNode.java:startInfoServer(312)) - Opened info server at localhost:0
2015-03-13 10:04:18,999 INFO  datanode.DataNode (WebHdfsFileSystem.java:isEnabled(157)) - dfs.webhdfs.enabled = false
2015-03-13 10:04:19,001 INFO  http.HttpServer (HttpServer.java:start(687)) - Jetty bound to port 60690
2015-03-13 10:04:19,002 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2015-03-13 10:04:19,013 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-hdfs/2.2.0/9f20694a2b243f5511f1da3c2812bbb27cef24aa/hadoop-hdfs-2.2.0-tests.jar!/webapps/datanode to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_localhost_60690_datanode____.9tddxi/webapp
2015-03-13 10:04:19,137 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@localhost:60690
2015-03-13 10:04:19,139 INFO  ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 60692
2015-03-13 10:04:19,141 INFO  datanode.DataNode (DataNode.java:initIpcServer(384)) - Opened IPC server at /127.0.0.1:60692
2015-03-13 10:04:19,146 INFO  datanode.DataNode (BlockPoolManager.java:refreshNamenodes(148)) - Refresh request received for nameservices: null
2015-03-13 10:04:19,146 INFO  datanode.DataNode (BlockPoolManager.java:doRefreshNamenodes(193)) - Starting BPOfferServices for nameservices: <default>
2015-03-13 10:04:19,147 INFO  datanode.DataNode (BPServiceActor.java:run(658)) - Block pool <registering> (storage id unknown) service to localhost/127.0.0.1:60685 starting to offer service
2015-03-13 10:04:19,149 INFO  ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:04:19,149 INFO  ipc.Server (Server.java:run(688)) - IPC Server listener on 60692: starting
2015-03-13 10:04:19,151 INFO  hdfs.MiniDFSCluster (MiniDFSCluster.java:startDataNodes(1159)) - Starting DataNode 2 with dfs.datanode.data.dir: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5,file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6
2015-03-13 10:04:19,161 INFO  common.Storage (Storage.java:tryLock(665)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/in_use.lock acquired by nodename 54873@Edinburgh.local
2015-03-13 10:04:19,161 INFO  common.Storage (Storage.java:tryLock(665)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/in_use.lock acquired by nodename 54873@Edinburgh.local
2015-03-13 10:04:19,162 INFO  common.Storage (DataStorage.java:recoverTransitionRead(163)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1 is not formatted
2015-03-13 10:04:19,162 INFO  common.Storage (DataStorage.java:recoverTransitionRead(163)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3 is not formatted
2015-03-13 10:04:19,162 INFO  common.Storage (DataStorage.java:recoverTransitionRead(164)) - Formatting ...
2015-03-13 10:04:19,162 INFO  common.Storage (DataStorage.java:recoverTransitionRead(164)) - Formatting ...
2015-03-13 10:04:19,164 INFO  common.Storage (Storage.java:tryLock(665)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/in_use.lock acquired by nodename 54873@Edinburgh.local
2015-03-13 10:04:19,164 INFO  common.Storage (Storage.java:tryLock(665)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/in_use.lock acquired by nodename 54873@Edinburgh.local
2015-03-13 10:04:19,164 INFO  common.Storage (DataStorage.java:recoverTransitionRead(163)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4 is not formatted
2015-03-13 10:04:19,164 INFO  common.Storage (DataStorage.java:recoverTransitionRead(163)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2 is not formatted
2015-03-13 10:04:19,164 INFO  common.Storage (DataStorage.java:recoverTransitionRead(164)) - Formatting ...
2015-03-13 10:04:19,164 INFO  common.Storage (DataStorage.java:recoverTransitionRead(164)) - Formatting ...
2015-03-13 10:04:19,181 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - DataNode metrics system started (again)
2015-03-13 10:04:19,182 INFO  datanode.DataNode (DataNode.java:<init>(258)) - Configured hostname is 127.0.0.1
2015-03-13 10:04:19,183 INFO  datanode.DataNode (DataNode.java:initDataXceiver(482)) - Opened streaming server at /127.0.0.1:60693
2015-03-13 10:04:19,183 INFO  datanode.DataNode (DataXceiverServer.java:<init>(73)) - Balancing bandwith is 1048576 bytes/s
2015-03-13 10:04:19,185 INFO  http.HttpServer (HttpServer.java:addGlobalFilter(525)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2015-03-13 10:04:19,186 INFO  http.HttpServer (HttpServer.java:addFilter(503)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context datanode
2015-03-13 10:04:19,187 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-03-13 10:04:19,187 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-03-13 10:04:19,188 INFO  datanode.DataNode (DataNode.java:startInfoServer(312)) - Opened info server at localhost:0
2015-03-13 10:04:19,189 INFO  datanode.DataNode (WebHdfsFileSystem.java:isEnabled(157)) - dfs.webhdfs.enabled = false
2015-03-13 10:04:19,190 INFO  http.HttpServer (HttpServer.java:start(687)) - Jetty bound to port 60694
2015-03-13 10:04:19,190 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2015-03-13 10:04:19,194 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-hdfs/2.2.0/9f20694a2b243f5511f1da3c2812bbb27cef24aa/hadoop-hdfs-2.2.0-tests.jar!/webapps/datanode to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_localhost_60694_datanode____.t83yrm/webapp
2015-03-13 10:04:19,213 INFO  common.Storage (Storage.java:lock(629)) - Locking is disabled
2015-03-13 10:04:19,213 INFO  common.Storage (Storage.java:lock(629)) - Locking is disabled
2015-03-13 10:04:19,214 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(120)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849 is not formatted.
2015-03-13 10:04:19,214 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(121)) - Formatting ...
2015-03-13 10:04:19,214 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(120)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849 is not formatted.
2015-03-13 10:04:19,214 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(121)) - Formatting ...
2015-03-13 10:04:19,214 INFO  common.Storage (BlockPoolSliceStorage.java:format(175)) - Formatting block pool BP-1005356445-10.1.1.144-1426266257849 directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current
2015-03-13 10:04:19,214 INFO  common.Storage (BlockPoolSliceStorage.java:format(175)) - Formatting block pool BP-1005356445-10.1.1.144-1426266257849 directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current
2015-03-13 10:04:19,215 INFO  common.Storage (Storage.java:lock(629)) - Locking is disabled
2015-03-13 10:04:19,215 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(120)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849 is not formatted.
2015-03-13 10:04:19,215 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(121)) - Formatting ...
2015-03-13 10:04:19,215 INFO  common.Storage (Storage.java:lock(629)) - Locking is disabled
2015-03-13 10:04:19,216 INFO  common.Storage (BlockPoolSliceStorage.java:format(175)) - Formatting block pool BP-1005356445-10.1.1.144-1426266257849 directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current
2015-03-13 10:04:19,216 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(120)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849 is not formatted.
2015-03-13 10:04:19,216 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(121)) - Formatting ...
2015-03-13 10:04:19,216 INFO  common.Storage (BlockPoolSliceStorage.java:format(175)) - Formatting block pool BP-1005356445-10.1.1.144-1426266257849 directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current
2015-03-13 10:04:19,218 INFO  datanode.DataNode (DataNode.java:initStorage(839)) - Setting up storage: nsid=799921817;bpid=BP-1005356445-10.1.1.144-1426266257849;lv=-47;nsInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0;bpid=BP-1005356445-10.1.1.144-1426266257849
2015-03-13 10:04:19,218 INFO  datanode.DataNode (DataNode.java:initStorage(839)) - Setting up storage: nsid=799921817;bpid=BP-1005356445-10.1.1.144-1426266257849;lv=-47;nsInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0;bpid=BP-1005356445-10.1.1.144-1426266257849
2015-03-13 10:04:19,228 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:<init>(213)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current
2015-03-13 10:04:19,228 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:<init>(213)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current
2015-03-13 10:04:19,228 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:<init>(213)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current
2015-03-13 10:04:19,228 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:<init>(213)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current
2015-03-13 10:04:19,233 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:registerMBean(1252)) - Registered FSDatasetState MBean
2015-03-13 10:04:19,233 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:registerMBean(1252)) - Registered FSDatasetState MBean
2015-03-13 10:04:19,237 INFO  datanode.DirectoryScanner (DirectoryScanner.java:start(325)) - Periodic Directory Tree Verification scan starting at 1426272710237 with interval 21600000
2015-03-13 10:04:19,238 INFO  datanode.DirectoryScanner (DirectoryScanner.java:start(325)) - Periodic Directory Tree Verification scan starting at 1426283284238 with interval 21600000
2015-03-13 10:04:19,238 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:addBlockPool(1621)) - Adding block pool BP-1005356445-10.1.1.144-1426266257849
2015-03-13 10:04:19,239 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:addBlockPool(1621)) - Adding block pool BP-1005356445-10.1.1.144-1426266257849
2015-03-13 10:04:19,239 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(173)) - Scanning block pool BP-1005356445-10.1.1.144-1426266257849 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current...
2015-03-13 10:04:19,239 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(173)) - Scanning block pool BP-1005356445-10.1.1.144-1426266257849 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current...
2015-03-13 10:04:19,239 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(173)) - Scanning block pool BP-1005356445-10.1.1.144-1426266257849 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current...
2015-03-13 10:04:19,240 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(173)) - Scanning block pool BP-1005356445-10.1.1.144-1426266257849 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current...
2015-03-13 10:04:19,250 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(178)) - Time taken to scan block pool BP-1005356445-10.1.1.144-1426266257849 on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current: 11ms
2015-03-13 10:04:19,250 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(178)) - Time taken to scan block pool BP-1005356445-10.1.1.144-1426266257849 on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current: 10ms
2015-03-13 10:04:19,250 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(178)) - Time taken to scan block pool BP-1005356445-10.1.1.144-1426266257849 on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current: 11ms
2015-03-13 10:04:19,250 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(178)) - Time taken to scan block pool BP-1005356445-10.1.1.144-1426266257849 on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current: 11ms
2015-03-13 10:04:19,250 INFO  impl.FsDatasetImpl (FsVolumeList.java:addBlockPool(202)) - Total time to scan all replicas for block pool BP-1005356445-10.1.1.144-1426266257849: 12ms
2015-03-13 10:04:19,250 INFO  impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(104)) - Adding replicas to map for block pool BP-1005356445-10.1.1.144-1426266257849 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current...
2015-03-13 10:04:19,250 INFO  impl.FsDatasetImpl (FsVolumeList.java:addBlockPool(202)) - Total time to scan all replicas for block pool BP-1005356445-10.1.1.144-1426266257849: 11ms
2015-03-13 10:04:19,251 INFO  impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(109)) - Time to add replicas to map for block pool BP-1005356445-10.1.1.144-1426266257849 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current: 0ms
2015-03-13 10:04:19,251 INFO  impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(104)) - Adding replicas to map for block pool BP-1005356445-10.1.1.144-1426266257849 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current...
2015-03-13 10:04:19,251 INFO  impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(104)) - Adding replicas to map for block pool BP-1005356445-10.1.1.144-1426266257849 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current...
2015-03-13 10:04:19,251 INFO  impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(109)) - Time to add replicas to map for block pool BP-1005356445-10.1.1.144-1426266257849 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current: 0ms
2015-03-13 10:04:19,252 INFO  impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(109)) - Time to add replicas to map for block pool BP-1005356445-10.1.1.144-1426266257849 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current: 0ms
2015-03-13 10:04:19,252 INFO  impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(104)) - Adding replicas to map for block pool BP-1005356445-10.1.1.144-1426266257849 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current...
2015-03-13 10:04:19,252 INFO  impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(113)) - Total time to add all replicas to map: 2ms
2015-03-13 10:04:19,253 INFO  impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(109)) - Time to add replicas to map for block pool BP-1005356445-10.1.1.144-1426266257849 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current: 0ms
2015-03-13 10:04:19,253 INFO  impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(113)) - Total time to add all replicas to map: 2ms
2015-03-13 10:04:19,255 INFO  datanode.DataNode (BPServiceActor.java:register(618)) - Block pool BP-1005356445-10.1.1.144-1426266257849 (storage id DS-1172757413-10.1.1.144-60689-1426266259165) service to localhost/127.0.0.1:60685 beginning handshake with NN
2015-03-13 10:04:19,255 INFO  datanode.DataNode (BPServiceActor.java:register(618)) - Block pool BP-1005356445-10.1.1.144-1426266257849 (storage id DS-1907321454-10.1.1.144-60686-1426266259166) service to localhost/127.0.0.1:60685 beginning handshake with NN
2015-03-13 10:04:19,264 INFO  hdfs.StateChange (DatanodeManager.java:registerDatanode(755)) - BLOCK* registerDatanode: from DatanodeRegistration(127.0.0.1, storageID=DS-1907321454-10.1.1.144-60686-1426266259166, infoPort=60687, ipcPort=60688, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) storage DS-1907321454-10.1.1.144-60686-1426266259166
2015-03-13 10:04:19,266 INFO  net.NetworkTopology (NetworkTopology.java:add(413)) - Adding a new node: /default-rack/127.0.0.1:60686
2015-03-13 10:04:19,267 INFO  hdfs.StateChange (DatanodeManager.java:registerDatanode(755)) - BLOCK* registerDatanode: from DatanodeRegistration(127.0.0.1, storageID=DS-1172757413-10.1.1.144-60689-1426266259165, infoPort=60690, ipcPort=60692, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) storage DS-1172757413-10.1.1.144-60689-1426266259165
2015-03-13 10:04:19,267 INFO  net.NetworkTopology (NetworkTopology.java:add(413)) - Adding a new node: /default-rack/127.0.0.1:60689
2015-03-13 10:04:19,269 INFO  datanode.DataNode (BPServiceActor.java:register(631)) - Block pool Block pool BP-1005356445-10.1.1.144-1426266257849 (storage id DS-1172757413-10.1.1.144-60689-1426266259165) service to localhost/127.0.0.1:60685 successfully registered with NN
2015-03-13 10:04:19,270 INFO  datanode.DataNode (BPServiceActor.java:offerService(499)) - For namenode localhost/127.0.0.1:60685 using DELETEREPORT_INTERVAL of 300000 msec  BLOCKREPORT_INTERVAL of 21600000msec Initial delay: 0msec; heartBeatInterval=3000
2015-03-13 10:04:19,273 INFO  datanode.DataNode (BPServiceActor.java:register(631)) - Block pool Block pool BP-1005356445-10.1.1.144-1426266257849 (storage id DS-1907321454-10.1.1.144-60686-1426266259166) service to localhost/127.0.0.1:60685 successfully registered with NN
2015-03-13 10:04:19,273 INFO  datanode.DataNode (BPServiceActor.java:offerService(499)) - For namenode localhost/127.0.0.1:60685 using DELETEREPORT_INTERVAL of 300000 msec  BLOCKREPORT_INTERVAL of 21600000msec Initial delay: 0msec; heartBeatInterval=3000
2015-03-13 10:04:19,301 INFO  datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(421)) - Namenode Block pool BP-1005356445-10.1.1.144-1426266257849 (storage id DS-1172757413-10.1.1.144-60689-1426266259165) service to localhost/127.0.0.1:60685 trying to claim ACTIVE state with txid=1
2015-03-13 10:04:19,302 INFO  datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(433)) - Acknowledging ACTIVE Namenode Block pool BP-1005356445-10.1.1.144-1426266257849 (storage id DS-1172757413-10.1.1.144-60689-1426266259165) service to localhost/127.0.0.1:60685
2015-03-13 10:04:19,302 INFO  datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(421)) - Namenode Block pool BP-1005356445-10.1.1.144-1426266257849 (storage id DS-1907321454-10.1.1.144-60686-1426266259166) service to localhost/127.0.0.1:60685 trying to claim ACTIVE state with txid=1
2015-03-13 10:04:19,302 INFO  datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(433)) - Acknowledging ACTIVE Namenode Block pool BP-1005356445-10.1.1.144-1426266257849 (storage id DS-1907321454-10.1.1.144-60686-1426266259166) service to localhost/127.0.0.1:60685
2015-03-13 10:04:19,314 INFO  blockmanagement.BlockManager (BlockManager.java:processReport(1631)) - BLOCK* processReport: Received first block report from 127.0.0.1:60686 after starting up or becoming active. Its block contents are no longer considered stale
2015-03-13 10:04:19,314 INFO  blockmanagement.BlockManager (BlockManager.java:processReport(1631)) - BLOCK* processReport: Received first block report from 127.0.0.1:60689 after starting up or becoming active. Its block contents are no longer considered stale
2015-03-13 10:04:19,314 INFO  BlockStateChange (BlockManager.java:processReport(1647)) - BLOCK* processReport: from DatanodeRegistration(127.0.0.1, storageID=DS-1907321454-10.1.1.144-60686-1426266259166, infoPort=60687, ipcPort=60688, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0), blocks: 0, processing time: 1 msecs
2015-03-13 10:04:19,314 INFO  BlockStateChange (BlockManager.java:processReport(1647)) - BLOCK* processReport: from DatanodeRegistration(127.0.0.1, storageID=DS-1172757413-10.1.1.144-60689-1426266259165, infoPort=60690, ipcPort=60692, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0), blocks: 0, processing time: 0 msecs
2015-03-13 10:04:19,352 INFO  datanode.DataNode (BPServiceActor.java:blockReport(409)) - BlockReport of 0 blocks took 1 msec to generate and 49 msecs for RPC and NN processing
2015-03-13 10:04:19,352 INFO  datanode.DataNode (BPServiceActor.java:blockReport(428)) - sent block report, processed command:org.apache.hadoop.hdfs.server.protocol.FinalizeCommand@769dac96
2015-03-13 10:04:19,353 INFO  datanode.DataNode (BPServiceActor.java:blockReport(409)) - BlockReport of 0 blocks took 1 msec to generate and 50 msecs for RPC and NN processing
2015-03-13 10:04:19,353 INFO  datanode.DataNode (BPServiceActor.java:blockReport(428)) - sent block report, processed command:org.apache.hadoop.hdfs.server.protocol.FinalizeCommand@3ce639a2
2015-03-13 10:04:19,357 INFO  util.GSet (LightWeightGSet.java:computeCapacity(328)) - Computing capacity for map BlockMap
2015-03-13 10:04:19,357 INFO  util.GSet (LightWeightGSet.java:computeCapacity(328)) - Computing capacity for map BlockMap
2015-03-13 10:04:19,357 INFO  util.GSet (LightWeightGSet.java:computeCapacity(329)) - VM type       = 64-bit
2015-03-13 10:04:19,357 INFO  util.GSet (LightWeightGSet.java:computeCapacity(329)) - VM type       = 64-bit
2015-03-13 10:04:19,358 INFO  util.GSet (LightWeightGSet.java:computeCapacity(330)) - 0.5% max memory = 672 MB
2015-03-13 10:04:19,358 INFO  util.GSet (LightWeightGSet.java:computeCapacity(332)) - capacity      = 2^19 = 524288 entries
2015-03-13 10:04:19,358 INFO  util.GSet (LightWeightGSet.java:computeCapacity(330)) - 0.5% max memory = 672 MB
2015-03-13 10:04:19,358 INFO  util.GSet (LightWeightGSet.java:computeCapacity(332)) - capacity      = 2^19 = 524288 entries
2015-03-13 10:04:19,358 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:<init>(186)) - Periodic Block Verification Scanner initialized with interval 504 hours for block pool BP-1005356445-10.1.1.144-1426266257849
2015-03-13 10:04:19,358 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:<init>(186)) - Periodic Block Verification Scanner initialized with interval 504 hours for block pool BP-1005356445-10.1.1.144-1426266257849
2015-03-13 10:04:19,361 INFO  datanode.DataBlockScanner (DataBlockScanner.java:addBlockPool(265)) - Added bpid=BP-1005356445-10.1.1.144-1426266257849 to blockPoolScannerMap, new size=1
2015-03-13 10:04:19,362 INFO  datanode.DataBlockScanner (DataBlockScanner.java:addBlockPool(265)) - Added bpid=BP-1005356445-10.1.1.144-1426266257849 to blockPoolScannerMap, new size=1
2015-03-13 10:04:19,372 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@localhost:60694
2015-03-13 10:04:19,374 INFO  ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 60695
2015-03-13 10:04:19,377 INFO  datanode.DataNode (DataNode.java:initIpcServer(384)) - Opened IPC server at /127.0.0.1:60695
2015-03-13 10:04:19,382 INFO  datanode.DataNode (BlockPoolManager.java:refreshNamenodes(148)) - Refresh request received for nameservices: null
2015-03-13 10:04:19,383 INFO  datanode.DataNode (BlockPoolManager.java:doRefreshNamenodes(193)) - Starting BPOfferServices for nameservices: <default>
2015-03-13 10:04:19,384 INFO  datanode.DataNode (BPServiceActor.java:run(658)) - Block pool <registering> (storage id unknown) service to localhost/127.0.0.1:60685 starting to offer service
2015-03-13 10:04:19,384 INFO  ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:04:19,384 INFO  ipc.Server (Server.java:run(688)) - IPC Server listener on 60695: starting
2015-03-13 10:04:19,387 INFO  hdfs.MiniDFSCluster (MiniDFSCluster.java:startDataNodes(1159)) - Starting DataNode 3 with dfs.datanode.data.dir: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7,file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8
2015-03-13 10:04:19,387 INFO  common.Storage (Storage.java:tryLock(665)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/in_use.lock acquired by nodename 54873@Edinburgh.local
2015-03-13 10:04:19,387 INFO  common.Storage (DataStorage.java:recoverTransitionRead(163)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5 is not formatted
2015-03-13 10:04:19,387 INFO  common.Storage (DataStorage.java:recoverTransitionRead(164)) - Formatting ...
2015-03-13 10:04:19,388 INFO  common.Storage (Storage.java:tryLock(665)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/in_use.lock acquired by nodename 54873@Edinburgh.local
2015-03-13 10:04:19,388 INFO  common.Storage (DataStorage.java:recoverTransitionRead(163)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6 is not formatted
2015-03-13 10:04:19,389 INFO  common.Storage (DataStorage.java:recoverTransitionRead(164)) - Formatting ...
2015-03-13 10:04:19,417 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - DataNode metrics system started (again)
2015-03-13 10:04:19,417 INFO  datanode.DataNode (DataNode.java:<init>(258)) - Configured hostname is 127.0.0.1
2015-03-13 10:04:19,418 INFO  datanode.DataNode (DataNode.java:initDataXceiver(482)) - Opened streaming server at /127.0.0.1:60696
2015-03-13 10:04:19,419 INFO  datanode.DataNode (DataXceiverServer.java:<init>(73)) - Balancing bandwith is 1048576 bytes/s
2015-03-13 10:04:19,420 INFO  http.HttpServer (HttpServer.java:addGlobalFilter(525)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2015-03-13 10:04:19,422 INFO  http.HttpServer (HttpServer.java:addFilter(503)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context datanode
2015-03-13 10:04:19,423 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-03-13 10:04:19,423 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-03-13 10:04:19,424 INFO  datanode.DataNode (DataNode.java:startInfoServer(312)) - Opened info server at localhost:0
2015-03-13 10:04:19,425 INFO  datanode.DataNode (WebHdfsFileSystem.java:isEnabled(157)) - dfs.webhdfs.enabled = false
2015-03-13 10:04:19,426 INFO  http.HttpServer (HttpServer.java:start(687)) - Jetty bound to port 60697
2015-03-13 10:04:19,426 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2015-03-13 10:04:19,430 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-hdfs/2.2.0/9f20694a2b243f5511f1da3c2812bbb27cef24aa/hadoop-hdfs-2.2.0-tests.jar!/webapps/datanode to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_localhost_60697_datanode____r8y5kx/webapp
2015-03-13 10:04:19,431 INFO  common.Storage (Storage.java:lock(629)) - Locking is disabled
2015-03-13 10:04:19,431 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(120)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849 is not formatted.
2015-03-13 10:04:19,431 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(121)) - Formatting ...
2015-03-13 10:04:19,431 INFO  common.Storage (BlockPoolSliceStorage.java:format(175)) - Formatting block pool BP-1005356445-10.1.1.144-1426266257849 directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current
2015-03-13 10:04:19,432 INFO  common.Storage (Storage.java:lock(629)) - Locking is disabled
2015-03-13 10:04:19,432 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(120)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849 is not formatted.
2015-03-13 10:04:19,432 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(121)) - Formatting ...
2015-03-13 10:04:19,432 INFO  common.Storage (BlockPoolSliceStorage.java:format(175)) - Formatting block pool BP-1005356445-10.1.1.144-1426266257849 directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current
2015-03-13 10:04:19,434 INFO  datanode.DataNode (DataNode.java:initStorage(839)) - Setting up storage: nsid=799921817;bpid=BP-1005356445-10.1.1.144-1426266257849;lv=-47;nsInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0;bpid=BP-1005356445-10.1.1.144-1426266257849
2015-03-13 10:04:19,434 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:<init>(213)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current
2015-03-13 10:04:19,434 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:<init>(213)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current
2015-03-13 10:04:19,435 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:registerMBean(1252)) - Registered FSDatasetState MBean
2015-03-13 10:04:19,436 INFO  datanode.DirectoryScanner (DirectoryScanner.java:start(325)) - Periodic Directory Tree Verification scan starting at 1426286221436 with interval 21600000
2015-03-13 10:04:19,436 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:addBlockPool(1621)) - Adding block pool BP-1005356445-10.1.1.144-1426266257849
2015-03-13 10:04:19,437 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(173)) - Scanning block pool BP-1005356445-10.1.1.144-1426266257849 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current...
2015-03-13 10:04:19,437 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(173)) - Scanning block pool BP-1005356445-10.1.1.144-1426266257849 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current...
2015-03-13 10:04:19,443 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(178)) - Time taken to scan block pool BP-1005356445-10.1.1.144-1426266257849 on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current: 6ms
2015-03-13 10:04:19,443 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(178)) - Time taken to scan block pool BP-1005356445-10.1.1.144-1426266257849 on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current: 6ms
2015-03-13 10:04:19,443 INFO  impl.FsDatasetImpl (FsVolumeList.java:addBlockPool(202)) - Total time to scan all replicas for block pool BP-1005356445-10.1.1.144-1426266257849: 7ms
2015-03-13 10:04:19,443 INFO  impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(104)) - Adding replicas to map for block pool BP-1005356445-10.1.1.144-1426266257849 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current...
2015-03-13 10:04:19,443 INFO  impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(109)) - Time to add replicas to map for block pool BP-1005356445-10.1.1.144-1426266257849 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current: 0ms
2015-03-13 10:04:19,443 INFO  impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(104)) - Adding replicas to map for block pool BP-1005356445-10.1.1.144-1426266257849 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current...
2015-03-13 10:04:19,444 INFO  impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(109)) - Time to add replicas to map for block pool BP-1005356445-10.1.1.144-1426266257849 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current: 0ms
2015-03-13 10:04:19,444 INFO  impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(113)) - Total time to add all replicas to map: 1ms
2015-03-13 10:04:19,444 INFO  datanode.DataNode (BPServiceActor.java:register(618)) - Block pool BP-1005356445-10.1.1.144-1426266257849 (storage id DS-1589780806-10.1.1.144-60693-1426266259390) service to localhost/127.0.0.1:60685 beginning handshake with NN
2015-03-13 10:04:19,445 INFO  hdfs.StateChange (DatanodeManager.java:registerDatanode(755)) - BLOCK* registerDatanode: from DatanodeRegistration(127.0.0.1, storageID=DS-1589780806-10.1.1.144-60693-1426266259390, infoPort=60694, ipcPort=60695, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) storage DS-1589780806-10.1.1.144-60693-1426266259390
2015-03-13 10:04:19,445 INFO  net.NetworkTopology (NetworkTopology.java:add(413)) - Adding a new node: /default-rack/127.0.0.1:60693
2015-03-13 10:04:19,446 INFO  datanode.DataNode (BPServiceActor.java:register(631)) - Block pool Block pool BP-1005356445-10.1.1.144-1426266257849 (storage id DS-1589780806-10.1.1.144-60693-1426266259390) service to localhost/127.0.0.1:60685 successfully registered with NN
2015-03-13 10:04:19,446 INFO  datanode.DataNode (BPServiceActor.java:offerService(499)) - For namenode localhost/127.0.0.1:60685 using DELETEREPORT_INTERVAL of 300000 msec  BLOCKREPORT_INTERVAL of 21600000msec Initial delay: 0msec; heartBeatInterval=3000
2015-03-13 10:04:19,448 INFO  datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(421)) - Namenode Block pool BP-1005356445-10.1.1.144-1426266257849 (storage id DS-1589780806-10.1.1.144-60693-1426266259390) service to localhost/127.0.0.1:60685 trying to claim ACTIVE state with txid=1
2015-03-13 10:04:19,448 INFO  datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(433)) - Acknowledging ACTIVE Namenode Block pool BP-1005356445-10.1.1.144-1426266257849 (storage id DS-1589780806-10.1.1.144-60693-1426266259390) service to localhost/127.0.0.1:60685
2015-03-13 10:04:19,449 INFO  blockmanagement.BlockManager (BlockManager.java:processReport(1631)) - BLOCK* processReport: Received first block report from 127.0.0.1:60693 after starting up or becoming active. Its block contents are no longer considered stale
2015-03-13 10:04:19,449 INFO  BlockStateChange (BlockManager.java:processReport(1647)) - BLOCK* processReport: from DatanodeRegistration(127.0.0.1, storageID=DS-1589780806-10.1.1.144-60693-1426266259390, infoPort=60694, ipcPort=60695, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0), blocks: 0, processing time: 0 msecs
2015-03-13 10:04:19,450 INFO  datanode.DataNode (BPServiceActor.java:blockReport(409)) - BlockReport of 0 blocks took 0 msec to generate and 2 msecs for RPC and NN processing
2015-03-13 10:04:19,450 INFO  datanode.DataNode (BPServiceActor.java:blockReport(428)) - sent block report, processed command:org.apache.hadoop.hdfs.server.protocol.FinalizeCommand@7f34784e
2015-03-13 10:04:19,450 INFO  util.GSet (LightWeightGSet.java:computeCapacity(328)) - Computing capacity for map BlockMap
2015-03-13 10:04:19,450 INFO  util.GSet (LightWeightGSet.java:computeCapacity(329)) - VM type       = 64-bit
2015-03-13 10:04:19,450 INFO  util.GSet (LightWeightGSet.java:computeCapacity(330)) - 0.5% max memory = 672 MB
2015-03-13 10:04:19,450 INFO  util.GSet (LightWeightGSet.java:computeCapacity(332)) - capacity      = 2^19 = 524288 entries
2015-03-13 10:04:19,451 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:<init>(186)) - Periodic Block Verification Scanner initialized with interval 504 hours for block pool BP-1005356445-10.1.1.144-1426266257849
2015-03-13 10:04:19,451 INFO  datanode.DataBlockScanner (DataBlockScanner.java:addBlockPool(265)) - Added bpid=BP-1005356445-10.1.1.144-1426266257849 to blockPoolScannerMap, new size=1
2015-03-13 10:04:19,552 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@localhost:60697
2015-03-13 10:04:19,553 INFO  ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 60698
2015-03-13 10:04:19,556 INFO  datanode.DataNode (DataNode.java:initIpcServer(384)) - Opened IPC server at /127.0.0.1:60698
2015-03-13 10:04:19,561 INFO  datanode.DataNode (BlockPoolManager.java:refreshNamenodes(148)) - Refresh request received for nameservices: null
2015-03-13 10:04:19,561 INFO  datanode.DataNode (BlockPoolManager.java:doRefreshNamenodes(193)) - Starting BPOfferServices for nameservices: <default>
2015-03-13 10:04:19,563 INFO  datanode.DataNode (BPServiceActor.java:run(658)) - Block pool <registering> (storage id unknown) service to localhost/127.0.0.1:60685 starting to offer service
2015-03-13 10:04:19,563 INFO  ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:04:19,564 INFO  ipc.Server (Server.java:run(688)) - IPC Server listener on 60698: starting
2015-03-13 10:04:19,566 INFO  common.Storage (Storage.java:tryLock(665)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/in_use.lock acquired by nodename 54873@Edinburgh.local
2015-03-13 10:04:19,566 INFO  common.Storage (DataStorage.java:recoverTransitionRead(163)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7 is not formatted
2015-03-13 10:04:19,566 INFO  common.Storage (DataStorage.java:recoverTransitionRead(164)) - Formatting ...
2015-03-13 10:04:19,570 INFO  common.Storage (Storage.java:tryLock(665)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/in_use.lock acquired by nodename 54873@Edinburgh.local
2015-03-13 10:04:19,570 INFO  common.Storage (DataStorage.java:recoverTransitionRead(163)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8 is not formatted
2015-03-13 10:04:19,570 INFO  common.Storage (DataStorage.java:recoverTransitionRead(164)) - Formatting ...
2015-03-13 10:04:19,611 INFO  common.Storage (Storage.java:lock(629)) - Locking is disabled
2015-03-13 10:04:19,611 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(120)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849 is not formatted.
2015-03-13 10:04:19,611 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(121)) - Formatting ...
2015-03-13 10:04:19,611 INFO  common.Storage (BlockPoolSliceStorage.java:format(175)) - Formatting block pool BP-1005356445-10.1.1.144-1426266257849 directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current
2015-03-13 10:04:19,612 INFO  common.Storage (Storage.java:lock(629)) - Locking is disabled
2015-03-13 10:04:19,612 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(120)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849 is not formatted.
2015-03-13 10:04:19,612 INFO  common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(121)) - Formatting ...
2015-03-13 10:04:19,612 INFO  common.Storage (BlockPoolSliceStorage.java:format(175)) - Formatting block pool BP-1005356445-10.1.1.144-1426266257849 directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current
2015-03-13 10:04:19,614 INFO  datanode.DataNode (DataNode.java:initStorage(839)) - Setting up storage: nsid=799921817;bpid=BP-1005356445-10.1.1.144-1426266257849;lv=-47;nsInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0;bpid=BP-1005356445-10.1.1.144-1426266257849
2015-03-13 10:04:19,614 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:<init>(213)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current
2015-03-13 10:04:19,614 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:<init>(213)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current
2015-03-13 10:04:19,615 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:registerMBean(1252)) - Registered FSDatasetState MBean
2015-03-13 10:04:19,616 INFO  datanode.DirectoryScanner (DirectoryScanner.java:start(325)) - Periodic Directory Tree Verification scan starting at 1426273578616 with interval 21600000
2015-03-13 10:04:19,616 INFO  impl.FsDatasetImpl (FsDatasetImpl.java:addBlockPool(1621)) - Adding block pool BP-1005356445-10.1.1.144-1426266257849
2015-03-13 10:04:19,617 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(173)) - Scanning block pool BP-1005356445-10.1.1.144-1426266257849 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current...
2015-03-13 10:04:19,617 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(173)) - Scanning block pool BP-1005356445-10.1.1.144-1426266257849 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current...
2015-03-13 10:04:19,625 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(178)) - Time taken to scan block pool BP-1005356445-10.1.1.144-1426266257849 on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current: 8ms
2015-03-13 10:04:19,625 INFO  impl.FsDatasetImpl (FsVolumeList.java:run(178)) - Time taken to scan block pool BP-1005356445-10.1.1.144-1426266257849 on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current: 8ms
2015-03-13 10:04:19,625 INFO  impl.FsDatasetImpl (FsVolumeList.java:addBlockPool(202)) - Total time to scan all replicas for block pool BP-1005356445-10.1.1.144-1426266257849: 8ms
2015-03-13 10:04:19,625 INFO  impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(104)) - Adding replicas to map for block pool BP-1005356445-10.1.1.144-1426266257849 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current...
2015-03-13 10:04:19,625 INFO  impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(109)) - Time to add replicas to map for block pool BP-1005356445-10.1.1.144-1426266257849 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current: 0ms
2015-03-13 10:04:19,625 INFO  impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(104)) - Adding replicas to map for block pool BP-1005356445-10.1.1.144-1426266257849 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current...
2015-03-13 10:04:19,626 INFO  impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(109)) - Time to add replicas to map for block pool BP-1005356445-10.1.1.144-1426266257849 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current: 1ms
2015-03-13 10:04:19,626 INFO  impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(113)) - Total time to add all replicas to map: 1ms
2015-03-13 10:04:19,626 INFO  datanode.DataNode (BPServiceActor.java:register(618)) - Block pool BP-1005356445-10.1.1.144-1426266257849 (storage id DS-318492837-10.1.1.144-60696-1426266259571) service to localhost/127.0.0.1:60685 beginning handshake with NN
2015-03-13 10:04:19,627 INFO  hdfs.StateChange (DatanodeManager.java:registerDatanode(755)) - BLOCK* registerDatanode: from DatanodeRegistration(127.0.0.1, storageID=DS-318492837-10.1.1.144-60696-1426266259571, infoPort=60697, ipcPort=60698, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) storage DS-318492837-10.1.1.144-60696-1426266259571
2015-03-13 10:04:19,627 INFO  net.NetworkTopology (NetworkTopology.java:add(413)) - Adding a new node: /default-rack/127.0.0.1:60696
2015-03-13 10:04:19,628 INFO  datanode.DataNode (BPServiceActor.java:register(631)) - Block pool Block pool BP-1005356445-10.1.1.144-1426266257849 (storage id DS-318492837-10.1.1.144-60696-1426266259571) service to localhost/127.0.0.1:60685 successfully registered with NN
2015-03-13 10:04:19,628 INFO  datanode.DataNode (BPServiceActor.java:offerService(499)) - For namenode localhost/127.0.0.1:60685 using DELETEREPORT_INTERVAL of 300000 msec  BLOCKREPORT_INTERVAL of 21600000msec Initial delay: 0msec; heartBeatInterval=3000
2015-03-13 10:04:19,630 INFO  datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(421)) - Namenode Block pool BP-1005356445-10.1.1.144-1426266257849 (storage id DS-318492837-10.1.1.144-60696-1426266259571) service to localhost/127.0.0.1:60685 trying to claim ACTIVE state with txid=1
2015-03-13 10:04:19,630 INFO  datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(433)) - Acknowledging ACTIVE Namenode Block pool BP-1005356445-10.1.1.144-1426266257849 (storage id DS-318492837-10.1.1.144-60696-1426266259571) service to localhost/127.0.0.1:60685
2015-03-13 10:04:19,631 INFO  blockmanagement.BlockManager (BlockManager.java:processReport(1631)) - BLOCK* processReport: Received first block report from 127.0.0.1:60696 after starting up or becoming active. Its block contents are no longer considered stale
2015-03-13 10:04:19,631 INFO  BlockStateChange (BlockManager.java:processReport(1647)) - BLOCK* processReport: from DatanodeRegistration(127.0.0.1, storageID=DS-318492837-10.1.1.144-60696-1426266259571, infoPort=60697, ipcPort=60698, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0), blocks: 0, processing time: 0 msecs
2015-03-13 10:04:19,632 INFO  datanode.DataNode (BPServiceActor.java:blockReport(409)) - BlockReport of 0 blocks took 0 msec to generate and 2 msecs for RPC and NN processing
2015-03-13 10:04:19,633 INFO  datanode.DataNode (BPServiceActor.java:blockReport(428)) - sent block report, processed command:org.apache.hadoop.hdfs.server.protocol.FinalizeCommand@613cf3c5
2015-03-13 10:04:19,633 INFO  util.GSet (LightWeightGSet.java:computeCapacity(328)) - Computing capacity for map BlockMap
2015-03-13 10:04:19,633 INFO  util.GSet (LightWeightGSet.java:computeCapacity(329)) - VM type       = 64-bit
2015-03-13 10:04:19,633 INFO  util.GSet (LightWeightGSet.java:computeCapacity(330)) - 0.5% max memory = 672 MB
2015-03-13 10:04:19,633 INFO  util.GSet (LightWeightGSet.java:computeCapacity(332)) - capacity      = 2^19 = 524288 entries
2015-03-13 10:04:19,634 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:<init>(186)) - Periodic Block Verification Scanner initialized with interval 504 hours for block pool BP-1005356445-10.1.1.144-1426266257849
2015-03-13 10:04:19,634 INFO  datanode.DataBlockScanner (DataBlockScanner.java:addBlockPool(265)) - Added bpid=BP-1005356445-10.1.1.144-1426266257849 to blockPoolScannerMap, new size=1
2015-03-13 10:04:19,825 INFO  hdfs.MiniDFSCluster (MiniDFSCluster.java:waitActive(1891)) - Cluster is active
2015-03-13 10:04:19,851 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:04:19,875 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:04:19,905 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:04:19,932 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741825_1001 src: /127.0.0.1:60700 dest: /127.0.0.1:60693
2015-03-13 10:04:19,937 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741825_1001 src: /127.0.0.1:60701 dest: /127.0.0.1:60696
2015-03-13 10:04:19,939 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741825_1001 src: /127.0.0.1:60702 dest: /127.0.0.1:60689
2015-03-13 10:04:19,956 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60702, dest: /127.0.0.1:60689, bytes: 482042, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741825_1001, duration: 7044000
2015-03-13 10:04:19,957 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741825_1001, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:04:19,957 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:04:19,958 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60701, dest: /127.0.0.1:60696, bytes: 482042, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741825_1001, duration: 8121000
2015-03-13 10:04:19,958 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741825_1001, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:19,958 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:04:19,959 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60700, dest: /127.0.0.1:60693, bytes: 482042, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741825_1001, duration: 9016000
2015-03-13 10:04:19,959 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741825_1001, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:19,959 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:04:19,962 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:04:19,967 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=soberoi:supergroup:rwxr--r--
2015-03-13 10:04:20,059 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:04:20,061 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:04:20,064 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073741826_1002{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:04:20,065 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741826_1002 src: /127.0.0.1:60703 dest: /127.0.0.1:60696
2015-03-13 10:04:20,067 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741826_1002 src: /127.0.0.1:60704 dest: /127.0.0.1:60693
2015-03-13 10:04:20,068 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741826_1002 src: /127.0.0.1:60705 dest: /127.0.0.1:60689
2015-03-13 10:04:20,074 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60705, dest: /127.0.0.1:60689, bytes: 405113, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741826_1002, duration: 4170000
2015-03-13 10:04:20,074 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741826_1002, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:04:20,075 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741826_1002{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:04:20,075 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60704, dest: /127.0.0.1:60693, bytes: 405113, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741826_1002, duration: 5174000
2015-03-13 10:04:20,075 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741826_1002, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:20,076 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741826_1002{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:04:20,076 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60703, dest: /127.0.0.1:60696, bytes: 405113, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741826_1002, duration: 6035000
2015-03-13 10:04:20,076 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741826_1002, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:20,077 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741826_1002{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:04:20,078 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:04:20,079 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=soberoi:supergroup:rwxr--r--
2015-03-13 10:04:20,323 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging	dst=null	perm=null
2015-03-13 10:04:20,324 INFO  v2.MiniMRYarnCluster (MiniMRYarnCluster.java:serviceInit(150)) - mkdir: hdfs://localhost:60685/tmp/hadoop-yarn/staging
2015-03-13 10:04:20,327 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:04:20,336 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/history/done	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:04:20,366 INFO  security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:rollMasterKey(107)) - Rolling master-key for amrm-tokens
2015-03-13 10:04:20,372 INFO  security.RMContainerTokenSecretManager (RMContainerTokenSecretManager.java:<init>(75)) - ContainerTokenKeyRollingInterval: 86400000ms and ContainerTokenKeyActivationDelay: 900000ms
2015-03-13 10:04:20,374 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:<init>(77)) - NMTokenKeyRollingInterval: 86400000ms and NMTokenKeyActivationDelay: 900000ms
2015-03-13 10:04:20,376 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStoreEventType for class org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore$ForwardingEventHandler
2015-03-13 10:04:20,377 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.NodesListManagerEventType for class org.apache.hadoop.yarn.server.resourcemanager.NodesListManager
2015-03-13 10:04:20,378 INFO  resourcemanager.ResourceManager (ResourceManager.java:createScheduler(328)) - Using Scheduler: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler
2015-03-13 10:04:20,404 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.scheduler.event.SchedulerEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$SchedulerEventDispatcher
2015-03-13 10:04:20,405 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationEventDispatcher
2015-03-13 10:04:20,406 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher
2015-03-13 10:04:20,406 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$NodeEventDispatcher
2015-03-13 10:04:20,417 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - ResourceManager metrics system started (again)
2015-03-13 10:04:20,446 INFO  capacity.ParentQueue (ParentQueue.java:setupQueueConfigs(189)) - root, capacity=1.0, asboluteCapacity=1.0, maxCapacity=1.0, asboluteMaxCapacity=1.0, state=RUNNING, acls=ADMINISTER_QUEUE:*SUBMIT_APPLICATIONS:*
2015-03-13 10:04:20,446 INFO  capacity.ParentQueue (ParentQueue.java:<init>(151)) - Initialized parent-queue root name=root, fullname=root
2015-03-13 10:04:20,452 INFO  capacity.LeafQueue (LeafQueue.java:setupQueueConfigs(271)) - Initializing default
capacity = 1.0 [= (float) configuredCapacity / 100 ]
asboluteCapacity = 1.0 [= parentAbsoluteCapacity * capacity ]
maxCapacity = 1.0 [= configuredMaxCapacity ]
absoluteMaxCapacity = 1.0 [= 1.0 maximumCapacity undefined, (parentAbsoluteMaxCapacity * maximumCapacity) / 100 otherwise ]
userLimit = 100 [= configuredUserLimit ]
userLimitFactor = 1.0 [= configuredUserLimitFactor ]
maxApplications = 10000 [= configuredMaximumSystemApplicationsPerQueue or (int)(configuredMaximumSystemApplications * absoluteCapacity)]
maxApplicationsPerUser = 10000 [= (int)(maxApplications * (userLimit / 100.0f) * userLimitFactor) ]
maxActiveApplications = 1 [= max((int)ceil((clusterResourceMemory / minimumAllocation) * maxAMResourcePerQueuePercent * absoluteMaxCapacity),1) ]
maxActiveAppsUsingAbsCap = 1 [= max((int)ceil((clusterResourceMemory / minimumAllocation) *maxAMResourcePercent * absoluteCapacity),1) ]
maxActiveApplicationsPerUser = 1 [= max((int)(maxActiveApplications * (userLimit / 100.0f) * userLimitFactor),1) ]
usedCapacity = 0.0 [= usedResourcesMemory / (clusterResourceMemory * absoluteCapacity)]
absoluteUsedCapacity = 0.0 [= usedResourcesMemory / clusterResourceMemory]
maxAMResourcePerQueuePercent = 0.1 [= configuredMaximumAMResourcePercent ]
minimumAllocationFactor = 0.875 [= (float)(maximumAllocationMemory - minimumAllocationMemory) / maximumAllocationMemory ]
numContainers = 0 [= currentNumContainers ]
state = RUNNING [= configuredState ]
acls = ADMINISTER_QUEUE:*SUBMIT_APPLICATIONS:* [= configuredAcls ]
nodeLocalityDelay = 0

2015-03-13 10:04:20,453 INFO  capacity.CapacityScheduler (CapacityScheduler.java:parseQueue(409)) - Initialized queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:0, vCores:0>usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0
2015-03-13 10:04:20,453 INFO  capacity.CapacityScheduler (CapacityScheduler.java:parseQueue(409)) - Initialized queue: root: numChildQueue= 1, capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:0, vCores:0>usedCapacity=0.0, numApps=0, numContainers=0
2015-03-13 10:04:20,454 INFO  capacity.CapacityScheduler (CapacityScheduler.java:initializeQueues(307)) - Initialized root queue root: numChildQueue= 1, capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:0, vCores:0>usedCapacity=0.0, numApps=0, numContainers=0
2015-03-13 10:04:20,454 INFO  capacity.CapacityScheduler (CapacityScheduler.java:reinitialize(271)) - Initialized CapacityScheduler with calculator=class org.apache.hadoop.yarn.util.resource.DefaultResourceCalculator, minimumAllocation=<<memory:1024, vCores:1>>, maximumAllocation=<<memory:8192, vCores:32>>
2015-03-13 10:04:20,478 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.RMAppManagerEventType for class org.apache.hadoop.yarn.server.resourcemanager.RMAppManager
2015-03-13 10:04:20,483 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncherEventType for class org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher
2015-03-13 10:04:20,484 INFO  resourcemanager.RMNMInfo (RMNMInfo.java:<init>(63)) - Registered RMNMInfo MBean
2015-03-13 10:04:20,485 INFO  util.HostsFileReader (HostsFileReader.java:refresh(84)) - Refreshing hosts (include/exclude) list
2015-03-13 10:04:20,487 INFO  server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(225)) - Waiting for RM to start...
2015-03-13 10:04:20,487 INFO  security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:rollMasterKey(107)) - Rolling master-key for amrm-tokens
2015-03-13 10:04:20,487 INFO  security.RMContainerTokenSecretManager (RMContainerTokenSecretManager.java:rollMasterKey(103)) - Rolling master-key for container-tokens
2015-03-13 10:04:20,490 INFO  security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:rollMasterKey(97)) - Rolling master-key for nm-tokens
2015-03-13 10:04:20,498 INFO  http.HttpServer (HttpServer.java:addGlobalFilter(525)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2015-03-13 10:04:20,498 INFO  http.HttpServer (HttpServer.java:addFilter(503)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context cluster
2015-03-13 10:04:20,498 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-03-13 10:04:20,499 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-03-13 10:04:20,499 INFO  http.HttpServer (HttpServer.java:<init>(280)) - adding path spec: /cluster/*
2015-03-13 10:04:20,499 INFO  http.HttpServer (HttpServer.java:<init>(280)) - adding path spec: /ws/*
2015-03-13 10:04:20,501 INFO  http.HttpServer (HttpServer.java:start(687)) - Jetty bound to port 60706
2015-03-13 10:04:20,501 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2015-03-13 10:04:20,504 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-common/2.2.0/77f18c3d40dcb45b0be2602cfa5115a5edb40db1/hadoop-yarn-common-2.2.0.jar!/webapps/cluster to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_Edinburgh_local_60706_cluster____agehuh/webapp
2015-03-13 10:04:20,590 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@Edinburgh.local:60706
2015-03-13 10:04:20,591 INFO  webapp.WebApps (WebApps.java:start(258)) - Web app /cluster started at 60706
2015-03-13 10:04:20,799 INFO  webapp.WebApps (WebApps.java:start(272)) - Registered webapp guice modules
2015-03-13 10:04:20,800 INFO  delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:updateCurrentKey(223)) - Updating the current master key for generating delegation tokens
2015-03-13 10:04:20,800 INFO  security.RMDelegationTokenSecretManager (RMDelegationTokenSecretManager.java:storeNewMasterKey(85)) - storing master key with keyID 1
2015-03-13 10:04:20,802 INFO  delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:run(526)) - Starting expired delegation token remover thread, tokenRemoverScanInterval=60 min(s)
2015-03-13 10:04:20,802 INFO  delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:updateCurrentKey(223)) - Updating the current master key for generating delegation tokens
2015-03-13 10:04:20,802 INFO  security.RMDelegationTokenSecretManager (RMDelegationTokenSecretManager.java:storeNewMasterKey(85)) - storing master key with keyID 2
2015-03-13 10:04:20,812 INFO  ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 60707
2015-03-13 10:04:20,814 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.server.api.ResourceTrackerPB to the server
2015-03-13 10:04:20,814 INFO  ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:04:20,814 INFO  ipc.Server (Server.java:run(688)) - IPC Server listener on 60707: starting
2015-03-13 10:04:20,826 INFO  ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 60708
2015-03-13 10:04:20,828 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.api.ApplicationMasterProtocolPB to the server
2015-03-13 10:04:20,828 INFO  ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:04:20,828 INFO  ipc.Server (Server.java:run(688)) - IPC Server listener on 60708: starting
2015-03-13 10:04:20,848 INFO  ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 60709
2015-03-13 10:04:20,850 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.api.ApplicationClientProtocolPB to the server
2015-03-13 10:04:20,851 INFO  ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:04:20,851 INFO  ipc.Server (Server.java:run(688)) - IPC Server listener on 60709: starting
2015-03-13 10:04:20,868 INFO  ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 60710
2015-03-13 10:04:20,870 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.server.api.ResourceManagerAdministrationProtocolPB to the server
2015-03-13 10:04:20,871 INFO  ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:04:20,871 INFO  ipc.Server (Server.java:run(688)) - IPC Server listener on 60710: starting
2015-03-13 10:04:21,993 INFO  server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(238)) - MiniYARN ResourceManager address: 10.1.1.144:60709
2015-03-13 10:04:21,993 INFO  server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(240)) - MiniYARN ResourceManager web address: Edinburgh.local:60706
2015-03-13 10:04:21,994 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0
2015-03-13 10:04:21,994 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1
2015-03-13 10:04:21,995 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2
2015-03-13 10:04:21,995 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3
2015-03-13 10:04:22,006 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-0_0
2015-03-13 10:04:22,007 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-0_1
2015-03-13 10:04:22,007 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-0_2
2015-03-13 10:04:22,007 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-0_3
2015-03-13 10:04:22,008 INFO  server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(333)) - Starting NM: 0
2015-03-13 10:04:22,043 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher
2015-03-13 10:04:22,044 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher
2015-03-13 10:04:22,045 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService
2015-03-13 10:04:22,045 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices
2015-03-13 10:04:22,045 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl
2015-03-13 10:04:22,046 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher
2015-03-13 10:04:22,047 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.ContainerManagerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl
2015-03-13 10:04:22,047 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.NodeManagerEventType for class org.apache.hadoop.yarn.server.MiniYARNCluster$CustomNodeManager
2015-03-13 10:04:22,047 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - NodeManager metrics system started (again)
2015-03-13 10:04:22,052 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler
2015-03-13 10:04:22,052 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(196)) - per directory file limit = 8192
2015-03-13 10:04:22,176 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker
2015-03-13 10:04:22,185 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-03-13 10:04:22,185 INFO  containermanager.AuxServices (AuxServices.java:addService(67)) - Adding auxiliary service httpshuffle, "mapreduce_shuffle"
2015-03-13 10:04:22,203 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(98)) -  Using ResourceCalculatorPlugin : null
2015-03-13 10:04:22,203 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(103)) -  Using ResourceCalculatorProcessTree : null
2015-03-13 10:04:22,204 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(127)) - Physical memory check enabled: false
2015-03-13 10:04:22,204 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(128)) - Virtual memory check enabled: false
2015-03-13 10:04:22,204 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(160)) - Initialized nodemanager for null: physical-memory=4096 virtual-memory=8602 virtual-cores=8
2015-03-13 10:04:22,205 INFO  server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(343)) - Waiting for NM 0 to start...
2015-03-13 10:04:22,215 INFO  ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 60711
2015-03-13 10:04:22,216 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.api.ContainerManagementProtocolPB to the server
2015-03-13 10:04:22,217 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(281)) - Blocking new container-requests as container manager rpc server is still starting.
2015-03-13 10:04:22,217 INFO  ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:04:22,217 INFO  ipc.Server (Server.java:run(688)) - IPC Server listener on 60711: starting
2015-03-13 10:04:22,223 INFO  security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setNodeId(189)) - Updating node address : 10.1.1.144:60711
2015-03-13 10:04:22,223 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(292)) - ContainerManager started at /10.1.1.144:60711
2015-03-13 10:04:22,228 INFO  ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 60712
2015-03-13 10:04:22,230 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.server.nodemanager.api.LocalizationProtocolPB to the server
2015-03-13 10:04:22,231 INFO  ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:04:22,231 INFO  ipc.Server (Server.java:run(688)) - IPC Server listener on 60712: starting
2015-03-13 10:04:22,232 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceStart(263)) - Localizer started on port 60712
2015-03-13 10:04:22,241 INFO  mapred.IndexCache (IndexCache.java:<init>(47)) - IndexCache created with max memory = 10485760
2015-03-13 10:04:22,249 INFO  mapred.ShuffleHandler (ShuffleHandler.java:serviceStart(316)) - httpshuffle listening on port 60713
2015-03-13 10:04:22,250 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:04:22,250 INFO  webapp.WebServer (WebServer.java:serviceStart(60)) - Instantiating NMWebApp at Edinburgh.local:0
2015-03-13 10:04:22,251 INFO  http.HttpServer (HttpServer.java:addGlobalFilter(525)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2015-03-13 10:04:22,251 INFO  http.HttpServer (HttpServer.java:addFilter(503)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context node
2015-03-13 10:04:22,251 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-03-13 10:04:22,252 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-03-13 10:04:22,252 INFO  http.HttpServer (HttpServer.java:<init>(280)) - adding path spec: /node/*
2015-03-13 10:04:22,252 INFO  http.HttpServer (HttpServer.java:<init>(280)) - adding path spec: /ws/*
2015-03-13 10:04:22,253 INFO  http.HttpServer (HttpServer.java:start(687)) - Jetty bound to port 60714
2015-03-13 10:04:22,253 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2015-03-13 10:04:22,255 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-common/2.2.0/77f18c3d40dcb45b0be2602cfa5115a5edb40db1/hadoop-yarn-common-2.2.0.jar!/webapps/node to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_Edinburgh_local_60714_node____jvahc6/webapp
2015-03-13 10:04:23,025 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@Edinburgh.local:60714
2015-03-13 10:04:23,026 INFO  webapp.WebApps (WebApps.java:start(258)) - Web app /node started at 60714
2015-03-13 10:04:23,041 INFO  webapp.WebApps (WebApps.java:start(272)) - Registered webapp guice modules
2015-03-13 10:04:23,053 INFO  util.RackResolver (RackResolver.java:coreResolve(109)) - Resolved 10.1.1.144 to /default-rack
2015-03-13 10:04:23,054 INFO  resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(230)) - NodeManager from node 10.1.1.144(cmPort: 60711 httpPort: 60714) registered with capability: <memory:4096, vCores:8>, assigned nodeId 10.1.1.144:60711
2015-03-13 10:04:23,054 INFO  security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(71)) - Rolling master-key for container-tokens, got key with id 1649686742
2015-03-13 10:04:23,055 INFO  security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(65)) - Rolling master-key for nm-tokens, got key with id :1886638853
2015-03-13 10:04:23,056 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(265)) - Registered with ResourceManager as 10.1.1.144:60711 with total resource of <memory:4096, vCores:8>
2015-03-13 10:04:23,056 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(267)) - Notifying ContainerManager to unblock new container-requests
2015-03-13 10:04:23,057 INFO  rmnode.RMNodeImpl (RMNodeImpl.java:handle(366)) - 10.1.1.144:60711 Node Transitioned from NEW to RUNNING
2015-03-13 10:04:23,059 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addNode(774)) - Added node 10.1.1.144:60711 clusterResource: <memory:4096, vCores:8>
2015-03-13 10:04:23,211 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0
2015-03-13 10:04:23,212 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1
2015-03-13 10:04:23,212 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2
2015-03-13 10:04:23,213 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3
2015-03-13 10:04:23,224 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-1_0
2015-03-13 10:04:23,224 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-1_1
2015-03-13 10:04:23,225 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-1_2
2015-03-13 10:04:23,225 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-1_3
2015-03-13 10:04:23,226 INFO  server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(333)) - Starting NM: 1
2015-03-13 10:04:23,241 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher
2015-03-13 10:04:23,242 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher
2015-03-13 10:04:23,242 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService
2015-03-13 10:04:23,242 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices
2015-03-13 10:04:23,242 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl
2015-03-13 10:04:23,242 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher
2015-03-13 10:04:23,243 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.ContainerManagerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl
2015-03-13 10:04:23,243 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.NodeManagerEventType for class org.apache.hadoop.yarn.server.MiniYARNCluster$CustomNodeManager
2015-03-13 10:04:23,243 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - NodeManager metrics system started (again)
2015-03-13 10:04:23,245 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler
2015-03-13 10:04:23,245 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(196)) - per directory file limit = 8192
2015-03-13 10:04:23,351 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker
2015-03-13 10:04:23,353 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-03-13 10:04:23,353 INFO  containermanager.AuxServices (AuxServices.java:addService(67)) - Adding auxiliary service httpshuffle, "mapreduce_shuffle"
2015-03-13 10:04:23,355 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(98)) -  Using ResourceCalculatorPlugin : null
2015-03-13 10:04:23,355 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(103)) -  Using ResourceCalculatorProcessTree : null
2015-03-13 10:04:23,356 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(127)) - Physical memory check enabled: false
2015-03-13 10:04:23,356 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(128)) - Virtual memory check enabled: false
2015-03-13 10:04:23,356 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(160)) - Initialized nodemanager for null: physical-memory=4096 virtual-memory=8602 virtual-cores=8
2015-03-13 10:04:23,357 INFO  server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(343)) - Waiting for NM 1 to start...
2015-03-13 10:04:23,359 INFO  ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 60715
2015-03-13 10:04:23,361 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.api.ContainerManagementProtocolPB to the server
2015-03-13 10:04:23,361 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(281)) - Blocking new container-requests as container manager rpc server is still starting.
2015-03-13 10:04:23,362 INFO  ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:04:23,362 INFO  ipc.Server (Server.java:run(688)) - IPC Server listener on 60715: starting
2015-03-13 10:04:23,366 INFO  security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setNodeId(189)) - Updating node address : 10.1.1.144:60715
2015-03-13 10:04:23,366 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(292)) - ContainerManager started at /10.1.1.144:60715
2015-03-13 10:04:23,367 INFO  ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 60716
2015-03-13 10:04:23,368 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.server.nodemanager.api.LocalizationProtocolPB to the server
2015-03-13 10:04:23,369 INFO  ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:04:23,369 INFO  ipc.Server (Server.java:run(688)) - IPC Server listener on 60716: starting
2015-03-13 10:04:23,370 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceStart(263)) - Localizer started on port 60716
2015-03-13 10:04:23,372 INFO  mapred.IndexCache (IndexCache.java:<init>(47)) - IndexCache created with max memory = 10485760
2015-03-13 10:04:23,373 INFO  mapred.ShuffleHandler (ShuffleHandler.java:serviceStart(316)) - httpshuffle listening on port 60717
2015-03-13 10:04:23,373 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:04:23,374 INFO  webapp.WebServer (WebServer.java:serviceStart(60)) - Instantiating NMWebApp at Edinburgh.local:0
2015-03-13 10:04:23,375 INFO  http.HttpServer (HttpServer.java:addGlobalFilter(525)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2015-03-13 10:04:23,375 INFO  http.HttpServer (HttpServer.java:addFilter(503)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context node
2015-03-13 10:04:23,375 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-03-13 10:04:23,376 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-03-13 10:04:23,376 INFO  http.HttpServer (HttpServer.java:<init>(280)) - adding path spec: /node/*
2015-03-13 10:04:23,376 INFO  http.HttpServer (HttpServer.java:<init>(280)) - adding path spec: /ws/*
2015-03-13 10:04:23,376 INFO  http.HttpServer (HttpServer.java:start(687)) - Jetty bound to port 60718
2015-03-13 10:04:23,377 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2015-03-13 10:04:23,379 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-common/2.2.0/77f18c3d40dcb45b0be2602cfa5115a5edb40db1/hadoop-yarn-common-2.2.0.jar!/webapps/node to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_Edinburgh_local_60718_node____.so1jue/webapp
2015-03-13 10:04:23,607 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@Edinburgh.local:60718
2015-03-13 10:04:23,608 INFO  webapp.WebApps (WebApps.java:start(258)) - Web app /node started at 60718
2015-03-13 10:04:23,615 INFO  webapp.WebApps (WebApps.java:start(272)) - Registered webapp guice modules
2015-03-13 10:04:23,616 INFO  util.RackResolver (RackResolver.java:coreResolve(109)) - Resolved 10.1.1.144 to /default-rack
2015-03-13 10:04:23,616 INFO  resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(230)) - NodeManager from node 10.1.1.144(cmPort: 60715 httpPort: 60718) registered with capability: <memory:4096, vCores:8>, assigned nodeId 10.1.1.144:60715
2015-03-13 10:04:23,617 INFO  security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(71)) - Rolling master-key for container-tokens, got key with id 1649686742
2015-03-13 10:04:23,616 INFO  rmnode.RMNodeImpl (RMNodeImpl.java:handle(366)) - 10.1.1.144:60715 Node Transitioned from NEW to RUNNING
2015-03-13 10:04:23,617 INFO  security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(65)) - Rolling master-key for nm-tokens, got key with id :1886638853
2015-03-13 10:04:23,617 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(265)) - Registered with ResourceManager as 10.1.1.144:60715 with total resource of <memory:4096, vCores:8>
2015-03-13 10:04:23,617 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(267)) - Notifying ContainerManager to unblock new container-requests
2015-03-13 10:04:23,617 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addNode(774)) - Added node 10.1.1.144:60715 clusterResource: <memory:8192, vCores:16>
2015-03-13 10:04:24,246 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741825_1001
2015-03-13 10:04:24,253 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741826_1002
2015-03-13 10:04:24,362 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0
2015-03-13 10:04:24,363 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1
2015-03-13 10:04:24,363 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2
2015-03-13 10:04:24,363 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3
2015-03-13 10:04:24,378 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-2_0
2015-03-13 10:04:24,378 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-2_1
2015-03-13 10:04:24,379 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-2_2
2015-03-13 10:04:24,379 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-2_3
2015-03-13 10:04:24,379 INFO  server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(333)) - Starting NM: 2
2015-03-13 10:04:24,391 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher
2015-03-13 10:04:24,392 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher
2015-03-13 10:04:24,392 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService
2015-03-13 10:04:24,392 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices
2015-03-13 10:04:24,392 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl
2015-03-13 10:04:24,392 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher
2015-03-13 10:04:24,393 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.ContainerManagerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl
2015-03-13 10:04:24,393 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.NodeManagerEventType for class org.apache.hadoop.yarn.server.MiniYARNCluster$CustomNodeManager
2015-03-13 10:04:24,393 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - NodeManager metrics system started (again)
2015-03-13 10:04:24,394 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler
2015-03-13 10:04:24,395 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(196)) - per directory file limit = 8192
2015-03-13 10:04:24,441 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741825_1001
2015-03-13 10:04:24,445 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741826_1002
2015-03-13 10:04:24,496 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker
2015-03-13 10:04:24,498 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-03-13 10:04:24,498 INFO  containermanager.AuxServices (AuxServices.java:addService(67)) - Adding auxiliary service httpshuffle, "mapreduce_shuffle"
2015-03-13 10:04:24,501 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(98)) -  Using ResourceCalculatorPlugin : null
2015-03-13 10:04:24,501 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(103)) -  Using ResourceCalculatorProcessTree : null
2015-03-13 10:04:24,501 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(127)) - Physical memory check enabled: false
2015-03-13 10:04:24,501 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(128)) - Virtual memory check enabled: false
2015-03-13 10:04:24,502 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(160)) - Initialized nodemanager for null: physical-memory=4096 virtual-memory=8602 virtual-cores=8
2015-03-13 10:04:24,502 INFO  server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(343)) - Waiting for NM 2 to start...
2015-03-13 10:04:24,508 INFO  ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 60719
2015-03-13 10:04:24,509 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.api.ContainerManagementProtocolPB to the server
2015-03-13 10:04:24,509 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(281)) - Blocking new container-requests as container manager rpc server is still starting.
2015-03-13 10:04:24,510 INFO  ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:04:24,510 INFO  ipc.Server (Server.java:run(688)) - IPC Server listener on 60719: starting
2015-03-13 10:04:24,513 INFO  security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setNodeId(189)) - Updating node address : 10.1.1.144:60719
2015-03-13 10:04:24,514 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(292)) - ContainerManager started at /10.1.1.144:60719
2015-03-13 10:04:24,515 INFO  ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 60720
2015-03-13 10:04:24,517 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.server.nodemanager.api.LocalizationProtocolPB to the server
2015-03-13 10:04:24,517 INFO  ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:04:24,517 INFO  ipc.Server (Server.java:run(688)) - IPC Server listener on 60720: starting
2015-03-13 10:04:24,519 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceStart(263)) - Localizer started on port 60720
2015-03-13 10:04:24,520 INFO  mapred.IndexCache (IndexCache.java:<init>(47)) - IndexCache created with max memory = 10485760
2015-03-13 10:04:24,520 INFO  mapred.ShuffleHandler (ShuffleHandler.java:serviceStart(316)) - httpshuffle listening on port 60721
2015-03-13 10:04:24,520 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:04:24,521 INFO  webapp.WebServer (WebServer.java:serviceStart(60)) - Instantiating NMWebApp at Edinburgh.local:0
2015-03-13 10:04:24,521 INFO  http.HttpServer (HttpServer.java:addGlobalFilter(525)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2015-03-13 10:04:24,522 INFO  http.HttpServer (HttpServer.java:addFilter(503)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context node
2015-03-13 10:04:24,522 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-03-13 10:04:24,522 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-03-13 10:04:24,522 INFO  http.HttpServer (HttpServer.java:<init>(280)) - adding path spec: /node/*
2015-03-13 10:04:24,523 INFO  http.HttpServer (HttpServer.java:<init>(280)) - adding path spec: /ws/*
2015-03-13 10:04:24,523 INFO  http.HttpServer (HttpServer.java:start(687)) - Jetty bound to port 60722
2015-03-13 10:04:24,523 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2015-03-13 10:04:24,526 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-common/2.2.0/77f18c3d40dcb45b0be2602cfa5115a5edb40db1/hadoop-yarn-common-2.2.0.jar!/webapps/node to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_Edinburgh_local_60722_node____5dei5f/webapp
2015-03-13 10:04:24,624 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741825_1001
2015-03-13 10:04:24,629 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741826_1002
2015-03-13 10:04:24,728 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@Edinburgh.local:60722
2015-03-13 10:04:24,729 INFO  webapp.WebApps (WebApps.java:start(258)) - Web app /node started at 60722
2015-03-13 10:04:24,734 INFO  webapp.WebApps (WebApps.java:start(272)) - Registered webapp guice modules
2015-03-13 10:04:24,735 INFO  util.RackResolver (RackResolver.java:coreResolve(109)) - Resolved 10.1.1.144 to /default-rack
2015-03-13 10:04:24,735 INFO  resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(230)) - NodeManager from node 10.1.1.144(cmPort: 60719 httpPort: 60722) registered with capability: <memory:4096, vCores:8>, assigned nodeId 10.1.1.144:60719
2015-03-13 10:04:24,735 INFO  rmnode.RMNodeImpl (RMNodeImpl.java:handle(366)) - 10.1.1.144:60719 Node Transitioned from NEW to RUNNING
2015-03-13 10:04:24,735 INFO  security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(71)) - Rolling master-key for container-tokens, got key with id 1649686742
2015-03-13 10:04:24,736 INFO  security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(65)) - Rolling master-key for nm-tokens, got key with id :1886638853
2015-03-13 10:04:24,736 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addNode(774)) - Added node 10.1.1.144:60719 clusterResource: <memory:12288, vCores:24>
2015-03-13 10:04:24,736 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(265)) - Registered with ResourceManager as 10.1.1.144:60719 with total resource of <memory:4096, vCores:8>
2015-03-13 10:04:24,736 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(267)) - Notifying ContainerManager to unblock new container-requests
2015-03-13 10:04:25,505 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0
2015-03-13 10:04:25,506 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1
2015-03-13 10:04:25,506 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2
2015-03-13 10:04:25,507 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3
2015-03-13 10:04:25,519 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-3_0
2015-03-13 10:04:25,519 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-3_1
2015-03-13 10:04:25,520 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-3_2
2015-03-13 10:04:25,520 INFO  server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-3_3
2015-03-13 10:04:25,520 INFO  server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(333)) - Starting NM: 3
2015-03-13 10:04:25,531 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher
2015-03-13 10:04:25,531 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher
2015-03-13 10:04:25,531 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService
2015-03-13 10:04:25,532 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices
2015-03-13 10:04:25,532 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl
2015-03-13 10:04:25,532 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher
2015-03-13 10:04:25,532 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.ContainerManagerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl
2015-03-13 10:04:25,532 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.NodeManagerEventType for class org.apache.hadoop.yarn.server.MiniYARNCluster$CustomNodeManager
2015-03-13 10:04:25,532 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - NodeManager metrics system started (again)
2015-03-13 10:04:25,534 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler
2015-03-13 10:04:25,534 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(196)) - per directory file limit = 8192
2015-03-13 10:04:25,648 INFO  event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker
2015-03-13 10:04:25,649 WARN  containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-03-13 10:04:25,649 INFO  containermanager.AuxServices (AuxServices.java:addService(67)) - Adding auxiliary service httpshuffle, "mapreduce_shuffle"
2015-03-13 10:04:25,652 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(98)) -  Using ResourceCalculatorPlugin : null
2015-03-13 10:04:25,653 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(103)) -  Using ResourceCalculatorProcessTree : null
2015-03-13 10:04:25,653 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(127)) - Physical memory check enabled: false
2015-03-13 10:04:25,653 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(128)) - Virtual memory check enabled: false
2015-03-13 10:04:25,654 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(160)) - Initialized nodemanager for null: physical-memory=4096 virtual-memory=8602 virtual-cores=8
2015-03-13 10:04:25,654 INFO  server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(343)) - Waiting for NM 3 to start...
2015-03-13 10:04:25,657 INFO  ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 60723
2015-03-13 10:04:25,659 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.api.ContainerManagementProtocolPB to the server
2015-03-13 10:04:25,659 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(281)) - Blocking new container-requests as container manager rpc server is still starting.
2015-03-13 10:04:25,660 INFO  ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:04:25,660 INFO  ipc.Server (Server.java:run(688)) - IPC Server listener on 60723: starting
2015-03-13 10:04:25,664 INFO  security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setNodeId(189)) - Updating node address : 10.1.1.144:60723
2015-03-13 10:04:25,664 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(292)) - ContainerManager started at /10.1.1.144:60723
2015-03-13 10:04:25,665 INFO  ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 60724
2015-03-13 10:04:25,667 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.server.nodemanager.api.LocalizationProtocolPB to the server
2015-03-13 10:04:25,667 INFO  ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:04:25,667 INFO  ipc.Server (Server.java:run(688)) - IPC Server listener on 60724: starting
2015-03-13 10:04:25,669 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceStart(263)) - Localizer started on port 60724
2015-03-13 10:04:25,670 INFO  mapred.IndexCache (IndexCache.java:<init>(47)) - IndexCache created with max memory = 10485760
2015-03-13 10:04:25,670 INFO  mapred.ShuffleHandler (ShuffleHandler.java:serviceStart(316)) - httpshuffle listening on port 60725
2015-03-13 10:04:25,671 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:04:25,671 INFO  webapp.WebServer (WebServer.java:serviceStart(60)) - Instantiating NMWebApp at Edinburgh.local:0
2015-03-13 10:04:25,672 INFO  http.HttpServer (HttpServer.java:addGlobalFilter(525)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2015-03-13 10:04:25,672 INFO  http.HttpServer (HttpServer.java:addFilter(503)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context node
2015-03-13 10:04:25,672 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-03-13 10:04:25,672 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-03-13 10:04:25,673 INFO  http.HttpServer (HttpServer.java:<init>(280)) - adding path spec: /node/*
2015-03-13 10:04:25,673 INFO  http.HttpServer (HttpServer.java:<init>(280)) - adding path spec: /ws/*
2015-03-13 10:04:25,673 INFO  http.HttpServer (HttpServer.java:start(687)) - Jetty bound to port 60726
2015-03-13 10:04:25,673 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2015-03-13 10:04:25,677 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-common/2.2.0/77f18c3d40dcb45b0be2602cfa5115a5edb40db1/hadoop-yarn-common-2.2.0.jar!/webapps/node to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_Edinburgh_local_60726_node____rv6ixz/webapp
2015-03-13 10:04:25,916 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@Edinburgh.local:60726
2015-03-13 10:04:25,917 INFO  webapp.WebApps (WebApps.java:start(258)) - Web app /node started at 60726
2015-03-13 10:04:25,922 INFO  webapp.WebApps (WebApps.java:start(272)) - Registered webapp guice modules
2015-03-13 10:04:25,923 INFO  util.RackResolver (RackResolver.java:coreResolve(109)) - Resolved 10.1.1.144 to /default-rack
2015-03-13 10:04:25,923 INFO  resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(230)) - NodeManager from node 10.1.1.144(cmPort: 60723 httpPort: 60726) registered with capability: <memory:4096, vCores:8>, assigned nodeId 10.1.1.144:60723
2015-03-13 10:04:25,923 INFO  rmnode.RMNodeImpl (RMNodeImpl.java:handle(366)) - 10.1.1.144:60723 Node Transitioned from NEW to RUNNING
2015-03-13 10:04:25,923 INFO  security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(71)) - Rolling master-key for container-tokens, got key with id 1649686742
2015-03-13 10:04:25,924 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addNode(774)) - Added node 10.1.1.144:60723 clusterResource: <memory:16384, vCores:32>
2015-03-13 10:04:25,924 INFO  security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(65)) - Rolling master-key for nm-tokens, got key with id :1886638853
2015-03-13 10:04:25,924 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(265)) - Registered with ResourceManager as 10.1.1.144:60723 with total resource of <memory:4096, vCores:8>
2015-03-13 10:04:25,924 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(267)) - Notifying ContainerManager to unblock new container-requests
2015-03-13 10:04:26,666 INFO  hs.JobHistory (JobHistory.java:serviceInit(77)) - JobHistory Init
2015-03-13 10:04:26,675 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done	dst=null	perm=null
2015-03-13 10:04:26,678 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:04:26,680 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:04:26,681 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:04:26,681 INFO  hs.HistoryFileManager (HistoryFileManager.java:mkdir(561)) - Perms after creating 511, Expected: 1023
2015-03-13 10:04:26,681 INFO  hs.HistoryFileManager (HistoryFileManager.java:mkdir(564)) - Explicitly setting permissions to : 1023, rwxrwxrwt
2015-03-13 10:04:26,683 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=soberoi:supergroup:rwxrwxrwt
2015-03-13 10:04:26,685 INFO  hs.HistoryFileManager (HistoryFileManager.java:initExisting(580)) - Initializing Existing Jobs...
2015-03-13 10:04:26,688 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-yarn/staging/history/done	dst=null	perm=null
2015-03-13 10:04:26,691 INFO  hs.CachedHistoryStorage (CachedHistoryStorage.java:serviceInit(65)) - CachedHistoryStorage Init
2015-03-13 10:04:26,692 INFO  v2.MiniMRYarnCluster (MiniMRYarnCluster.java:serviceStart(207)) - Waiting for HistoryServer to start...
2015-03-13 10:04:26,692 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - JobHistoryServer metrics system started (again)
2015-03-13 10:04:26,693 INFO  delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:updateCurrentKey(223)) - Updating the current master key for generating delegation tokens
2015-03-13 10:04:26,693 INFO  delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:run(526)) - Starting expired delegation token remover thread, tokenRemoverScanInterval=60 min(s)
2015-03-13 10:04:26,693 INFO  delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:updateCurrentKey(223)) - Updating the current master key for generating delegation tokens
2015-03-13 10:04:26,696 INFO  http.HttpServer (HttpServer.java:addGlobalFilter(525)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2015-03-13 10:04:26,696 INFO  http.HttpServer (HttpServer.java:addFilter(503)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context jobhistory
2015-03-13 10:04:26,697 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-03-13 10:04:26,697 INFO  http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-03-13 10:04:26,697 INFO  http.HttpServer (HttpServer.java:<init>(280)) - adding path spec: /jobhistory/*
2015-03-13 10:04:26,697 INFO  http.HttpServer (HttpServer.java:<init>(280)) - adding path spec: /ws/*
2015-03-13 10:04:26,698 INFO  http.HttpServer (HttpServer.java:start(687)) - Jetty bound to port 60727
2015-03-13 10:04:26,698 INFO  mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2015-03-13 10:04:26,700 INFO  mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-common/2.2.0/77f18c3d40dcb45b0be2602cfa5115a5edb40db1/hadoop-yarn-common-2.2.0.jar!/webapps/jobhistory to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_Edinburgh_local_60727_jobhistory____dzqaj7/webapp
2015-03-13 10:04:26,876 INFO  mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@Edinburgh.local:60727
2015-03-13 10:04:26,877 INFO  webapp.WebApps (WebApps.java:start(258)) - Web app /jobhistory started at 60727
2015-03-13 10:04:26,895 INFO  webapp.WebApps (WebApps.java:start(272)) - Registered webapp guice modules
2015-03-13 10:04:26,901 INFO  ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 60728
2015-03-13 10:04:26,903 INFO  pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.mapreduce.v2.api.HSClientProtocolPB to the server
2015-03-13 10:04:26,903 INFO  ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:04:26,903 INFO  ipc.Server (Server.java:run(688)) - IPC Server listener on 60728: starting
2015-03-13 10:04:26,906 INFO  hs.HistoryClientService (HistoryClientService.java:serviceStart(140)) - Instantiated MRClientService at 10.1.1.144/10.1.1.144:60728
2015-03-13 10:04:28,197 INFO  v2.MiniMRYarnCluster (MiniMRYarnCluster.java:serviceStart(224)) - MiniMRYARN ResourceManager address: 10.1.1.144:60709
2015-03-13 10:04:28,198 INFO  v2.MiniMRYarnCluster (MiniMRYarnCluster.java:serviceStart(226)) - MiniMRYARN ResourceManager web address: Edinburgh.local:60706
2015-03-13 10:04:28,198 INFO  v2.MiniMRYarnCluster (MiniMRYarnCluster.java:serviceStart(228)) - MiniMRYARN HistoryServer address: 10.1.1.144:60728
2015-03-13 10:04:28,199 INFO  v2.MiniMRYarnCluster (MiniMRYarnCluster.java:serviceStart(230)) - MiniMRYARN HistoryServer web address: Edinburgh.local:60727
2015-03-13 10:04:28,208 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower-offset.txt	dst=null	perm=null
2015-03-13 10:04:28,209 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower-offset.txt	dst=null	perm=null
2015-03-13 10:04:28,215 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower-offset.txt	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:04:28,217 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower-offset.txt. BP-1005356445-10.1.1.144-1426266257849 blk_1073741827_1003{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:04:28,219 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741827_1003 src: /127.0.0.1:60729 dest: /127.0.0.1:60696
2015-03-13 10:04:28,220 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741827_1003 src: /127.0.0.1:60730 dest: /127.0.0.1:60693
2015-03-13 10:04:28,221 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741827_1003 src: /127.0.0.1:60731 dest: /127.0.0.1:60686
2015-03-13 10:04:28,226 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60731, dest: /127.0.0.1:60686, bytes: 15, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741827_1003, duration: 3081000
2015-03-13 10:04:28,226 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741827_1003, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:04:28,227 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741827_1003{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:04:28,227 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60730, dest: /127.0.0.1:60693, bytes: 15, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741827_1003, duration: 4193000
2015-03-13 10:04:28,227 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741827_1003, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:28,228 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60729, dest: /127.0.0.1:60696, bytes: 15, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741827_1003, duration: 5613000
2015-03-13 10:04:28,229 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741827_1003{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:04:28,229 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741827_1003, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:28,229 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741827_1003{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:04:28,232 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower-offset.txt is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:04:28,233 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:04:28,234 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:04:28,236 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:04:28,238 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt. BP-1005356445-10.1.1.144-1426266257849 blk_1073741828_1004{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:04:28,240 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004 src: /127.0.0.1:60732 dest: /127.0.0.1:60686
2015-03-13 10:04:28,241 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004 src: /127.0.0.1:60733 dest: /127.0.0.1:60689
2015-03-13 10:04:28,242 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004 src: /127.0.0.1:60734 dest: /127.0.0.1:60696
2015-03-13 10:04:28,247 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60734, dest: /127.0.0.1:60696, bytes: 19, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 3485000
2015-03-13 10:04:28,248 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:04:28,248 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741828_1004{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:04:28,249 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60733, dest: /127.0.0.1:60689, bytes: 19, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 4519000
2015-03-13 10:04:28,249 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:28,250 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741828_1004{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:04:28,251 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60732, dest: /127.0.0.1:60686, bytes: 19, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 6513000
2015-03-13 10:04:28,251 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:28,252 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741828_1004{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:04:28,254 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:04:28,279 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.classpath.files is deprecated. Instead, use mapreduce.job.classpath.files
2015-03-13 10:04:28,279 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
2015-03-13 10:04:28,280 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
2015-03-13 10:04:28,280 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
2015-03-13 10:04:28,280 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:04:28,280 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
2015-03-13 10:04:28,281 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.cache.files is deprecated. Instead, use mapreduce.job.cache.files
2015-03-13 10:04:28,281 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2015-03-13 10:04:28,281 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-03-13 10:04:28,282 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2015-03-13 10:04:28,282 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
2015-03-13 10:04:28,282 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-03-13 10:04:28,282 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
2015-03-13 10:04:28,283 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2015-03-13 10:04:28,285 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
2015-03-13 10:04:28,285 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
2015-03-13 10:04:28,285 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
2015-03-13 10:04:28,290 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:04:28,291 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:04:28,297 INFO  property.AppProps (AppProps.java:getAppID(169)) - using app.id: 351D3133F32B4C56AD41C256158277CA
2015-03-13 10:04:28,330 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-03-13 10:04:28,347 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-03-13 10:04:28,386 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle	dst=null	perm=null
2015-03-13 10:04:28,395 INFO  util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 2.6.3
2015-03-13 10:04:28,397 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting
2015-03-13 10:04:28,397 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt"]
2015-03-13 10:04:28,398 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower-offset.txt"]
2015-03-13 10:04:28,398 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle"]
2015-03-13 10:04:28,398 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  parallel execution is enabled: true
2015-03-13 10:04:28,398 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  starting jobs: 1
2015-03-13 10:04:28,399 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  allocating threads: 1
2015-03-13 10:04:28,399 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (1/1) ...splatform/joininnersingle
2015-03-13 10:04:28,442 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:04:28,457 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:04:28,464 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle	dst=null	perm=null
2015-03-13 10:04:28,467 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:04:28,470 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=soberoi:supergroup:rwx------
2015-03-13 10:04:28,491 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 1
2015-03-13 10:04:28,497 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001	dst=null	perm=null
2015-03-13 10:04:28,499 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001	dst=null	perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:04:28,500 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001	dst=null	perm=soberoi:supergroup:rwx------
2015-03-13 10:04:28,501 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.jar	dst=null	perm=null
2015-03-13 10:04:28,503 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:04:28,505 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073741829_1005{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:04:28,507 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741829_1005 src: /127.0.0.1:60736 dest: /127.0.0.1:60686
2015-03-13 10:04:28,509 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741829_1005 src: /127.0.0.1:60737 dest: /127.0.0.1:60693
2015-03-13 10:04:28,510 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741829_1005 src: /127.0.0.1:60738 dest: /127.0.0.1:60689
2015-03-13 10:04:28,516 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60738, dest: /127.0.0.1:60689, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741829_1005, duration: 4849000
2015-03-13 10:04:28,516 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741829_1005, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:04:28,517 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741829_1005{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:04:28,518 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60737, dest: /127.0.0.1:60693, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741829_1005, duration: 5643000
2015-03-13 10:04:28,518 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741829_1005, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:28,520 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60736, dest: /127.0.0.1:60686, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741829_1005, duration: 7631000
2015-03-13 10:04:28,520 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741829_1005{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:04:28,520 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741829_1005, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:28,522 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741829_1005{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:04:28,524 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:04:28,526 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.jar
2015-03-13 10:04:28,527 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.jar	dst=null	perm=null
2015-03-13 10:04:28,530 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:04:28,532 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:04:28,533 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:04:28,534 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:04:28,535 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:04:28,536 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:04:28,537 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:04:28,538 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:04:28,540 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:04:28,541 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:04:28,543 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2015-03-13 10:04:28,551 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower-offset.txt	dst=null	perm=null
2015-03-13 10:04:28,552 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:04:28,555 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower-offset.txt	dst=null	perm=null
2015-03-13 10:04:28,564 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:04:28,566 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:04:28,567 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.split
2015-03-13 10:04:28,567 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.split	dst=null	perm=null
2015-03-13 10:04:28,571 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073741830_1006{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:04:28,573 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741830_1006 src: /127.0.0.1:60739 dest: /127.0.0.1:60693
2015-03-13 10:04:28,574 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741830_1006 src: /127.0.0.1:60740 dest: /127.0.0.1:60689
2015-03-13 10:04:28,576 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741830_1006 src: /127.0.0.1:60741 dest: /127.0.0.1:60696
2015-03-13 10:04:28,577 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741830_1006 src: /127.0.0.1:60742 dest: /127.0.0.1:60686
2015-03-13 10:04:28,584 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60742, dest: /127.0.0.1:60686, bytes: 1817, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741830_1006, duration: 5649000
2015-03-13 10:04:28,584 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741830_1006, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:04:28,585 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741830_1006{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:04:28,586 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60741, dest: /127.0.0.1:60696, bytes: 1817, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741830_1006, duration: 6720000
2015-03-13 10:04:28,586 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741830_1006, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:28,587 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741830_1006{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:04:28,587 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60740, dest: /127.0.0.1:60689, bytes: 1817, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741830_1006, duration: 8540000
2015-03-13 10:04:28,588 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741830_1006, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:28,588 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741830_1006{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:04:28,589 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60739, dest: /127.0.0.1:60693, bytes: 1817, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741830_1006, duration: 9995000
2015-03-13 10:04:28,589 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741830_1006, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:28,590 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741830_1006{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:04:28,594 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:04:28,597 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:04:28,599 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:04:28,602 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073741831_1007{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:04:28,604 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741831_1007 src: /127.0.0.1:60743 dest: /127.0.0.1:60686
2015-03-13 10:04:28,606 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741831_1007 src: /127.0.0.1:60744 dest: /127.0.0.1:60693
2015-03-13 10:04:28,607 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741831_1007 src: /127.0.0.1:60745 dest: /127.0.0.1:60696
2015-03-13 10:04:28,612 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60745, dest: /127.0.0.1:60696, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741831_1007, duration: 3980000
2015-03-13 10:04:28,613 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741831_1007, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:04:28,614 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741831_1007{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:04:28,614 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60744, dest: /127.0.0.1:60693, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741831_1007, duration: 5345000
2015-03-13 10:04:28,614 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741831_1007, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:28,615 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741831_1007{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:04:28,616 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60743, dest: /127.0.0.1:60686, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741831_1007, duration: 6723000
2015-03-13 10:04:28,616 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741831_1007, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:28,617 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741831_1007{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:04:28,618 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:04:28,619 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:04:28,623 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:04:28,625 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:04:28,626 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.df.interval is deprecated. Instead, use fs.df.interval
2015-03-13 10:04:28,627 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
2015-03-13 10:04:28,627 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
2015-03-13 10:04:28,627 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
2015-03-13 10:04:28,627 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-03-13 10:04:28,627 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
2015-03-13 10:04:28,627 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
2015-03-13 10:04:28,627 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
2015-03-13 10:04:28,627 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
2015-03-13 10:04:28,628 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2015-03-13 10:04:28,628 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
2015-03-13 10:04:28,628 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
2015-03-13 10:04:28,628 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
2015-03-13 10:04:28,628 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2015-03-13 10:04:28,628 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
2015-03-13 10:04:28,629 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
2015-03-13 10:04:28,629 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
2015-03-13 10:04:28,629 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2015-03-13 10:04:28,629 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
2015-03-13 10:04:28,629 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
2015-03-13 10:04:28,629 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
2015-03-13 10:04:28,629 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.cache.files.filesizes is deprecated. Instead, use mapreduce.job.cache.files.filesizes
2015-03-13 10:04:28,629 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
2015-03-13 10:04:28,630 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
2015-03-13 10:04:28,630 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
2015-03-13 10:04:28,630 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
2015-03-13 10:04:28,630 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
2015-03-13 10:04:28,630 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
2015-03-13 10:04:28,630 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:04:28,630 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
2015-03-13 10:04:28,630 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
2015-03-13 10:04:28,631 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.block.size is deprecated. Instead, use dfs.blocksize
2015-03-13 10:04:28,631 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
2015-03-13 10:04:28,631 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
2015-03-13 10:04:28,631 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
2015-03-13 10:04:28,631 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
2015-03-13 10:04:28,631 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2015-03-13 10:04:28,631 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
2015-03-13 10:04:28,632 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
2015-03-13 10:04:28,632 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
2015-03-13 10:04:28,632 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2015-03-13 10:04:28,632 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
2015-03-13 10:04:28,632 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
2015-03-13 10:04:28,632 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
2015-03-13 10:04:28,633 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
2015-03-13 10:04:28,633 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
2015-03-13 10:04:28,633 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
2015-03-13 10:04:28,633 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
2015-03-13 10:04:28,633 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2015-03-13 10:04:28,633 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
2015-03-13 10:04:28,634 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
2015-03-13 10:04:28,634 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
2015-03-13 10:04:28,634 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:04:28,634 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
2015-03-13 10:04:28,634 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2015-03-13 10:04:28,634 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
2015-03-13 10:04:28,634 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
2015-03-13 10:04:28,635 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
2015-03-13 10:04:28,635 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
2015-03-13 10:04:28,635 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
2015-03-13 10:04:28,635 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
2015-03-13 10:04:28,635 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
2015-03-13 10:04:28,635 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
2015-03-13 10:04:28,636 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
2015-03-13 10:04:28,636 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
2015-03-13 10:04:28,636 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
2015-03-13 10:04:28,636 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
2015-03-13 10:04:28,636 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
2015-03-13 10:04:28,636 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
2015-03-13 10:04:28,636 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
2015-03-13 10:04:28,637 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
2015-03-13 10:04:28,637 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
2015-03-13 10:04:28,637 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
2015-03-13 10:04:28,637 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
2015-03-13 10:04:28,637 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-03-13 10:04:28,637 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
2015-03-13 10:04:28,637 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
2015-03-13 10:04:28,638 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
2015-03-13 10:04:28,638 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2015-03-13 10:04:28,638 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
2015-03-13 10:04:28,638 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
2015-03-13 10:04:28,638 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
2015-03-13 10:04:28,638 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
2015-03-13 10:04:28,638 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
2015-03-13 10:04:28,638 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
2015-03-13 10:04:28,639 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
2015-03-13 10:04:28,639 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
2015-03-13 10:04:28,639 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
2015-03-13 10:04:28,639 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
2015-03-13 10:04:28,639 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
2015-03-13 10:04:28,639 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2015-03-13 10:04:28,639 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
2015-03-13 10:04:28,639 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
2015-03-13 10:04:28,640 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
2015-03-13 10:04:28,640 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
2015-03-13 10:04:28,640 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
2015-03-13 10:04:28,640 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
2015-03-13 10:04:28,640 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
2015-03-13 10:04:28,640 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
2015-03-13 10:04:28,641 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
2015-03-13 10:04:28,641 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
2015-03-13 10:04:28,641 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
2015-03-13 10:04:28,641 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2015-03-13 10:04:28,641 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.cache.files.timestamps is deprecated. Instead, use mapreduce.job.cache.files.timestamps
2015-03-13 10:04:28,641 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-03-13 10:04:28,641 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
2015-03-13 10:04:28,642 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2015-03-13 10:04:28,642 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
2015-03-13 10:04:28,642 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
2015-03-13 10:04:28,642 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
2015-03-13 10:04:28,642 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
2015-03-13 10:04:28,642 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
2015-03-13 10:04:28,642 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
2015-03-13 10:04:28,643 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
2015-03-13 10:04:28,643 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
2015-03-13 10:04:28,643 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
2015-03-13 10:04:28,643 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
2015-03-13 10:04:28,643 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:04:28,643 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2015-03-13 10:04:28,731 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073741832_1008{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:04:28,734 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741832_1008 src: /127.0.0.1:60746 dest: /127.0.0.1:60686
2015-03-13 10:04:28,737 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741832_1008 src: /127.0.0.1:60747 dest: /127.0.0.1:60696
2015-03-13 10:04:28,739 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741832_1008 src: /127.0.0.1:60748 dest: /127.0.0.1:60693
2015-03-13 10:04:28,753 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60748, dest: /127.0.0.1:60693, bytes: 97648, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741832_1008, duration: 12392000
2015-03-13 10:04:28,754 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741832_1008, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:04:28,755 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741832_1008{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:04:28,755 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60747, dest: /127.0.0.1:60696, bytes: 97648, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741832_1008, duration: 13836000
2015-03-13 10:04:28,756 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741832_1008, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:28,758 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741832_1008{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:04:28,758 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60746, dest: /127.0.0.1:60686, bytes: 97648, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741832_1008, duration: 16503000
2015-03-13 10:04:28,758 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741832_1008, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:28,762 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741832_1008{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:04:28,763 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:04:28,764 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0001
2015-03-13 10:04:28,804 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001	dst=null	perm=null
2015-03-13 10:04:28,816 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.xml	dst=null	perm=null
2015-03-13 10:04:28,817 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.xml	dst=null	perm=null
2015-03-13 10:04:28,818 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.jar	dst=null	perm=null
2015-03-13 10:04:28,819 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.jar	dst=null	perm=null
2015-03-13 10:04:28,820 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.split	dst=null	perm=null
2015-03-13 10:04:28,821 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.split	dst=null	perm=null
2015-03-13 10:04:28,822 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:04:28,823 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:04:28,828 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:04:28,829 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:04:28,831 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:04:28,832 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:04:28,833 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:04:28,834 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:04:28,869 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 1 submitted by user soberoi
2015-03-13 10:04:28,869 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0001
2015-03-13 10:04:28,870 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0001 State change from NEW to NEW_SAVING
2015-03-13 10:04:28,870 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	IP=10.1.1.144	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1426266260362_0001
2015-03-13 10:04:28,874 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0001
2015-03-13 10:04:28,876 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0001 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:04:28,876 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0001_000001
2015-03-13 10:04:28,878 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0001_000001 State change from NEW to SUBMITTED
2015-03-13 10:04:28,881 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0001 from user: soberoi activated in queue: default
2015-03-13 10:04:28,882 INFO  capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0001 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:04:28,883 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0001 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:04:28,883 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0001_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:0, vCores:0>usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=1, numContainers=0, currently active: 1
2015-03-13 10:04:28,884 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0001_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:04:28,887 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0001 State change from SUBMITTED to ACCEPTED
2015-03-13 10:04:28,889 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0001 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:04:28,909 INFO  mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0001/
2015-03-13 10:04:28,910 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1426266260362_0001
2015-03-13 10:04:28,911 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0001/
2015-03-13 10:04:28,953 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0001_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:04:28,954 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0001	CONTAINERID=container_1426266260362_0001_01_000001
2015-03-13 10:04:28,954 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0001_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:04:28,954 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0001 container=Container: [ContainerId: container_1426266260362_0001_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0001_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:0, vCores:0>usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=1, numContainers=0 usedCapacity=0.0 absoluteUsedCapacity=0.0 used=<memory:0, vCores:0> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:28,954 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:04:28,955 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:28,956 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0001_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:04:28,957 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0001 AttemptId: appattempt_1426266260362_0001_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0001_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ]
2015-03-13 10:04:28,957 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0001_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:04:28,961 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0001_000001
2015-03-13 10:04:28,962 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0001_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:04:28,964 INFO  amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0001_000001
2015-03-13 10:04:28,974 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0001_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] for AM appattempt_1426266260362_0001_000001
2015-03-13 10:04:28,975 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0001_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-03-13 10:04:28,993 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0001_000001 (auth:SIMPLE)
2015-03-13 10:04:29,000 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0001_01_000001 by user soberoi
2015-03-13 10:04:29,011 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0001
2015-03-13 10:04:29,013 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0001 transitioned from NEW to INITING
2015-03-13 10:04:29,013 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0001	CONTAINERID=container_1426266260362_0001_01_000001
2015-03-13 10:04:29,014 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0001_01_000001 to application application_1426266260362_0001
2015-03-13 10:04:29,017 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0001 transitioned from INITING to RUNNING
2015-03-13 10:04:29,019 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:04:29,019 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0001
2015-03-13 10:04:29,022 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0001_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] for AM appattempt_1426266260362_0001_000001
2015-03-13 10:04:29,022 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0001_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:04:29,026 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:04:29,027 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:04:29,027 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:04:29,027 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:04:29,027 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:04:29,027 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:04:29,027 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0001_01_000001
2015-03-13 10:04:29,029 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar, 1426266260077, FILE, null }
2015-03-13 10:04:29,035 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar, 1426266259962, FILE, null }
2015-03-13 10:04:29,045 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426266260362_0001_01_000001.tokens. Credentials list: 
2015-03-13 10:04:29,059 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:04:29,059 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:04:29,061 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:04:29,061 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:04:29,063 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:04:29,063 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:04:29,064 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:04:29,064 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:04:29,065 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:04:29,065 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:04:29,067 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:04:29,067 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:04:29,068 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:04:29,068 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:04:29,069 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:04:29,069 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:04:29,071 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:04:29,075 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:04:29,075 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:04:29,097 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:60751, bytes: 408281, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741826_1002, duration: 2742000
2015-03-13 10:04:29,097 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:60750, bytes: 485810, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741825_1001, duration: 2691000
2015-03-13 10:04:29,142 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:04:29,143 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:04:29,177 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426266260362_0001_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000001.tokens
2015-03-13 10:04:29,177 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0001 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0001
2015-03-13 10:04:29,238 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004
2015-03-13 10:04:29,239 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741827_1003
2015-03-13 10:04:29,239 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741831_1007
2015-03-13 10:04:29,241 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741829_1005
2015-03-13 10:04:29,241 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741830_1006
2015-03-13 10:04:29,243 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741832_1008
2015-03-13 10:04:29,258 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741829_1005
2015-03-13 10:04:29,258 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741830_1006
2015-03-13 10:04:29,259 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004
2015-03-13 10:04:29,267 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.jar	dst=null	perm=null
2015-03-13 10:04:29,269 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.jar	dst=null	perm=null
2015-03-13 10:04:29,270 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.jar	dst=null	perm=null
2015-03-13 10:04:29,278 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60754, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1032480705_837, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741829_1005, duration: 711000
2015-03-13 10:04:29,312 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:04:29,332 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:04:29,333 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:04:29,335 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:04:29,342 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:60751, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1032480705_837, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741831_1007, duration: 207000
2015-03-13 10:04:29,356 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:04:29,373 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.split	dst=null	perm=null
2015-03-13 10:04:29,374 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.split	dst=null	perm=null
2015-03-13 10:04:29,375 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.split	dst=null	perm=null
2015-03-13 10:04:29,383 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:60755, bytes: 1833, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1032480705_837, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741830_1006, duration: 254000
2015-03-13 10:04:29,396 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:04:29,414 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.xml	dst=null	perm=null
2015-03-13 10:04:29,415 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.xml	dst=null	perm=null
2015-03-13 10:04:29,416 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.xml	dst=null	perm=null
2015-03-13 10:04:29,423 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60754, bytes: 98412, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1032480705_837, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741832_1008, duration: 423000
2015-03-13 10:04:29,437 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:04:29,438 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:04:29,448 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741832_1008
2015-03-13 10:04:29,449 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741827_1003
2015-03-13 10:04:29,449 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741830_1006
2015-03-13 10:04:29,451 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741829_1005
2015-03-13 10:04:29,451 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741831_1007
2015-03-13 10:04:29,474 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:04:29,475 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:04:29,550 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000001/default_container_executor.sh]
2015-03-13 10:04:29,633 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741827_1003
2015-03-13 10:04:29,634 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741830_1006
2015-03-13 10:04:29,634 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004
2015-03-13 10:04:29,635 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741831_1007
2015-03-13 10:04:29,636 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741832_1008
2015-03-13 10:04:29,943 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:29,944 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0001_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:04:30,620 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60686 to replicate blk_1073741829_1005 to datanode(s) 127.0.0.1:60696
2015-03-13 10:04:30,945 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:31,217 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:04:31,238 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/COMMIT_STARTED	dst=null	perm=null
2015-03-13 10:04:31,239 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/COMMIT_SUCCESS	dst=null	perm=null
2015-03-13 10:04:31,240 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/COMMIT_FAIL	dst=null	perm=null
2015-03-13 10:04:31,293 INFO  datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-1907321454-10.1.1.144-60686-1426266259166, infoPort=60687, ipcPort=60688, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073741829_1005 to 127.0.0.1:60696 
2015-03-13 10:04:31,293 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001	dst=null	perm=null
2015-03-13 10:04:31,295 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:04:31,297 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741829_1005 src: /127.0.0.1:60757 dest: /127.0.0.1:60696
2015-03-13 10:04:31,297 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:04:31,298 INFO  datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073741829_1005 (numBytes=254067) to /127.0.0.1:60696
2015-03-13 10:04:31,299 INFO  datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073741829_1005 src: /127.0.0.1:60757 dest: /127.0.0.1:60696 of size 254067
2015-03-13 10:04:31,300 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741829_1005 size 254067
2015-03-13 10:04:31,302 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:04:31,305 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:04:31,596 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:04:31,604 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:04:31,659 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:60758, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1686244545_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741831_1007, duration: 246000
2015-03-13 10:04:31,947 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:32,430 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0001_000001 (auth:SIMPLE)
2015-03-13 10:04:32,435 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0001_000001
2015-03-13 10:04:32,435 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi	IP=10.1.1.144	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1426266260362_0001	APPATTEMPTID=appattempt_1426266260362_0001_000001
2015-03-13 10:04:32,436 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0001_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:04:32,436 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0001 State change from ACCEPTED to RUNNING
2015-03-13 10:04:32,464 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job_1426266260362_0001_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:04:32,473 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:04:32,529 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job_1426266260362_0001_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:04:32,655 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job_1426266260362_0001_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073741833_1009{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:04:32,692 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741833_1009 src: /127.0.0.1:60764 dest: /127.0.0.1:60689
2015-03-13 10:04:32,693 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741833_1009 src: /127.0.0.1:60765 dest: /127.0.0.1:60696
2015-03-13 10:04:32,695 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741833_1009 src: /127.0.0.1:60766 dest: /127.0.0.1:60693
2015-03-13 10:04:32,708 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60766, dest: /127.0.0.1:60693, bytes: 90446, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1686244545_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741833_1009, duration: 11034000
2015-03-13 10:04:32,709 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741833_1009, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:04:32,710 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741833_1009{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:04:32,710 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60765, dest: /127.0.0.1:60696, bytes: 90446, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1686244545_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741833_1009, duration: 7792000
2015-03-13 10:04:32,710 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741833_1009, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:32,711 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741833_1009{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:04:32,711 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60764, dest: /127.0.0.1:60689, bytes: 90446, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1686244545_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741833_1009, duration: 13090000
2015-03-13 10:04:32,711 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741833_1009, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:32,712 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741833_1009{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:04:32,718 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job_1426266260362_0001_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-1686244545_1
2015-03-13 10:04:32,948 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:33,644 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0001_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:04:33,645 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0001	CONTAINERID=container_1426266260362_0001_01_000002
2015-03-13 10:04:33,645 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0001_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:04:33,645 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0001 container=Container: [ContainerId: container_1426266260362_0001_01_000002, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0001_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:33,645 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:04:33,646 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:33,646 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0001_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:04:33,647 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0001	CONTAINERID=container_1426266260362_0001_01_000003
2015-03-13 10:04:33,647 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0001_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:04:33,647 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0001 container=Container: [ContainerId: container_1426266260362_0001_01_000003, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0001_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:33,647 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:04:33,647 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:33,648 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0001_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:04:33,648 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0001	CONTAINERID=container_1426266260362_0001_01_000004
2015-03-13 10:04:33,648 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0001_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:04:33,649 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0001 container=Container: [ContainerId: container_1426266260362_0001_01_000004, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0001_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:33,649 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:04:33,649 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:33,650 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0001_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:04:33,650 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0001	CONTAINERID=container_1426266260362_0001_01_000005
2015-03-13 10:04:33,650 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0001_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:04:33,650 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0001 container=Container: [ContainerId: container_1426266260362_0001_01_000005, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0001_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:33,651 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:04:33,651 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:33,758 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0001_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:04:33,758 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0001	CONTAINERID=container_1426266260362_0001_01_000006
2015-03-13 10:04:33,758 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0001_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:04:33,759 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0001 container=Container: [ContainerId: container_1426266260362_0001_01_000006, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0001_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:33,759 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=1, numContainers=6
2015-03-13 10:04:33,759 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:33,948 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:34,265 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741833_1009
2015-03-13 10:04:34,460 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741833_1009
2015-03-13 10:04:34,489 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0001_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:04:34,489 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0001_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:04:34,490 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0001_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:04:34,490 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0001_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:04:34,491 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0001_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:04:34,522 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.jar	dst=null	perm=null
2015-03-13 10:04:34,523 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.jar	dst=null	perm=null
2015-03-13 10:04:34,531 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.xml	dst=null	perm=null
2015-03-13 10:04:34,533 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.xml	dst=null	perm=null
2015-03-13 10:04:34,535 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:04:34,536 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:04:34,542 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:04:34,544 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:04:34,546 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:04:34,547 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:04:34,625 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0001_000001 (auth:SIMPLE)
2015-03-13 10:04:34,625 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0001_000001 (auth:SIMPLE)
2015-03-13 10:04:34,631 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0001_01_000006 by user soberoi
2015-03-13 10:04:34,632 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0001_01_000004 by user soberoi
2015-03-13 10:04:34,633 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0001_01_000002 by user soberoi
2015-03-13 10:04:34,633 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0001_01_000003 by user soberoi
2015-03-13 10:04:34,632 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0001_01_000005 by user soberoi
2015-03-13 10:04:34,634 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0001
2015-03-13 10:04:34,635 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0001	CONTAINERID=container_1426266260362_0001_01_000004
2015-03-13 10:04:34,635 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0001
2015-03-13 10:04:34,634 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0001	CONTAINERID=container_1426266260362_0001_01_000002
2015-03-13 10:04:34,634 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0001	CONTAINERID=container_1426266260362_0001_01_000003
2015-03-13 10:04:34,634 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0001	CONTAINERID=container_1426266260362_0001_01_000005
2015-03-13 10:04:34,635 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0001_01_000002 to application application_1426266260362_0001
2015-03-13 10:04:34,637 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0001 transitioned from NEW to INITING
2015-03-13 10:04:34,637 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0001_01_000003 to application application_1426266260362_0001
2015-03-13 10:04:34,637 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0001_01_000005 to application application_1426266260362_0001
2015-03-13 10:04:34,638 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0001_01_000004 to application application_1426266260362_0001
2015-03-13 10:04:34,635 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0001	CONTAINERID=container_1426266260362_0001_01_000006
2015-03-13 10:04:34,636 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0001 transitioned from NEW to INITING
2015-03-13 10:04:34,639 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0001_01_000006 to application application_1426266260362_0001
2015-03-13 10:04:34,639 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0001 transitioned from INITING to RUNNING
2015-03-13 10:04:34,641 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0001 transitioned from INITING to RUNNING
2015-03-13 10:04:34,640 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:04:34,642 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741829_1005
2015-03-13 10:04:34,642 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:04:34,642 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:04:34,643 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:04:34,642 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0001
2015-03-13 10:04:34,643 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0001
2015-03-13 10:04:34,643 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:04:34,643 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:04:34,643 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0001
2015-03-13 10:04:34,643 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0001
2015-03-13 10:04:34,644 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:04:34,643 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741833_1009
2015-03-13 10:04:34,645 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0001
2015-03-13 10:04:34,646 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0001
2015-03-13 10:04:34,646 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:34,646 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:04:34,647 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:04:34,647 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:04:34,647 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:04:34,647 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0001_01_000006
2015-03-13 10:04:34,646 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:04:34,648 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:04:34,647 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:34,648 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar, 1426266260077, FILE, null }
2015-03-13 10:04:34,648 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:04:34,649 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:04:34,649 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0001
2015-03-13 10:04:34,649 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0001
2015-03-13 10:04:34,649 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:04:34,649 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0001
2015-03-13 10:04:34,649 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:34,649 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0001
2015-03-13 10:04:34,650 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0001
2015-03-13 10:04:34,650 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:04:34,650 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0001
2015-03-13 10:04:34,650 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0001
2015-03-13 10:04:34,650 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0001
2015-03-13 10:04:34,650 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:04:34,650 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0001
2015-03-13 10:04:34,651 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0001_01_000004
2015-03-13 10:04:34,652 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar, 1426266260077, FILE, null }
2015-03-13 10:04:34,652 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:34,653 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar, 1426266259962, FILE, null }
2015-03-13 10:04:34,653 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0001_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:04:34,653 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0001_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:04:34,654 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0001_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:04:34,654 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0001_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:04:34,663 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar, 1426266259962, FILE, null }
2015-03-13 10:04:34,664 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0001_01_000002
2015-03-13 10:04:34,665 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar, 1426266260077, FILE, null }
2015-03-13 10:04:34,665 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar, 1426266259962, FILE, null }
2015-03-13 10:04:34,665 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0001_01_000003
2015-03-13 10:04:34,667 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar, 1426266260077, FILE, null }
2015-03-13 10:04:34,667 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar, 1426266259962, FILE, null }
2015-03-13 10:04:34,667 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0001_01_000005
2015-03-13 10:04:34,669 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar, 1426266260077, FILE, null }
2015-03-13 10:04:34,669 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar, 1426266259962, FILE, null }
2015-03-13 10:04:34,684 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426266260362_0001_01_000004.tokens. Credentials list: 
2015-03-13 10:04:34,684 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0001_01_000006.tokens. Credentials list: 
2015-03-13 10:04:34,696 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0001_01_000005.tokens. Credentials list: 
2015-03-13 10:04:34,696 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1426266260362_0001_01_000003.tokens. Credentials list: 
2015-03-13 10:04:34,699 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426266260362_0001_01_000002.tokens. Credentials list: 
2015-03-13 10:04:34,705 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:04:34,707 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:04:34,708 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:04:34,709 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:04:34,709 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:04:34,711 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:04:34,713 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:04:34,713 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:04:34,715 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:04:34,715 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:04:34,717 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:04:34,717 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:04:34,718 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:04:34,719 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:04:34,719 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:04:34,720 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:04:34,720 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:04:34,720 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:04:34,723 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:04:34,725 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:04:34,725 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:04:34,726 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:04:34,726 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:04:34,727 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:04:34,727 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:04:34,727 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:04:34,728 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:04:34,728 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:04:34,730 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:04:34,730 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:04:34,738 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:04:34,738 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:04:34,740 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:04:34,740 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:04:34,741 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:04:34,741 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:04:34,744 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:04:34,745 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:04:34,752 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:60769, bytes: 485810, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741825_1001, duration: 1256000
2015-03-13 10:04:34,755 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:60770, bytes: 485810, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741825_1001, duration: 1244000
2015-03-13 10:04:34,758 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:60771, bytes: 408281, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741826_1002, duration: 1092000
2015-03-13 10:04:34,764 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:60772, bytes: 408281, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741826_1002, duration: 1101000
2015-03-13 10:04:34,764 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:34,765 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0001_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:04:34,804 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:04:34,805 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:04:34,806 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:04:34,812 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:04:34,869 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426266260362_0001_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000004.tokens
2015-03-13 10:04:34,869 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0001 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0001
2015-03-13 10:04:34,874 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0001_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000006.tokens
2015-03-13 10:04:34,874 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0001 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0001
2015-03-13 10:04:34,948 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.jar	dst=null	perm=null
2015-03-13 10:04:34,950 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.jar	dst=null	perm=null
2015-03-13 10:04:34,952 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.jar	dst=null	perm=null
2015-03-13 10:04:34,953 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:34,957 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.jar	dst=null	perm=null
2015-03-13 10:04:34,960 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.jar	dst=null	perm=null
2015-03-13 10:04:34,961 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.jar	dst=null	perm=null
2015-03-13 10:04:34,961 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:60770, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-420781055_1031, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741829_1005, duration: 736000
2015-03-13 10:04:34,972 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60777, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-65381258_1034, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741829_1005, duration: 756000
2015-03-13 10:04:34,989 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:04:35,001 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:04:35,014 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.xml	dst=null	perm=null
2015-03-13 10:04:35,015 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.xml	dst=null	perm=null
2015-03-13 10:04:35,016 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.xml	dst=null	perm=null
2015-03-13 10:04:35,023 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.xml	dst=null	perm=null
2015-03-13 10:04:35,024 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:60772, bytes: 98412, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-420781055_1031, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741832_1008, duration: 458000
2015-03-13 10:04:35,025 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.xml	dst=null	perm=null
2015-03-13 10:04:35,026 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.xml	dst=null	perm=null
2015-03-13 10:04:35,033 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60777, bytes: 98412, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-65381258_1034, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741832_1008, duration: 415000
2015-03-13 10:04:35,039 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:04:35,039 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:04:35,039 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:04:35,039 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:04:35,039 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:04:35,064 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:04:35,065 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:04:35,118 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:04:35,118 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:04:35,121 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:04:35,121 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:04:35,126 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:04:35,126 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:04:35,128 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:04:35,128 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:04:35,133 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:04:35,134 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:04:35,289 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000005/default_container_executor.sh]
2015-03-13 10:04:35,297 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000002/default_container_executor.sh]
2015-03-13 10:04:35,298 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000006/default_container_executor.sh]
2015-03-13 10:04:35,317 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000003/default_container_executor.sh]
2015-03-13 10:04:35,335 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000004/default_container_executor.sh]
2015-03-13 10:04:35,510 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:04:35,656 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:35,656 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:35,657 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:35,657 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:35,774 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:35,959 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:36,069 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:04:36,191 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426266260362_0001_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000002.tokens
2015-03-13 10:04:36,191 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0001 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0001
2015-03-13 10:04:36,301 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:04:36,425 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1426266260362_0001_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000003.tokens
2015-03-13 10:04:36,425 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0001 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0001
2015-03-13 10:04:36,536 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:04:36,657 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0001_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000005.tokens
2015-03-13 10:04:36,658 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0001 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0001
2015-03-13 10:04:36,658 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:36,659 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:36,659 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:36,660 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:36,778 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:36,963 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:37,663 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:37,663 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:37,664 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:37,664 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:37,781 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:37,968 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:38,670 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:38,670 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:38,671 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:38,671 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:38,786 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:38,970 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:39,674 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:39,675 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:39,675 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:39,676 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:39,787 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:39,971 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:40,678 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:40,679 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:40,679 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:40,680 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:40,790 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:40,972 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:41,682 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:41,682 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:41,682 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:41,683 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:41,791 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:41,973 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:42,687 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:42,687 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:42,688 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:42,688 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:42,794 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:42,974 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:43,313 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.split	dst=null	perm=null
2015-03-13 10:04:43,365 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.split	dst=null	perm=null
2015-03-13 10:04:43,564 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60788, bytes: 1317, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0001_m_000002_0_1287431413_1, offset: 512, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741830_1006, duration: 270000
2015-03-13 10:04:43,585 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.split	dst=null	perm=null
2015-03-13 10:04:43,617 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.split	dst=null	perm=null
2015-03-13 10:04:43,631 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60789, bytes: 801, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0001_m_000003_0_369364749_1, offset: 1024, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741830_1006, duration: 230000
2015-03-13 10:04:43,637 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.split	dst=null	perm=null
2015-03-13 10:04:43,689 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:43,689 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:43,690 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:43,690 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:43,728 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower-offset.txt	dst=null	perm=null
2015-03-13 10:04:43,732 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60788, bytes: 19, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0001_m_000002_0_1287431413_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741827_1003, duration: 245000
2015-03-13 10:04:43,735 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60793, bytes: 1833, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0001_m_000001_0_-1451507588_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741830_1006, duration: 262000
2015-03-13 10:04:43,772 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/_temporary/attempt_1426266260362_0001_m_000002_0/part-00002	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:04:43,780 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:60794, bytes: 1833, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0001_m_000000_0_-582525044_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741830_1006, duration: 226000
2015-03-13 10:04:43,787 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower-offset.txt	dst=null	perm=null
2015-03-13 10:04:43,793 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60789, bytes: 19, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0001_m_000003_0_369364749_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741827_1003, duration: 240000
2015-03-13 10:04:43,798 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:43,805 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:60795, bytes: 801, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0001_m_000004_0_-730026302_1, offset: 1024, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741830_1006, duration: 213000
2015-03-13 10:04:43,809 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/_temporary/attempt_1426266260362_0001_m_000003_0/part-00003	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:04:43,863 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower-offset.txt	dst=null	perm=null
2015-03-13 10:04:43,867 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:60796, bytes: 19, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0001_m_000001_0_-1451507588_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741827_1003, duration: 223000
2015-03-13 10:04:43,905 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/_temporary/attempt_1426266260362_0001_m_000001_0/part-00001	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:04:43,921 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower-offset.txt	dst=null	perm=null
2015-03-13 10:04:43,931 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower-offset.txt	dst=null	perm=null
2015-03-13 10:04:43,937 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:60797, bytes: 19, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0001_m_000004_0_-730026302_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741827_1003, duration: 223000
2015-03-13 10:04:43,958 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/_temporary/attempt_1426266260362_0001_m_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:04:43,970 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/_temporary/attempt_1426266260362_0001_m_000004_0/part-00004	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:04:43,975 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:44,177 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:04:44,186 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:04:44,190 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:04:44,196 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:60798, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0001_m_000002_0_1287431413_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 1431000
2015-03-13 10:04:44,198 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:04:44,207 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:04:44,210 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:04:44,216 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60799, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0001_m_000003_0_369364749_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 212000
2015-03-13 10:04:44,218 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/_temporary/attempt_1426266260362_0001_m_000002_0/part-00002 is closed by DFSClient_attempt_1426266260362_0001_m_000002_0_1287431413_1
2015-03-13 10:04:44,226 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/_temporary/attempt_1426266260362_0001_m_000002_0	dst=null	perm=null
2015-03-13 10:04:44,234 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/_temporary/attempt_1426266260362_0001_m_000002_0	dst=null	perm=null
2015-03-13 10:04:44,235 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/task_1426266260362_0001_m_000002	dst=null	perm=null
2015-03-13 10:04:44,241 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/_temporary/attempt_1426266260362_0001_m_000002_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/task_1426266260362_0001_m_000002	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:04:44,247 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/_temporary/attempt_1426266260362_0001_m_000003_0/part-00003. BP-1005356445-10.1.1.144-1426266257849 blk_1073741834_1010{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:04:44,266 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0001_01_000004
2015-03-13 10:04:44,267 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0001	CONTAINERID=container_1426266260362_0001_01_000004
2015-03-13 10:04:44,267 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:04:44,268 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0001_01_000004
2015-03-13 10:04:44,268 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:44,268 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:44,269 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:04:44,269 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:44,282 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0001_01_000004 is : 143
2015-03-13 10:04:44,286 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job_1426266260362_0001_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073741835_1011{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:04:44,288 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741835_1011 src: /127.0.0.1:60801 dest: /127.0.0.1:60686
2015-03-13 10:04:44,290 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741835_1011 src: /127.0.0.1:60802 dest: /127.0.0.1:60689
2015-03-13 10:04:44,292 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741835_1011 src: /127.0.0.1:60803 dest: /127.0.0.1:60693
2015-03-13 10:04:44,301 INFO  hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job_1426266260362_0001_1.jhist for DFSClient_NONMAPREDUCE_-1686244545_1
2015-03-13 10:04:44,302 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:04:44,304 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000004
2015-03-13 10:04:44,304 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000004
2015-03-13 10:04:44,304 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0001	CONTAINERID=container_1426266260362_0001_01_000004
2015-03-13 10:04:44,304 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000004
2015-03-13 10:04:44,304 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000004
2015-03-13 10:04:44,307 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:04:44,307 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0001_01_000004 from application application_1426266260362_0001
2015-03-13 10:04:44,307 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:04:44,307 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0001
2015-03-13 10:04:44,313 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741834_1010 src: /127.0.0.1:60800 dest: /127.0.0.1:60689
2015-03-13 10:04:44,316 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741834_1010 src: /127.0.0.1:60804 dest: /127.0.0.1:60696
2015-03-13 10:04:44,317 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741834_1010 src: /127.0.0.1:60805 dest: /127.0.0.1:60693
2015-03-13 10:04:44,330 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60805, dest: /127.0.0.1:60693, bytes: 4, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0001_m_000003_0_369364749_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741834_1010, duration: 11670000
2015-03-13 10:04:44,331 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741834_1010, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:04:44,331 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741834_1010{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:04:44,331 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60804, dest: /127.0.0.1:60696, bytes: 4, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0001_m_000003_0_369364749_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741834_1010, duration: 12533000
2015-03-13 10:04:44,332 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741834_1010, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:44,333 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741834_1010{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:04:44,333 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60800, dest: /127.0.0.1:60689, bytes: 4, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0001_m_000003_0_369364749_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741834_1010, duration: 13841000
2015-03-13 10:04:44,333 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741834_1010, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:44,334 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741834_1010{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:04:44,340 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/_temporary/attempt_1426266260362_0001_m_000003_0/part-00003 is closed by DFSClient_attempt_1426266260362_0001_m_000003_0_369364749_1
2015-03-13 10:04:44,350 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/_temporary/attempt_1426266260362_0001_m_000003_0	dst=null	perm=null
2015-03-13 10:04:44,356 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/_temporary/attempt_1426266260362_0001_m_000003_0	dst=null	perm=null
2015-03-13 10:04:44,358 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/task_1426266260362_0001_m_000003	dst=null	perm=null
2015-03-13 10:04:44,362 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/_temporary/attempt_1426266260362_0001_m_000003_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/task_1426266260362_0001_m_000003	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:04:44,374 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0001_01_000005
2015-03-13 10:04:44,374 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0001	CONTAINERID=container_1426266260362_0001_01_000005
2015-03-13 10:04:44,375 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:44,375 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:44,376 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:04:44,376 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0001_01_000004
2015-03-13 10:04:44,376 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:04:44,377 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:04:44,378 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0001_01_000005
2015-03-13 10:04:44,378 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0001_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:04:44,378 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0001_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:04:44,379 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0001	CONTAINERID=container_1426266260362_0001_01_000004
2015-03-13 10:04:44,379 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0001_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:04:44,379 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:04:44,379 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0001_01_000004, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:44,379 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:44,380 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:04:44,380 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0001_000001 released container container_1426266260362_0001_01_000004 on node: host: 10.1.1.144:60715 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:04:44,393 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0001_01_000005 is : 143
2015-03-13 10:04:44,407 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:04:44,408 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000005
2015-03-13 10:04:44,408 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000005
2015-03-13 10:04:44,408 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000005
2015-03-13 10:04:44,408 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000005
2015-03-13 10:04:44,409 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0001	CONTAINERID=container_1426266260362_0001_01_000005
2015-03-13 10:04:44,409 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:04:44,410 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0001_01_000005 from application application_1426266260362_0001
2015-03-13 10:04:44,410 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:04:44,410 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0001
2015-03-13 10:04:44,417 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:04:44,422 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:04:44,426 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:04:44,429 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:04:44,431 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:04:44,433 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60793, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0001_m_000001_0_-1451507588_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 247000
2015-03-13 10:04:44,435 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:04:44,440 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60806, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0001_m_000000_0_-582525044_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 242000
2015-03-13 10:04:44,446 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:60807, bytes: 19, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0001_m_000000_0_-582525044_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741827_1003, duration: 1287000
2015-03-13 10:04:44,454 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:04:44,460 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/_temporary/attempt_1426266260362_0001_m_000001_0/part-00001. BP-1005356445-10.1.1.144-1426266257849 blk_1073741836_1012{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:04:44,466 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741834_1010
2015-03-13 10:04:44,469 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/_temporary/attempt_1426266260362_0001_m_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073741837_1013{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:04:44,505 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741836_1012 src: /127.0.0.1:60808 dest: /127.0.0.1:60696
2015-03-13 10:04:44,507 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741836_1012 src: /127.0.0.1:60810 dest: /127.0.0.1:60693
2015-03-13 10:04:44,509 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741836_1012 src: /127.0.0.1:60811 dest: /127.0.0.1:60689
2015-03-13 10:04:44,514 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741837_1013 src: /127.0.0.1:60809 dest: /127.0.0.1:60689
2015-03-13 10:04:44,515 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741837_1013 src: /127.0.0.1:60812 dest: /127.0.0.1:60686
2015-03-13 10:04:44,517 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741837_1013 src: /127.0.0.1:60813 dest: /127.0.0.1:60693
2015-03-13 10:04:44,526 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60813, dest: /127.0.0.1:60693, bytes: 4, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0001_m_000000_0_-582525044_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741837_1013, duration: 7601000
2015-03-13 10:04:44,526 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741837_1013, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:04:44,527 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741837_1013{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:04:44,527 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60812, dest: /127.0.0.1:60686, bytes: 4, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0001_m_000000_0_-582525044_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741837_1013, duration: 7880000
2015-03-13 10:04:44,527 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741837_1013, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:44,528 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741837_1013{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:04:44,528 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60809, dest: /127.0.0.1:60689, bytes: 4, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0001_m_000000_0_-582525044_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741837_1013, duration: 9601000
2015-03-13 10:04:44,528 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741837_1013, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:44,529 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741837_1013{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:04:44,539 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60811, dest: /127.0.0.1:60689, bytes: 4, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0001_m_000001_0_-1451507588_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741836_1012, duration: 28907000
2015-03-13 10:04:44,540 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741836_1012, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:04:44,540 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741836_1012{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:04:44,540 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60810, dest: /127.0.0.1:60693, bytes: 4, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0001_m_000001_0_-1451507588_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741836_1012, duration: 29638000
2015-03-13 10:04:44,541 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741836_1012, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:44,541 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741836_1012{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:04:44,541 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60808, dest: /127.0.0.1:60696, bytes: 4, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0001_m_000001_0_-1451507588_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741836_1012, duration: 30833000
2015-03-13 10:04:44,542 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741836_1012, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:44,542 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741836_1012{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:04:44,550 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/_temporary/attempt_1426266260362_0001_m_000001_0/part-00001 is closed by DFSClient_attempt_1426266260362_0001_m_000001_0_-1451507588_1
2015-03-13 10:04:44,554 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/_temporary/attempt_1426266260362_0001_m_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0001_m_000000_0_-582525044_1
2015-03-13 10:04:44,563 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/_temporary/attempt_1426266260362_0001_m_000001_0	dst=null	perm=null
2015-03-13 10:04:44,570 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/_temporary/attempt_1426266260362_0001_m_000000_0	dst=null	perm=null
2015-03-13 10:04:44,570 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/_temporary/attempt_1426266260362_0001_m_000001_0	dst=null	perm=null
2015-03-13 10:04:44,572 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/task_1426266260362_0001_m_000001	dst=null	perm=null
2015-03-13 10:04:44,578 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/_temporary/attempt_1426266260362_0001_m_000000_0	dst=null	perm=null
2015-03-13 10:04:44,579 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/task_1426266260362_0001_m_000000	dst=null	perm=null
2015-03-13 10:04:44,580 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/_temporary/attempt_1426266260362_0001_m_000001_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/task_1426266260362_0001_m_000001	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:04:44,584 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/_temporary/attempt_1426266260362_0001_m_000000_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/task_1426266260362_0001_m_000000	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:04:44,585 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:04:44,592 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0001_01_000003
2015-03-13 10:04:44,593 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0001	CONTAINERID=container_1426266260362_0001_01_000003
2015-03-13 10:04:44,593 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:04:44,593 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0001_01_000003
2015-03-13 10:04:44,593 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:44,594 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:04:44,594 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:04:44,594 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0001_01_000005
2015-03-13 10:04:44,595 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0001_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:04:44,595 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0001_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:04:44,595 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0001	CONTAINERID=container_1426266260362_0001_01_000005
2015-03-13 10:04:44,595 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0001_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:04:44,595 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:04:44,595 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0001_01_000005, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:44,596 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:44,596 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:04:44,596 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0001_000001 released container container_1426266260362_0001_01_000005 on node: host: 10.1.1.144:60715 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:04:44,605 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0001_01_000003 is : 143
2015-03-13 10:04:44,619 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:04:44,620 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000003
2015-03-13 10:04:44,620 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000003
2015-03-13 10:04:44,621 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000003
2015-03-13 10:04:44,621 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000003
2015-03-13 10:04:44,622 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0001	CONTAINERID=container_1426266260362_0001_01_000003
2015-03-13 10:04:44,622 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:04:44,622 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0001_01_000003 from application application_1426266260362_0001
2015-03-13 10:04:44,623 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:04:44,623 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0001
2015-03-13 10:04:44,630 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0001_01_000002
2015-03-13 10:04:44,631 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0001	CONTAINERID=container_1426266260362_0001_01_000002
2015-03-13 10:04:44,631 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:04:44,631 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0001_01_000002
2015-03-13 10:04:44,631 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:04:44,631 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:04:44,632 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0001_01_000003
2015-03-13 10:04:44,633 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0001_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:04:44,633 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0001_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:04:44,633 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0001	CONTAINERID=container_1426266260362_0001_01_000003
2015-03-13 10:04:44,633 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0001_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:04:44,633 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:04:44,633 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0001_01_000003, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:44,634 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:44,634 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:04:44,634 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0001_000001 released container container_1426266260362_0001_01_000003 on node: host: 10.1.1.144:60715 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:04:44,644 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0001_01_000002 is : 143
2015-03-13 10:04:44,648 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741836_1012
2015-03-13 10:04:44,649 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741834_1010
2015-03-13 10:04:44,654 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:04:44,659 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:60814, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0001_m_000004_0_-730026302_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 202000
2015-03-13 10:04:44,663 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:04:44,664 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000002
2015-03-13 10:04:44,664 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000002
2015-03-13 10:04:44,664 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000002
2015-03-13 10:04:44,665 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000002
2015-03-13 10:04:44,671 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0001	CONTAINERID=container_1426266260362_0001_01_000002
2015-03-13 10:04:44,671 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:04:44,671 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0001_01_000002 from application application_1426266260362_0001
2015-03-13 10:04:44,671 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:04:44,671 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0001
2015-03-13 10:04:44,680 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/_temporary/attempt_1426266260362_0001_m_000004_0/part-00004 is closed by DFSClient_attempt_1426266260362_0001_m_000004_0_-730026302_1
2015-03-13 10:04:44,689 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/_temporary/attempt_1426266260362_0001_m_000004_0	dst=null	perm=null
2015-03-13 10:04:44,696 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/_temporary/attempt_1426266260362_0001_m_000004_0	dst=null	perm=null
2015-03-13 10:04:44,698 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/task_1426266260362_0001_m_000004	dst=null	perm=null
2015-03-13 10:04:44,702 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/_temporary/attempt_1426266260362_0001_m_000004_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/task_1426266260362_0001_m_000004	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:04:44,717 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0001_000001 (auth:SIMPLE)
2015-03-13 10:04:44,723 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0001_01_000006
2015-03-13 10:04:44,723 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0001	CONTAINERID=container_1426266260362_0001_01_000006
2015-03-13 10:04:44,724 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:04:44,724 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0001_01_000006
2015-03-13 10:04:44,724 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:04:44,729 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:04:44,731 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-1686244545_1
2015-03-13 10:04:44,735 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1	dst=null	perm=null
2015-03-13 10:04:44,736 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0001_01_000006 is : 143
2015-03-13 10:04:44,744 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle	dst=null	perm=null
2015-03-13 10:04:44,746 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle	dst=null	perm=null
2015-03-13 10:04:44,748 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/task_1426266260362_0001_m_000000	dst=null	perm=null
2015-03-13 10:04:44,750 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/part-00000	dst=null	perm=null
2015-03-13 10:04:44,750 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:04:44,752 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000006
2015-03-13 10:04:44,753 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000006
2015-03-13 10:04:44,754 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0001	CONTAINERID=container_1426266260362_0001_01_000006
2015-03-13 10:04:44,754 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000006
2015-03-13 10:04:44,755 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/task_1426266260362_0001_m_000000/part-00000	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/part-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:04:44,755 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000006
2015-03-13 10:04:44,758 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:04:44,759 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0001_01_000006 from application application_1426266260362_0001
2015-03-13 10:04:44,759 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:04:44,760 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0001
2015-03-13 10:04:44,760 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle	dst=null	perm=null
2015-03-13 10:04:44,761 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle	dst=null	perm=null
2015-03-13 10:04:44,762 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/task_1426266260362_0001_m_000001	dst=null	perm=null
2015-03-13 10:04:44,764 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/part-00001	dst=null	perm=null
2015-03-13 10:04:44,766 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/task_1426266260362_0001_m_000001/part-00001	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/part-00001	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:04:44,767 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle	dst=null	perm=null
2015-03-13 10:04:44,768 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle	dst=null	perm=null
2015-03-13 10:04:44,769 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/task_1426266260362_0001_m_000002	dst=null	perm=null
2015-03-13 10:04:44,773 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/part-00002	dst=null	perm=null
2015-03-13 10:04:44,778 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/task_1426266260362_0001_m_000002/part-00002	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/part-00002	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:04:44,781 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle	dst=null	perm=null
2015-03-13 10:04:44,782 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle	dst=null	perm=null
2015-03-13 10:04:44,784 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/task_1426266260362_0001_m_000003	dst=null	perm=null
2015-03-13 10:04:44,786 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/part-00003	dst=null	perm=null
2015-03-13 10:04:44,789 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/task_1426266260362_0001_m_000003/part-00003	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/part-00003	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:04:44,791 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle	dst=null	perm=null
2015-03-13 10:04:44,792 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle	dst=null	perm=null
2015-03-13 10:04:44,794 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/task_1426266260362_0001_m_000004	dst=null	perm=null
2015-03-13 10:04:44,796 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/part-00004	dst=null	perm=null
2015-03-13 10:04:44,798 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/task_1426266260362_0001_m_000004/part-00004	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/part-00004	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:04:44,804 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary	dst=null	perm=null
2015-03-13 10:04:44,810 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:04:44,813 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-1686244545_1
2015-03-13 10:04:44,815 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:04:44,817 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-1686244545_1
2015-03-13 10:04:44,828 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60803, dest: /127.0.0.1:60693, bytes: 52937, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1686244545_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741835_1011, duration: 534594000
2015-03-13 10:04:44,828 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741835_1011, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:04:44,829 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741835_1011{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:04:44,829 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60802, dest: /127.0.0.1:60689, bytes: 52937, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1686244545_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741835_1011, duration: 534680000
2015-03-13 10:04:44,829 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741835_1011, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:44,830 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741835_1011{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:04:44,830 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60801, dest: /127.0.0.1:60686, bytes: 52937, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1686244545_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741835_1011, duration: 536731000
2015-03-13 10:04:44,830 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741835_1011, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:44,831 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741835_1011{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:04:44,832 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job_1426266260362_0001_1.jhist is closed by DFSClient_NONMAPREDUCE_-1686244545_1
2015-03-13 10:04:44,834 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0001.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:04:44,837 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0001.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741838_1014{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:04:44,839 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741838_1014 src: /127.0.0.1:60816 dest: /127.0.0.1:60696
2015-03-13 10:04:44,840 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741838_1014 src: /127.0.0.1:60817 dest: /127.0.0.1:60686
2015-03-13 10:04:44,842 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741838_1014 src: /127.0.0.1:60818 dest: /127.0.0.1:60689
2015-03-13 10:04:44,846 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60818, dest: /127.0.0.1:60689, bytes: 440, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1686244545_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741838_1014, duration: 2892000
2015-03-13 10:04:44,847 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741838_1014, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:04:44,847 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741838_1014{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:04:44,847 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60817, dest: /127.0.0.1:60686, bytes: 440, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1686244545_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741838_1014, duration: 3114000
2015-03-13 10:04:44,848 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741838_1014, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:44,848 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741838_1014{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:04:44,849 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60816, dest: /127.0.0.1:60696, bytes: 440, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1686244545_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741838_1014, duration: 4746000
2015-03-13 10:04:44,849 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741838_1014, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:44,849 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741838_1014{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:04:44,851 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0001.summary_tmp is closed by DFSClient_NONMAPREDUCE_-1686244545_1
2015-03-13 10:04:44,855 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0001.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:04:44,860 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job_1426266260362_0001_1.jhist	dst=null	perm=null
2015-03-13 10:04:44,862 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0001-1426266268849-soberoi-%5B3CE1BF9BD7C747EDB1F8A6829F563276%2F1F14FA6CB9B54C3A-1426266284818-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:04:44,865 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job_1426266260362_0001_1.jhist	dst=null	perm=null
2015-03-13 10:04:44,866 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0001-1426266268849-soberoi-%5B3CE1BF9BD7C747EDB1F8A6829F563276%2F1F14FA6CB9B54C3A-1426266284818-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:04:44,867 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job_1426266260362_0001_1.jhist	dst=null	perm=null
2015-03-13 10:04:44,870 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0001-1426266268849-soberoi-%5B3CE1BF9BD7C747EDB1F8A6829F563276%2F1F14FA6CB9B54C3A-1426266284818-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:04:44,873 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:60819, bytes: 53353, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1686244545_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741835_1011, duration: 263000
2015-03-13 10:04:44,874 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0001-1426266268849-soberoi-%5B3CE1BF9BD7C747EDB1F8A6829F563276%2F1F14FA6CB9B54C3A-1426266284818-5-0-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741839_1015{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:04:44,876 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741839_1015 src: /127.0.0.1:60820 dest: /127.0.0.1:60693
2015-03-13 10:04:44,877 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741839_1015 src: /127.0.0.1:60821 dest: /127.0.0.1:60686
2015-03-13 10:04:44,879 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741839_1015 src: /127.0.0.1:60822 dest: /127.0.0.1:60696
2015-03-13 10:04:44,884 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60822, dest: /127.0.0.1:60696, bytes: 52937, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1686244545_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741839_1015, duration: 4117000
2015-03-13 10:04:44,884 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741839_1015, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:04:44,885 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741839_1015{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:04:44,885 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60821, dest: /127.0.0.1:60686, bytes: 52937, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1686244545_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741839_1015, duration: 4997000
2015-03-13 10:04:44,885 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741839_1015, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:44,886 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741839_1015{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:04:44,886 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60820, dest: /127.0.0.1:60693, bytes: 52937, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1686244545_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741839_1015, duration: 5841000
2015-03-13 10:04:44,886 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741839_1015, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:44,887 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741839_1015{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:04:44,889 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0001-1426266268849-soberoi-%5B3CE1BF9BD7C747EDB1F8A6829F563276%2F1F14FA6CB9B54C3A-1426266284818-5-0-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-1686244545_1
2015-03-13 10:04:44,891 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0001-1426266268849-soberoi-%5B3CE1BF9BD7C747EDB1F8A6829F563276%2F1F14FA6CB9B54C3A-1426266284818-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:04:44,893 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job_1426266260362_0001_1_conf.xml	dst=null	perm=null
2015-03-13 10:04:44,894 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0001_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:04:44,895 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job_1426266260362_0001_1_conf.xml	dst=null	perm=null
2015-03-13 10:04:44,897 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0001_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:04:44,898 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job_1426266260362_0001_1_conf.xml	dst=null	perm=null
2015-03-13 10:04:44,902 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0001_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:04:44,905 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:60823, bytes: 91154, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1686244545_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741833_1009, duration: 399000
2015-03-13 10:04:44,907 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0001_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741840_1016{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:04:44,909 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741840_1016 src: /127.0.0.1:60824 dest: /127.0.0.1:60693
2015-03-13 10:04:44,911 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741840_1016 src: /127.0.0.1:60825 dest: /127.0.0.1:60696
2015-03-13 10:04:44,912 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741840_1016 src: /127.0.0.1:60826 dest: /127.0.0.1:60686
2015-03-13 10:04:44,916 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60826, dest: /127.0.0.1:60686, bytes: 90446, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1686244545_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741840_1016, duration: 2159000
2015-03-13 10:04:44,916 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741840_1016, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:04:44,916 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741840_1016{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:04:44,917 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60825, dest: /127.0.0.1:60696, bytes: 90446, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1686244545_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741840_1016, duration: 2807000
2015-03-13 10:04:44,917 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741840_1016, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:44,917 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741840_1016{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:04:44,918 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60824, dest: /127.0.0.1:60693, bytes: 90446, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1686244545_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741840_1016, duration: 3746000
2015-03-13 10:04:44,918 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741840_1016, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:44,918 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741840_1016{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:04:44,920 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0001_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-1686244545_1
2015-03-13 10:04:44,921 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0001_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:04:44,924 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0001.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0001.summary	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:04:44,926 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0001_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0001_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:04:44,928 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0001-1426266268849-soberoi-%5B3CE1BF9BD7C747EDB1F8A6829F563276%2F1F14FA6CB9B54C3A-1426266284818-5-0-SUCCEEDED-default.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0001-1426266268849-soberoi-%5B3CE1BF9BD7C747EDB1F8A6829F563276%2F1F14FA6CB9B54C3A-1426266284818-5-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:04:44,938 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0001_000001 State change from RUNNING to FINISHING
2015-03-13 10:04:44,938 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0001
2015-03-13 10:04:44,939 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0001 State change from RUNNING to REMOVING
2015-03-13 10:04:44,939 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0001
2015-03-13 10:04:44,940 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0001 State change from REMOVING to FINISHING
2015-03-13 10:04:44,980 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:45,638 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:04:45,638 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0001_01_000002
2015-03-13 10:04:45,639 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0001_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:04:45,639 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0001_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:04:45,640 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0001	CONTAINERID=container_1426266260362_0001_01_000002
2015-03-13 10:04:45,640 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0001_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:04:45,640 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:04:45,640 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0001_01_000002, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:45,640 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:45,641 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:04:45,641 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0001_000001 released container container_1426266260362_0001_01_000002 on node: host: 10.1.1.144:60715 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:04:45,725 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:04:45,726 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0001_01_000006
2015-03-13 10:04:45,727 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0001_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:04:45,727 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0001_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:04:45,727 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0001	CONTAINERID=container_1426266260362_0001_01_000006
2015-03-13 10:04:45,727 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0001_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:04:45,727 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:04:45,727 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0001_01_000006, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:45,728 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:45,728 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:04:45,728 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0001_000001 released container container_1426266260362_0001_01_000006 on node: host: 10.1.1.144:60719 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:04:45,949 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741829_1005 127.0.0.1:60686 127.0.0.1:60693 127.0.0.1:60689 127.0.0.1:60696 
2015-03-13 10:04:45,950 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741830_1006 127.0.0.1:60693 127.0.0.1:60689 127.0.0.1:60696 127.0.0.1:60686 
2015-03-13 10:04:45,950 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741831_1007 127.0.0.1:60686 127.0.0.1:60693 127.0.0.1:60696 
2015-03-13 10:04:45,950 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741832_1008 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60693 
2015-03-13 10:04:45,950 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741835_1011 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60693 
2015-03-13 10:04:45,951 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741833_1009 127.0.0.1:60689 127.0.0.1:60696 127.0.0.1:60693 
2015-03-13 10:04:45,951 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001	dst=null	perm=null
2015-03-13 10:04:45,982 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:46,014 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle	dst=null	perm=null
2015-03-13 10:04:46,015 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary
2015-03-13 10:04:46,016 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary	dst=null	perm=null
2015-03-13 10:04:46,025 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:04:46,026 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:04:46,027 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:04:46,029 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle	dst=null	perm=null
2015-03-13 10:04:46,030 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle	dst=null	perm=null
2015-03-13 10:04:46,031 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle	dst=null	perm=null
2015-03-13 10:04:46,034 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:04:46,042 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/part-00000	dst=null	perm=null
2015-03-13 10:04:46,046 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:60828, bytes: 8, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741837_1013, duration: 196000
2015-03-13 10:04:46,047 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/part-00001	dst=null	perm=null
2015-03-13 10:04:46,049 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:60829, bytes: 8, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741836_1012, duration: 229000
2015-03-13 10:04:46,050 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/part-00002	dst=null	perm=null
2015-03-13 10:04:46,052 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/part-00003	dst=null	perm=null
2015-03-13 10:04:46,053 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:60828, bytes: 8, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741834_1010, duration: 205000
2015-03-13 10:04:46,054 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/part-00004	dst=null	perm=null
2015-03-13 10:04:46,064 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:04:46,064 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:04:46,065 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:04:46,068 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle	dst=null	perm=null
2015-03-13 10:04:46,069 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle	dst=null	perm=null
2015-03-13 10:04:46,070 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle	dst=null	perm=null
2015-03-13 10:04:46,073 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:04:46,074 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/part-00000	dst=null	perm=null
2015-03-13 10:04:46,077 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:60830, bytes: 8, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741837_1013, duration: 200000
2015-03-13 10:04:46,078 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/part-00001	dst=null	perm=null
2015-03-13 10:04:46,079 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:60830, bytes: 8, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741836_1012, duration: 158000
2015-03-13 10:04:46,080 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/part-00002	dst=null	perm=null
2015-03-13 10:04:46,081 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/part-00003	dst=null	perm=null
2015-03-13 10:04:46,083 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:60830, bytes: 8, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741834_1010, duration: 163000
2015-03-13 10:04:46,085 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/part-00004	dst=null	perm=null
2015-03-13 10:04:46,085 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/joininnersingle
2015-03-13 10:04:46,086 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle	dst=null	perm=null
2015-03-13 10:04:46,087 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle	dst=null	perm=null
2015-03-13 10:04:46,088 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle	dst=null	perm=null
2015-03-13 10:04:46,090 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle	dst=null	perm=null
2015-03-13 10:04:46,092 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/part-00000	dst=null	perm=null
2015-03-13 10:04:46,093 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/part-00000	dst=null	perm=null
2015-03-13 10:04:46,096 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60831, bytes: 8, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741837_1013, duration: 224000
2015-03-13 10:04:46,097 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/part-00001	dst=null	perm=null
2015-03-13 10:04:46,099 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/part-00001	dst=null	perm=null
2015-03-13 10:04:46,101 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:60829, bytes: 8, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741836_1012, duration: 223000
2015-03-13 10:04:46,102 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/part-00002	dst=null	perm=null
2015-03-13 10:04:46,103 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/part-00002	dst=null	perm=null
2015-03-13 10:04:46,104 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/part-00003	dst=null	perm=null
2015-03-13 10:04:46,106 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/part-00003	dst=null	perm=null
2015-03-13 10:04:46,108 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:60828, bytes: 8, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741834_1010, duration: 222000
2015-03-13 10:04:46,109 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/part-00004	dst=null	perm=null
2015-03-13 10:04:46,110 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/part-00004	dst=null	perm=null
2015-03-13 10:04:46,114 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:04:46,114 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:04:46,116 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:04:46,121 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt. BP-1005356445-10.1.1.144-1426266257849 blk_1073741841_1017{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:04:46,122 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017 src: /127.0.0.1:60832 dest: /127.0.0.1:60686
2015-03-13 10:04:46,123 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017 src: /127.0.0.1:60833 dest: /127.0.0.1:60689
2015-03-13 10:04:46,124 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017 src: /127.0.0.1:60834 dest: /127.0.0.1:60693
2015-03-13 10:04:46,127 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60834, dest: /127.0.0.1:60693, bytes: 19, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 1483000
2015-03-13 10:04:46,127 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:04:46,128 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741841_1017{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:04:46,128 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60833, dest: /127.0.0.1:60689, bytes: 19, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 2136000
2015-03-13 10:04:46,128 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:46,129 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741841_1017{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:04:46,129 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60832, dest: /127.0.0.1:60686, bytes: 19, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 2759000
2015-03-13 10:04:46,129 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:46,130 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741841_1017{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:04:46,131 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:04:46,132 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:04:46,151 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:04:46,155 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:04:46,155 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:04:46,198 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost	dst=null	perm=null
2015-03-13 10:04:46,199 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [upper1*upper2*lower] starting
2015-03-13 10:04:46,199 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [upper1*upper2*lower]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt"]
2015-03-13 10:04:46,199 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [upper1*upper2*lower]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-03-13 10:04:46,200 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [upper1*upper2*lower]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt"]
2015-03-13 10:04:46,200 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [upper1*upper2*lower]  sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost"]
2015-03-13 10:04:46,200 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [upper1*upper2*lower]  parallel execution is enabled: true
2015-03-13 10:04:46,200 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [upper1*upper2*lower]  starting jobs: 2
2015-03-13 10:04:46,200 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [upper1*upper2*lower]  allocating threads: 2
2015-03-13 10:04:46,201 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [upper1*upper2*lower] starting step: (2/2)
2015-03-13 10:04:46,216 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:04:46,226 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:04:46,228 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833	dst=null	perm=null
2015-03-13 10:04:46,229 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:04:46,230 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:04:46,233 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 2
2015-03-13 10:04:46,235 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002	dst=null	perm=null
2015-03-13 10:04:46,237 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002	dst=null	perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:04:46,238 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002	dst=null	perm=soberoi:supergroup:rwx------
2015-03-13 10:04:46,239 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.jar	dst=null	perm=null
2015-03-13 10:04:46,241 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:04:46,244 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073741842_1018{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:04:46,246 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741842_1018 src: /127.0.0.1:60836 dest: /127.0.0.1:60696
2015-03-13 10:04:46,247 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741842_1018 src: /127.0.0.1:60837 dest: /127.0.0.1:60693
2015-03-13 10:04:46,248 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741842_1018 src: /127.0.0.1:60838 dest: /127.0.0.1:60686
2015-03-13 10:04:46,252 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60838, dest: /127.0.0.1:60686, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741842_1018, duration: 2909000
2015-03-13 10:04:46,253 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741842_1018, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:04:46,253 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741842_1018{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:04:46,253 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60837, dest: /127.0.0.1:60693, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741842_1018, duration: 3215000
2015-03-13 10:04:46,254 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741842_1018, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:46,254 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741842_1018{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:04:46,255 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60836, dest: /127.0.0.1:60696, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741842_1018, duration: 4548000
2015-03-13 10:04:46,255 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741842_1018, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:46,257 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741842_1018{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:04:46,258 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:04:46,259 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.jar
2015-03-13 10:04:46,260 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.jar	dst=null	perm=null
2015-03-13 10:04:46,261 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:04:46,263 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:04:46,264 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:04:46,265 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:04:46,266 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:04:46,267 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:04:46,267 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:04:46,268 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:04:46,269 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:04:46,270 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:04:46,272 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:04:46,272 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:04:46,274 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:04:46,276 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:04:46,278 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:04:46,278 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.split
2015-03-13 10:04:46,279 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.split	dst=null	perm=null
2015-03-13 10:04:46,280 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073741843_1019{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:04:46,281 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741843_1019 src: /127.0.0.1:60839 dest: /127.0.0.1:60686
2015-03-13 10:04:46,283 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741843_1019 src: /127.0.0.1:60840 dest: /127.0.0.1:60693
2015-03-13 10:04:46,284 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741843_1019 src: /127.0.0.1:60841 dest: /127.0.0.1:60689
2015-03-13 10:04:46,286 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741843_1019 src: /127.0.0.1:60842 dest: /127.0.0.1:60696
2015-03-13 10:04:46,289 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60842, dest: /127.0.0.1:60696, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741843_1019, duration: 2269000
2015-03-13 10:04:46,290 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741843_1019, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:04:46,290 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741843_1019{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:04:46,290 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60841, dest: /127.0.0.1:60689, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741843_1019, duration: 3135000
2015-03-13 10:04:46,291 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741843_1019, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:46,291 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741843_1019{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:04:46,291 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60840, dest: /127.0.0.1:60693, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741843_1019, duration: 3957000
2015-03-13 10:04:46,292 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741843_1019, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:46,292 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741843_1019{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:04:46,292 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60839, dest: /127.0.0.1:60686, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741843_1019, duration: 4991000
2015-03-13 10:04:46,293 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741843_1019, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:46,293 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741843_1019{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:04:46,295 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:04:46,297 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:04:46,299 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:04:46,301 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073741844_1020{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:04:46,303 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741844_1020 src: /127.0.0.1:60843 dest: /127.0.0.1:60686
2015-03-13 10:04:46,305 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741844_1020 src: /127.0.0.1:60844 dest: /127.0.0.1:60696
2015-03-13 10:04:46,306 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741844_1020 src: /127.0.0.1:60845 dest: /127.0.0.1:60689
2015-03-13 10:04:46,310 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60845, dest: /127.0.0.1:60689, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741844_1020, duration: 1902000
2015-03-13 10:04:46,310 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741844_1020, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:04:46,310 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741844_1020{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:04:46,311 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60844, dest: /127.0.0.1:60696, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741844_1020, duration: 2403000
2015-03-13 10:04:46,311 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741844_1020, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:46,311 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741844_1020{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:04:46,311 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60843, dest: /127.0.0.1:60686, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741844_1020, duration: 3638000
2015-03-13 10:04:46,312 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741844_1020, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:46,313 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741844_1020{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:04:46,314 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:04:46,315 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:04:46,316 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:04:46,318 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:04:46,319 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:04:46,320 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:04:46,320 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:04:46,331 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073741845_1021{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:04:46,333 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741845_1021 src: /127.0.0.1:60846 dest: /127.0.0.1:60689
2015-03-13 10:04:46,334 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741845_1021 src: /127.0.0.1:60847 dest: /127.0.0.1:60686
2015-03-13 10:04:46,335 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741845_1021 src: /127.0.0.1:60848 dest: /127.0.0.1:60696
2015-03-13 10:04:46,339 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60848, dest: /127.0.0.1:60696, bytes: 96467, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741845_1021, duration: 2077000
2015-03-13 10:04:46,339 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741845_1021, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:04:46,340 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741845_1021{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:04:46,340 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60847, dest: /127.0.0.1:60686, bytes: 96467, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741845_1021, duration: 2930000
2015-03-13 10:04:46,340 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741845_1021, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:46,341 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741845_1021{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:04:46,341 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60846, dest: /127.0.0.1:60689, bytes: 96467, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741845_1021, duration: 4120000
2015-03-13 10:04:46,341 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741845_1021, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:46,344 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741845_1021{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:04:46,345 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:04:46,346 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0002
2015-03-13 10:04:46,348 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002	dst=null	perm=null
2015-03-13 10:04:46,350 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.xml	dst=null	perm=null
2015-03-13 10:04:46,351 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.xml	dst=null	perm=null
2015-03-13 10:04:46,353 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.jar	dst=null	perm=null
2015-03-13 10:04:46,354 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.jar	dst=null	perm=null
2015-03-13 10:04:46,355 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.split	dst=null	perm=null
2015-03-13 10:04:46,356 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.split	dst=null	perm=null
2015-03-13 10:04:46,358 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:04:46,359 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:04:46,361 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:04:46,362 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:04:46,364 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:04:46,364 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:04:46,366 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:04:46,367 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:04:46,369 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 2 submitted by user soberoi
2015-03-13 10:04:46,369 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0002
2015-03-13 10:04:46,369 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0002 State change from NEW to NEW_SAVING
2015-03-13 10:04:46,369 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0002
2015-03-13 10:04:46,369 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	IP=10.1.1.144	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1426266260362_0002
2015-03-13 10:04:46,370 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0002 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:04:46,370 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0002_000001
2015-03-13 10:04:46,371 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0002_000001 State change from NEW to SUBMITTED
2015-03-13 10:04:46,371 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0002 from user: soberoi activated in queue: default
2015-03-13 10:04:46,371 INFO  capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0002 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:04:46,372 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0002 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:04:46,372 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0002_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:04:46,372 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0002 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:04:46,372 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0002_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:04:46,373 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0002 State change from SUBMITTED to ACCEPTED
2015-03-13 10:04:46,375 INFO  mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0002/
2015-03-13 10:04:46,375 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [upper1*upper2*lower] submitted hadoop job: job_1426266260362_0002
2015-03-13 10:04:46,376 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [upper1*upper2*lower] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0002/
2015-03-13 10:04:46,641 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0002_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:04:46,641 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0002	CONTAINERID=container_1426266260362_0002_01_000001
2015-03-13 10:04:46,642 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0002_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:04:46,642 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0002 container=Container: [ContainerId: container_1426266260362_0002_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0002_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:46,642 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:04:46,643 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0002_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:04:46,643 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:46,644 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0002 AttemptId: appattempt_1426266260362_0002_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0002_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ]
2015-03-13 10:04:46,644 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0002_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:04:46,644 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0002_000001
2015-03-13 10:04:46,644 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0002_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:04:46,645 INFO  amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0002_000001
2015-03-13 10:04:46,646 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0002_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] for AM appattempt_1426266260362_0002_000001
2015-03-13 10:04:46,646 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0002_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-03-13 10:04:46,649 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0002_000001 (auth:SIMPLE)
2015-03-13 10:04:46,653 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0002_01_000001 by user soberoi
2015-03-13 10:04:46,653 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0002
2015-03-13 10:04:46,653 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0002	CONTAINERID=container_1426266260362_0002_01_000001
2015-03-13 10:04:46,653 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0002 transitioned from NEW to INITING
2015-03-13 10:04:46,654 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0002_01_000001 to application application_1426266260362_0002
2015-03-13 10:04:46,654 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0002 transitioned from INITING to RUNNING
2015-03-13 10:04:46,654 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0002_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] for AM appattempt_1426266260362_0002_000001
2015-03-13 10:04:46,654 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0002_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:04:46,654 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:04:46,654 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0002
2015-03-13 10:04:46,655 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:04:46,655 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:04:46,655 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:04:46,655 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:04:46,655 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0002_01_000001
2015-03-13 10:04:46,665 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0002_01_000001.tokens. Credentials list: 
2015-03-13 10:04:46,680 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:04:46,753 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0002_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000001.tokens
2015-03-13 10:04:46,753 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0002 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0002
2015-03-13 10:04:46,839 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.jar	dst=null	perm=null
2015-03-13 10:04:46,841 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.jar	dst=null	perm=null
2015-03-13 10:04:46,842 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.jar	dst=null	perm=null
2015-03-13 10:04:46,848 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:60829, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1568517157_1451, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741842_1018, duration: 606000
2015-03-13 10:04:46,866 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:04:46,883 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:04:46,884 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:04:46,885 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:04:46,891 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60831, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1568517157_1451, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741844_1020, duration: 202000
2015-03-13 10:04:46,904 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:04:46,920 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.split	dst=null	perm=null
2015-03-13 10:04:46,921 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.split	dst=null	perm=null
2015-03-13 10:04:46,922 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.split	dst=null	perm=null
2015-03-13 10:04:46,928 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60831, bytes: 1798, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1568517157_1451, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741843_1019, duration: 228000
2015-03-13 10:04:46,941 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:04:46,958 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.xml	dst=null	perm=null
2015-03-13 10:04:46,960 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.xml	dst=null	perm=null
2015-03-13 10:04:46,961 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.xml	dst=null	perm=null
2015-03-13 10:04:46,967 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60831, bytes: 97223, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1568517157_1451, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741845_1021, duration: 398000
2015-03-13 10:04:46,981 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:04:46,981 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:04:46,987 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:47,009 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:04:47,009 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:04:47,077 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000001/default_container_executor.sh]
2015-03-13 10:04:47,642 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:47,642 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0002_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:04:47,988 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:48,638 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60686 to replicate blk_1073741842_1018 to datanode(s) 127.0.0.1:60689
2015-03-13 10:04:48,638 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073741829_1005, blk_1073741830_1006, blk_1073741831_1007, blk_1073741832_1008, blk_1073741833_1009]
2015-03-13 10:04:48,638 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073741829_1005, blk_1073741830_1006, blk_1073741831_1007, blk_1073741832_1008, blk_1073741833_1009, blk_1073741835_1011]
2015-03-13 10:04:48,644 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:48,670 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:04:48,691 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/COMMIT_STARTED	dst=null	perm=null
2015-03-13 10:04:48,693 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/COMMIT_SUCCESS	dst=null	perm=null
2015-03-13 10:04:48,694 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/COMMIT_FAIL	dst=null	perm=null
2015-03-13 10:04:48,743 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002	dst=null	perm=null
2015-03-13 10:04:48,745 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:04:48,747 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:04:48,993 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:49,018 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:04:49,026 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:04:49,085 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:60853, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1214526405_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741844_1020, duration: 166000
2015-03-13 10:04:49,253 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017
2015-03-13 10:04:49,254 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741840_1016
2015-03-13 10:04:49,255 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741842_1018
2015-03-13 10:04:49,256 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741837_1013
2015-03-13 10:04:49,256 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741844_1020
2015-03-13 10:04:49,257 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741835_1011
2015-03-13 10:04:49,258 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741839_1015
2015-03-13 10:04:49,258 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741838_1014
2015-03-13 10:04:49,259 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741845_1021
2015-03-13 10:04:49,259 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741843_1019
2015-03-13 10:04:49,275 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741835_1011
2015-03-13 10:04:49,276 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741834_1010
2015-03-13 10:04:49,276 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017
2015-03-13 10:04:49,277 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741845_1021
2015-03-13 10:04:49,278 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741836_1012
2015-03-13 10:04:49,278 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741838_1014
2015-03-13 10:04:49,278 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741837_1013
2015-03-13 10:04:49,279 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741844_1020
2015-03-13 10:04:49,279 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741843_1019
2015-03-13 10:04:49,306 INFO  datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-1907321454-10.1.1.144-60686-1426266259166, infoPort=60687, ipcPort=60688, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073741842_1018 to 127.0.0.1:60689 
2015-03-13 10:04:49,319 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741842_1018 src: /127.0.0.1:60856 dest: /127.0.0.1:60689
2015-03-13 10:04:49,321 INFO  datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073741842_1018 src: /127.0.0.1:60856 dest: /127.0.0.1:60689 of size 254067
2015-03-13 10:04:49,319 INFO  datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073741842_1018 (numBytes=254067) to /127.0.0.1:60689
2015-03-13 10:04:49,324 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741842_1018 size 254067
2015-03-13 10:04:49,472 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017
2015-03-13 10:04:49,473 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741835_1011
2015-03-13 10:04:49,473 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741839_1015
2015-03-13 10:04:49,474 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741829_1005 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741829 for deletion
2015-03-13 10:04:49,474 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741837_1013
2015-03-13 10:04:49,474 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741843_1019
2015-03-13 10:04:49,474 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741836_1012
2015-03-13 10:04:49,475 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741830_1006 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741830 for deletion
2015-03-13 10:04:49,475 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741829_1005 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741829
2015-03-13 10:04:49,475 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741831_1007 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741831 for deletion
2015-03-13 10:04:49,475 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741832_1008 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741832 for deletion
2015-03-13 10:04:49,476 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741833_1009 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741833 for deletion
2015-03-13 10:04:49,476 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741835_1011 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741835 for deletion
2015-03-13 10:04:49,476 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741831_1007 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741831
2015-03-13 10:04:49,476 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741830_1006 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741830
2015-03-13 10:04:49,476 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741833_1009 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741833
2015-03-13 10:04:49,476 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741832_1008 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741832
2015-03-13 10:04:49,477 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741842_1018
2015-03-13 10:04:49,477 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741835_1011 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741835
2015-03-13 10:04:49,478 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741840_1016
2015-03-13 10:04:49,649 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:49,651 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741839_1015
2015-03-13 10:04:49,652 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741838_1014
2015-03-13 10:04:49,652 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741844_1020
2015-03-13 10:04:49,653 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741829_1005 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741829 for deletion
2015-03-13 10:04:49,653 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741830_1006 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741830 for deletion
2015-03-13 10:04:49,654 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741829_1005 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741829
2015-03-13 10:04:49,654 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741831_1007 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741831 for deletion
2015-03-13 10:04:49,654 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741832_1008 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741832 for deletion
2015-03-13 10:04:49,654 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741833_1009 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741833 for deletion
2015-03-13 10:04:49,654 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741830_1006 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741830
2015-03-13 10:04:49,654 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741842_1018
2015-03-13 10:04:49,654 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741831_1007 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741831
2015-03-13 10:04:49,655 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741832_1008 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741832
2015-03-13 10:04:49,655 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741843_1019
2015-03-13 10:04:49,655 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741833_1009 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741833
2015-03-13 10:04:49,656 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741845_1021
2015-03-13 10:04:49,657 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741840_1016
2015-03-13 10:04:49,916 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0002_000001 (auth:SIMPLE)
2015-03-13 10:04:49,918 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0002_000001
2015-03-13 10:04:49,919 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi	IP=10.1.1.144	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1426266260362_0002	APPATTEMPTID=appattempt_1426266260362_0002_000001
2015-03-13 10:04:49,919 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0002_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:04:49,919 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0002 State change from ACCEPTED to RUNNING
2015-03-13 10:04:49,939 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job_1426266260362_0002_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:04:49,941 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:04:49,997 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job_1426266260362_0002_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:04:49,997 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:50,121 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job_1426266260362_0002_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073741846_1022{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:04:50,162 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741846_1022 src: /127.0.0.1:60860 dest: /127.0.0.1:60696
2015-03-13 10:04:50,163 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741846_1022 src: /127.0.0.1:60861 dest: /127.0.0.1:60689
2015-03-13 10:04:50,164 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741846_1022 src: /127.0.0.1:60862 dest: /127.0.0.1:60693
2015-03-13 10:04:50,174 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60862, dest: /127.0.0.1:60693, bytes: 89372, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1214526405_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741846_1022, duration: 7731000
2015-03-13 10:04:50,174 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741846_1022, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:04:50,174 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741846_1022{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:04:50,175 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60861, dest: /127.0.0.1:60689, bytes: 89372, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1214526405_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741846_1022, duration: 8679000
2015-03-13 10:04:50,175 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741846_1022, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:50,175 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60860, dest: /127.0.0.1:60696, bytes: 89372, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1214526405_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741846_1022, duration: 9443000
2015-03-13 10:04:50,175 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741846_1022{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:04:50,176 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741846_1022, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:50,176 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741846_1022{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:04:50,180 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job_1426266260362_0002_1_conf.xml is closed by DFSClient_NONMAPREDUCE_1214526405_1
2015-03-13 10:04:50,654 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:50,998 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:51,000 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0002_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:04:51,000 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0002	CONTAINERID=container_1426266260362_0002_01_000002
2015-03-13 10:04:51,000 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0002_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:04:51,001 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0002 container=Container: [ContainerId: container_1426266260362_0002_01_000002, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0002_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:51,001 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:04:51,001 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:51,002 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0002_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:04:51,003 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0002	CONTAINERID=container_1426266260362_0002_01_000003
2015-03-13 10:04:51,003 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0002_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available
2015-03-13 10:04:51,003 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0002 container=Container: [ContainerId: container_1426266260362_0002_01_000003, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0002_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:51,003 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:04:51,003 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:51,084 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0001_01_000001 succeeded 
2015-03-13 10:04:51,084 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:04:51,084 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0001_01_000001
2015-03-13 10:04:51,093 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000001
2015-03-13 10:04:51,093 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000001
2015-03-13 10:04:51,094 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000001
2015-03-13 10:04:51,094 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000001
2015-03-13 10:04:51,094 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0001	CONTAINERID=container_1426266260362_0001_01_000001
2015-03-13 10:04:51,094 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:04:51,094 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0001_01_000001 from application application_1426266260362_0001
2015-03-13 10:04:51,094 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:04:51,094 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0001
2015-03-13 10:04:51,164 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0002_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:04:51,164 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0002	CONTAINERID=container_1426266260362_0002_01_000004
2015-03-13 10:04:51,165 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0002_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:04:51,165 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0002 container=Container: [ContainerId: container_1426266260362_0002_01_000004, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0002_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:51,165 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:04:51,165 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:51,166 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0002_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:04:51,166 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0002	CONTAINERID=container_1426266260362_0002_01_000005
2015-03-13 10:04:51,166 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0002_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:04:51,167 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0002 container=Container: [ContainerId: container_1426266260362_0002_01_000005, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0002_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:51,167 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:04:51,167 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:51,168 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0002_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:04:51,168 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0002	CONTAINERID=container_1426266260362_0002_01_000006
2015-03-13 10:04:51,168 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0002_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:04:51,168 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0002 container=Container: [ContainerId: container_1426266260362_0002_01_000006, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0002_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:51,168 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7
2015-03-13 10:04:51,168 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:51,640 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073741829_1005, blk_1073741830_1006, blk_1073741833_1009, blk_1073741835_1011]
2015-03-13 10:04:51,641 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073741829_1005, blk_1073741830_1006, blk_1073741831_1007, blk_1073741832_1008, blk_1073741835_1011]
2015-03-13 10:04:51,660 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:51,951 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0002_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:04:51,952 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0002_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:04:51,954 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0002_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:04:51,954 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0002_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:04:51,954 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0002_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:04:51,979 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.jar	dst=null	perm=null
2015-03-13 10:04:51,980 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.jar	dst=null	perm=null
2015-03-13 10:04:51,989 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.xml	dst=null	perm=null
2015-03-13 10:04:51,990 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.xml	dst=null	perm=null
2015-03-13 10:04:51,993 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:04:51,994 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:04:51,999 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:04:52,001 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:04:52,002 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:04:52,002 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0001_01_000001
2015-03-13 10:04:52,003 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:04:52,003 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0001_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:04:52,004 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0001_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:04:52,004 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0001	CONTAINERID=container_1426266260362_0001_01_000001
2015-03-13 10:04:52,004 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0001_000001
2015-03-13 10:04:52,005 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0001_000001 State change from FINISHING to FINISHED
2015-03-13 10:04:52,006 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0001 State change from FINISHING to FINISHED
2015-03-13 10:04:52,004 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0001_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60723, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:04:52,007 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:7168, vCores:6> numContainers=6 user=soberoi user-resources=<memory:7168, vCores:6>
2015-03-13 10:04:52,007 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0001_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:52,007 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:52,007 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6
2015-03-13 10:04:52,007 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0001_000001 released container container_1426266260362_0001_01_000001 on node: host: 10.1.1.144:60723 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:04:52,008 INFO  capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0001_000001 is done. finalState=FINISHED
2015-03-13 10:04:52,008 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:04:52,008 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0001 requests cleared
2015-03-13 10:04:52,010 INFO  capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0001 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:04:52,010 INFO  capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0001 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:04:52,009 INFO  amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0001_000001
2015-03-13 10:04:52,009 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1426266260362_0001
2015-03-13 10:04:52,013 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0001,name=[3CE1BF9BD7C747EDB1F8A6829F563276/1F14FA6CB9B54C3AB9069C6E50F98834] lower*upper/(1/1) ...splatform/joininnersingle,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0001/jobhistory/job/job_1426266260362_0001,appMasterHost=Edinburgh.local,startTime=1426266268868,finishTime=1426266284940,finalStatus=SUCCEEDED
2015-03-13 10:04:52,018 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0001_000001 (auth:SIMPLE)
2015-03-13 10:04:52,021 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0001_01_000001
2015-03-13 10:04:52,104 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0002_000001 (auth:SIMPLE)
2015-03-13 10:04:52,104 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0002_000001 (auth:SIMPLE)
2015-03-13 10:04:52,107 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0002_01_000002 by user soberoi
2015-03-13 10:04:52,108 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0002_01_000005 by user soberoi
2015-03-13 10:04:52,108 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0002
2015-03-13 10:04:52,109 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0002_01_000004 by user soberoi
2015-03-13 10:04:52,109 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0002
2015-03-13 10:04:52,109 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0002 transitioned from NEW to INITING
2015-03-13 10:04:52,109 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0002	CONTAINERID=container_1426266260362_0002_01_000005
2015-03-13 10:04:52,110 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0002_01_000004 to application application_1426266260362_0002
2015-03-13 10:04:52,108 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0002_01_000003 by user soberoi
2015-03-13 10:04:52,110 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0002 transitioned from NEW to INITING
2015-03-13 10:04:52,111 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0002	CONTAINERID=container_1426266260362_0002_01_000003
2015-03-13 10:04:52,109 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0002_01_000002 to application application_1426266260362_0002
2015-03-13 10:04:52,111 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0002_01_000003 to application application_1426266260362_0002
2015-03-13 10:04:52,109 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0002	CONTAINERID=container_1426266260362_0002_01_000004
2015-03-13 10:04:52,112 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0002 transitioned from INITING to RUNNING
2015-03-13 10:04:52,112 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:04:52,109 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0002	CONTAINERID=container_1426266260362_0002_01_000002
2015-03-13 10:04:52,108 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0002_01_000006 by user soberoi
2015-03-13 10:04:52,113 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:04:52,116 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0002
2015-03-13 10:04:52,116 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0002
2015-03-13 10:04:52,116 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:04:52,116 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0002
2015-03-13 10:04:52,116 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:04:52,117 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:04:52,117 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0002
2015-03-13 10:04:52,117 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0002
2015-03-13 10:04:52,117 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:04:52,117 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0002
2015-03-13 10:04:52,111 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0002_01_000005 to application application_1426266260362_0002
2015-03-13 10:04:52,118 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0002_01_000002
2015-03-13 10:04:52,118 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0002_01_000006 to application application_1426266260362_0002
2015-03-13 10:04:52,115 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0002	CONTAINERID=container_1426266260362_0002_01_000006
2015-03-13 10:04:52,119 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0002 transitioned from INITING to RUNNING
2015-03-13 10:04:52,119 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0002_01_000003
2015-03-13 10:04:52,120 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:04:52,120 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:04:52,120 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:04:52,120 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0002
2015-03-13 10:04:52,120 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0002
2015-03-13 10:04:52,121 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:04:52,121 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0002
2015-03-13 10:04:52,121 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:04:52,121 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:04:52,121 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:04:52,121 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:04:52,122 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0002
2015-03-13 10:04:52,122 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0002
2015-03-13 10:04:52,122 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:04:52,122 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0002
2015-03-13 10:04:52,122 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0002
2015-03-13 10:04:52,122 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0002
2015-03-13 10:04:52,122 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:04:52,123 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0002
2015-03-13 10:04:52,123 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0002_01_000005
2015-03-13 10:04:52,123 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar, 1426266260077, FILE, null }
2015-03-13 10:04:52,127 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar, 1426266259962, FILE, null }
2015-03-13 10:04:52,127 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0002_01_000004
2015-03-13 10:04:52,128 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar, 1426266260077, FILE, null }
2015-03-13 10:04:52,128 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar, 1426266259962, FILE, null }
2015-03-13 10:04:52,128 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0002_01_000006
2015-03-13 10:04:52,128 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar, 1426266260077, FILE, null }
2015-03-13 10:04:52,128 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar, 1426266259962, FILE, null }
2015-03-13 10:04:52,139 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426266260362_0002_01_000002.tokens. Credentials list: 
2015-03-13 10:04:52,142 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426266260362_0002_01_000003.tokens. Credentials list: 
2015-03-13 10:04:52,148 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0002_01_000005.tokens. Credentials list: 
2015-03-13 10:04:52,150 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0002_01_000004.tokens. Credentials list: 
2015-03-13 10:04:52,151 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1426266260362_0002_01_000006.tokens. Credentials list: 
2015-03-13 10:04:52,164 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:52,164 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:52,164 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:52,165 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0002_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:04:52,165 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0002_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:04:52,165 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0002_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:04:52,168 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:04:52,168 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:04:52,169 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:04:52,169 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:04:52,170 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:04:52,170 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:04:52,171 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:04:52,171 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:04:52,171 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:04:52,172 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:04:52,172 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:04:52,172 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:04:52,173 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:04:52,173 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:04:52,174 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:04:52,175 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:04:52,176 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:04:52,176 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:04:52,179 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:04:52,179 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:04:52,188 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:60866, bytes: 408281, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741826_1002, duration: 1093000
2015-03-13 10:04:52,189 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:60867, bytes: 485810, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741825_1001, duration: 1249000
2015-03-13 10:04:52,215 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:04:52,219 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:04:52,277 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426266260362_0002_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000002.tokens
2015-03-13 10:04:52,277 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0002_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000005.tokens
2015-03-13 10:04:52,278 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0002 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0002
2015-03-13 10:04:52,280 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0002 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0002
2015-03-13 10:04:52,307 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741829_1005 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741829 for deletion
2015-03-13 10:04:52,307 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741829_1005 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741829 for deletion
2015-03-13 10:04:52,308 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741830_1006 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741830 for deletion
2015-03-13 10:04:52,308 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741830_1006 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741830 for deletion
2015-03-13 10:04:52,308 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741833_1009 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741833 for deletion
2015-03-13 10:04:52,308 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741835_1011 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741835 for deletion
2015-03-13 10:04:52,308 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741829_1005 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741829
2015-03-13 10:04:52,308 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741829_1005 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741829
2015-03-13 10:04:52,308 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741831_1007 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741831 for deletion
2015-03-13 10:04:52,308 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741830_1006 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741830
2015-03-13 10:04:52,309 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741833_1009 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741833
2015-03-13 10:04:52,309 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741831_1007 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741831
2015-03-13 10:04:52,308 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741830_1006 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741830
2015-03-13 10:04:52,309 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741832_1008 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741832 for deletion
2015-03-13 10:04:52,309 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741835_1011 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741835 for deletion
2015-03-13 10:04:52,309 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741835_1011 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741835
2015-03-13 10:04:52,309 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741832_1008 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741832
2015-03-13 10:04:52,309 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741835_1011 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741835
2015-03-13 10:04:52,357 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.jar	dst=null	perm=null
2015-03-13 10:04:52,358 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.jar	dst=null	perm=null
2015-03-13 10:04:52,359 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.jar	dst=null	perm=null
2015-03-13 10:04:52,368 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60871, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1263266516_1627, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741842_1018, duration: 478000
2015-03-13 10:04:52,371 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.jar	dst=null	perm=null
2015-03-13 10:04:52,372 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.jar	dst=null	perm=null
2015-03-13 10:04:52,373 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.jar	dst=null	perm=null
2015-03-13 10:04:52,381 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:60867, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-245692817_1632, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741842_1018, duration: 627000
2015-03-13 10:04:52,400 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:04:52,416 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:04:52,428 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.xml	dst=null	perm=null
2015-03-13 10:04:52,430 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.xml	dst=null	perm=null
2015-03-13 10:04:52,431 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.xml	dst=null	perm=null
2015-03-13 10:04:52,437 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.xml	dst=null	perm=null
2015-03-13 10:04:52,438 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:60866, bytes: 97223, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1263266516_1627, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741845_1021, duration: 313000
2015-03-13 10:04:52,438 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.xml	dst=null	perm=null
2015-03-13 10:04:52,440 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.xml	dst=null	perm=null
2015-03-13 10:04:52,448 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60871, bytes: 97223, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-245692817_1632, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741845_1021, duration: 389000
2015-03-13 10:04:52,454 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:04:52,454 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:04:52,454 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:04:52,469 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:04:52,469 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:04:52,470 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:04:52,470 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:04:52,513 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:04:52,513 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:04:52,514 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:04:52,514 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:04:52,521 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:04:52,521 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:04:52,522 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:04:52,522 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:04:52,523 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:04:52,523 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:04:52,663 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:52,666 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0001 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:04:52,666 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0001
2015-03-13 10:04:52,667 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0001
2015-03-13 10:04:52,667 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0001
2015-03-13 10:04:52,667 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0001
2015-03-13 10:04:52,667 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0001
2015-03-13 10:04:52,668 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0001 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:04:52,669 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0001, with delay of 10800 seconds
2015-03-13 10:04:52,676 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000002/default_container_executor.sh]
2015-03-13 10:04:52,680 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000005/default_container_executor.sh]
2015-03-13 10:04:52,689 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000003/default_container_executor.sh]
2015-03-13 10:04:52,690 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000006/default_container_executor.sh]
2015-03-13 10:04:52,693 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000004/default_container_executor.sh]
2015-03-13 10:04:52,741 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0001 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:04:52,742 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0001
2015-03-13 10:04:52,742 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0001
2015-03-13 10:04:52,742 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0001
2015-03-13 10:04:52,743 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0001
2015-03-13 10:04:52,742 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0001
2015-03-13 10:04:52,743 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0001 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:04:52,743 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0001, with delay of 10800 seconds
2015-03-13 10:04:52,967 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:04:53,004 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:53,004 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:53,004 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0001 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:04:53,005 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0002_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:04:53,005 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0002_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:04:53,005 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0001
2015-03-13 10:04:53,005 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0001
2015-03-13 10:04:53,005 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0001 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:04:53,005 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0001, with delay of 10800 seconds
2015-03-13 10:04:53,005 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0001
2015-03-13 10:04:53,005 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0001
2015-03-13 10:04:53,006 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0001
2015-03-13 10:04:53,169 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:53,169 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:53,169 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:53,489 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:04:53,501 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:04:53,612 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426266260362_0002_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000003.tokens
2015-03-13 10:04:53,612 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0002 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0002
2015-03-13 10:04:53,627 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1426266260362_0002_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000006.tokens
2015-03-13 10:04:53,628 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0002 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0002
2015-03-13 10:04:53,667 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:53,737 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:04:53,876 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0002_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000004.tokens
2015-03-13 10:04:53,876 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0002 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0002
2015-03-13 10:04:54,010 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:54,010 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:54,174 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:54,175 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:54,175 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:54,284 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741846_1022
2015-03-13 10:04:54,286 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741842_1018
2015-03-13 10:04:54,484 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741846_1022
2015-03-13 10:04:54,661 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741846_1022
2015-03-13 10:04:54,669 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:55,014 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:55,014 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:55,179 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:55,179 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:55,179 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:55,670 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:56,016 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:56,016 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:56,182 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:56,183 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:56,183 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:56,675 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:56,699 INFO  hs.JobHistory (JobHistory.java:run(188)) - History Cleaner started
2015-03-13 10:04:56,701 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-yarn/staging/history/done	dst=null	perm=null
2015-03-13 10:04:56,701 INFO  hs.JobHistory (JobHistory.java:run(194)) - History Cleaner complete
2015-03-13 10:04:57,020 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:57,020 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:57,187 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:57,188 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:57,188 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:57,678 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:58,022 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:58,023 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:58,192 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:58,192 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:58,193 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:58,682 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:59,025 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:59,026 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:59,193 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:59,194 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:59,194 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:59,687 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:00,031 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:00,032 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:00,199 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:00,199 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:00,200 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:00,616 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.split	dst=null	perm=null
2015-03-13 10:05:00,692 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:00,721 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.split	dst=null	perm=null
2015-03-13 10:05:00,730 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.split	dst=null	perm=null
2015-03-13 10:05:00,793 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60885, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0002_m_000003_0_24478672_1, offset: 1024, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741843_1019, duration: 223000
2015-03-13 10:05:00,906 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:60886, bytes: 1282, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0002_m_000002_0_1248534415_1, offset: 512, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741843_1019, duration: 208000
2015-03-13 10:05:00,939 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:60887, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0002_m_000004_0_-820717384_1, offset: 1024, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741843_1019, duration: 205000
2015-03-13 10:05:00,965 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.split	dst=null	perm=null
2015-03-13 10:05:00,983 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:05:00,987 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60885, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0002_m_000003_0_24478672_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 184000
2015-03-13 10:05:00,989 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.split	dst=null	perm=null
2015-03-13 10:05:01,030 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/_temporary/attempt_1426266260362_0002_m_000003_0/part-00003	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:01,032 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:01,033 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:01,057 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:05:01,066 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:05:01,068 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60891, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0002_m_000002_0_1248534415_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 196000
2015-03-13 10:05:01,079 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60892, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0002_m_000004_0_-820717384_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 204000
2015-03-13 10:05:01,104 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:60890, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0002_m_000001_0_-2010036668_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741843_1019, duration: 218000
2015-03-13 10:05:01,124 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/_temporary/attempt_1426266260362_0002_m_000002_0/part-00002	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:01,126 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/_temporary/attempt_1426266260362_0002_m_000004_0/part-00004	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:01,146 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:60893, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0002_m_000000_0_-505175701_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741843_1019, duration: 216000
2015-03-13 10:05:01,202 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:01,203 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:01,203 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:01,248 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:05:01,253 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:60894, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0002_m_000001_0_-2010036668_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 216000
2015-03-13 10:05:01,298 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:05:01,334 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/_temporary/attempt_1426266260362_0002_m_000001_0/part-00001	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:01,339 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/_temporary/attempt_1426266260362_0002_m_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:01,388 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/_temporary/attempt_1426266260362_0002_m_000003_0/part-00003. BP-1005356445-10.1.1.144-1426266257849 blk_1073741847_1023{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:05:01,432 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741847_1023 src: /127.0.0.1:60895 dest: /127.0.0.1:60696
2015-03-13 10:05:01,437 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741847_1023 src: /127.0.0.1:60896 dest: /127.0.0.1:60693
2015-03-13 10:05:01,439 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741847_1023 src: /127.0.0.1:60897 dest: /127.0.0.1:60689
2015-03-13 10:05:01,460 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60897, dest: /127.0.0.1:60689, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0002_m_000003_0_24478672_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741847_1023, duration: 18804000
2015-03-13 10:05:01,460 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741847_1023, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:01,462 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741847_1023{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:01,462 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60896, dest: /127.0.0.1:60693, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0002_m_000003_0_24478672_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741847_1023, duration: 19637000
2015-03-13 10:05:01,463 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741847_1023, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:01,463 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741847_1023{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:01,463 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60895, dest: /127.0.0.1:60696, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0002_m_000003_0_24478672_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741847_1023, duration: 21998000
2015-03-13 10:05:01,463 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741847_1023, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:01,464 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741847_1023{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:01,468 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/_temporary/attempt_1426266260362_0002_m_000003_0/part-00003 is closed by DFSClient_attempt_1426266260362_0002_m_000003_0_24478672_1
2015-03-13 10:05:01,481 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/_temporary/attempt_1426266260362_0002_m_000003_0	dst=null	perm=null
2015-03-13 10:05:01,490 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/_temporary/attempt_1426266260362_0002_m_000003_0	dst=null	perm=null
2015-03-13 10:05:01,491 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/task_1426266260362_0002_m_000003	dst=null	perm=null
2015-03-13 10:05:01,496 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/_temporary/attempt_1426266260362_0002_m_000003_0	dst=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/task_1426266260362_0002_m_000003	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:05:01,514 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/_temporary/attempt_1426266260362_0002_m_000002_0/part-00002. BP-1005356445-10.1.1.144-1426266257849 blk_1073741848_1024{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:05:01,519 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0002_01_000005
2015-03-13 10:05:01,520 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0002	CONTAINERID=container_1426266260362_0002_01_000005
2015-03-13 10:05:01,520 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:05:01,520 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0002_01_000005
2015-03-13 10:05:01,521 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:01,521 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:05:01,521 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:01,531 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/_temporary/attempt_1426266260362_0002_m_000004_0/part-00004. BP-1005356445-10.1.1.144-1426266257849 blk_1073741849_1025{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:05:01,538 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0002_01_000005 is : 143
2015-03-13 10:05:01,550 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job_1426266260362_0002_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073741850_1026{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:05:01,552 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741850_1026 src: /127.0.0.1:60900 dest: /127.0.0.1:60693
2015-03-13 10:05:01,552 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:05:01,553 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000005
2015-03-13 10:05:01,553 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741850_1026 src: /127.0.0.1:60901 dest: /127.0.0.1:60686
2015-03-13 10:05:01,554 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000005
2015-03-13 10:05:01,555 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000005
2015-03-13 10:05:01,555 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000005
2015-03-13 10:05:01,555 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741850_1026 src: /127.0.0.1:60902 dest: /127.0.0.1:60696
2015-03-13 10:05:01,555 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0002	CONTAINERID=container_1426266260362_0002_01_000005
2015-03-13 10:05:01,559 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:05:01,559 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0002_01_000005 from application application_1426266260362_0002
2015-03-13 10:05:01,559 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:01,559 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0002
2015-03-13 10:05:01,561 INFO  hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job_1426266260362_0002_1.jhist for DFSClient_NONMAPREDUCE_1214526405_1
2015-03-13 10:05:01,582 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741848_1024 src: /127.0.0.1:60898 dest: /127.0.0.1:60696
2015-03-13 10:05:01,584 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741848_1024 src: /127.0.0.1:60903 dest: /127.0.0.1:60693
2015-03-13 10:05:01,586 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741848_1024 src: /127.0.0.1:60904 dest: /127.0.0.1:60689
2015-03-13 10:05:01,597 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741849_1025 src: /127.0.0.1:60899 dest: /127.0.0.1:60693
2015-03-13 10:05:01,599 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741849_1025 src: /127.0.0.1:60905 dest: /127.0.0.1:60686
2015-03-13 10:05:01,600 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741849_1025 src: /127.0.0.1:60906 dest: /127.0.0.1:60696
2015-03-13 10:05:01,606 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60904, dest: /127.0.0.1:60689, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0002_m_000002_0_1248534415_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741848_1024, duration: 19192000
2015-03-13 10:05:01,607 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741848_1024, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:01,607 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741848_1024{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:01,607 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60903, dest: /127.0.0.1:60693, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0002_m_000002_0_1248534415_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741848_1024, duration: 19380000
2015-03-13 10:05:01,608 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741848_1024, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:01,608 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741848_1024{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:01,608 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60898, dest: /127.0.0.1:60696, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0002_m_000002_0_1248534415_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741848_1024, duration: 20986000
2015-03-13 10:05:01,609 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741848_1024, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:01,609 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741848_1024{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:01,619 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/_temporary/attempt_1426266260362_0002_m_000002_0/part-00002 is closed by DFSClient_attempt_1426266260362_0002_m_000002_0_1248534415_1
2015-03-13 10:05:01,630 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60906, dest: /127.0.0.1:60696, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0002_m_000004_0_-820717384_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741849_1025, duration: 27150000
2015-03-13 10:05:01,630 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741849_1025, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:01,631 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741849_1025{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:05:01,631 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60905, dest: /127.0.0.1:60686, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0002_m_000004_0_-820717384_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741849_1025, duration: 27965000
2015-03-13 10:05:01,632 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741849_1025, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:01,632 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741849_1025{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:05:01,634 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60899, dest: /127.0.0.1:60693, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0002_m_000004_0_-820717384_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741849_1025, duration: 29826000
2015-03-13 10:05:01,634 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741849_1025, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:01,635 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741849_1025{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:05:01,641 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/_temporary/attempt_1426266260362_0002_m_000004_0/part-00004 is closed by DFSClient_attempt_1426266260362_0002_m_000004_0_-820717384_1
2015-03-13 10:05:01,646 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/_temporary/attempt_1426266260362_0002_m_000002_0	dst=null	perm=null
2015-03-13 10:05:01,652 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/_temporary/attempt_1426266260362_0002_m_000004_0	dst=null	perm=null
2015-03-13 10:05:01,660 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/_temporary/attempt_1426266260362_0002_m_000002_0	dst=null	perm=null
2015-03-13 10:05:01,661 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/_temporary/attempt_1426266260362_0002_m_000004_0	dst=null	perm=null
2015-03-13 10:05:01,662 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/task_1426266260362_0002_m_000002	dst=null	perm=null
2015-03-13 10:05:01,662 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/task_1426266260362_0002_m_000004	dst=null	perm=null
2015-03-13 10:05:01,665 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/_temporary/attempt_1426266260362_0002_m_000002_0	dst=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/task_1426266260362_0002_m_000002	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:05:01,666 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/_temporary/attempt_1426266260362_0002_m_000004_0	dst=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/task_1426266260362_0002_m_000004	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:05:01,677 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0002_01_000006
2015-03-13 10:05:01,677 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0002	CONTAINERID=container_1426266260362_0002_01_000006
2015-03-13 10:05:01,678 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:05:01,678 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:01,679 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:05:01,679 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0002_01_000004
2015-03-13 10:05:01,679 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0002	CONTAINERID=container_1426266260362_0002_01_000004
2015-03-13 10:05:01,679 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0002_01_000006
2015-03-13 10:05:01,679 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0002_01_000005
2015-03-13 10:05:01,680 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:05:01,681 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0002_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:05:01,681 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0002_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:05:01,681 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0002	CONTAINERID=container_1426266260362_0002_01_000005
2015-03-13 10:05:01,681 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0002_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:05:01,681 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:05:01,681 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0002_01_000005, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:01,681 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:01,682 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:05:01,682 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0002_000001 released container container_1426266260362_0002_01_000005 on node: host: 10.1.1.144:60711 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:05:01,692 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0002_01_000006 is : 143
2015-03-13 10:05:01,695 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:01,707 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:05:01,707 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:05:01,708 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0002_01_000004
2015-03-13 10:05:01,720 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0002_01_000004 is : 143
2015-03-13 10:05:01,734 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000006
2015-03-13 10:05:01,734 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000006
2015-03-13 10:05:01,735 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000006
2015-03-13 10:05:01,735 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000006
2015-03-13 10:05:01,736 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:05:01,736 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0002	CONTAINERID=container_1426266260362_0002_01_000006
2015-03-13 10:05:01,737 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:05:01,738 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000004
2015-03-13 10:05:01,738 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000004
2015-03-13 10:05:01,739 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000004
2015-03-13 10:05:01,740 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000004
2015-03-13 10:05:01,740 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0002_01_000006 from application application_1426266260362_0002
2015-03-13 10:05:01,741 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:01,741 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0002
2015-03-13 10:05:01,741 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0002	CONTAINERID=container_1426266260362_0002_01_000004
2015-03-13 10:05:01,741 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:05:01,741 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0002_01_000004 from application application_1426266260362_0002
2015-03-13 10:05:01,741 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:01,742 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0002
2015-03-13 10:05:01,812 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/_temporary/attempt_1426266260362_0002_m_000001_0/part-00001. BP-1005356445-10.1.1.144-1426266257849 blk_1073741851_1027{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:05:01,812 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60907, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0002_m_000000_0_-505175701_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 208000
2015-03-13 10:05:01,830 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/_temporary/attempt_1426266260362_0002_m_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073741852_1028{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:05:01,871 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741851_1027 src: /127.0.0.1:60908 dest: /127.0.0.1:60686
2015-03-13 10:05:01,872 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741851_1027 src: /127.0.0.1:60910 dest: /127.0.0.1:60696
2015-03-13 10:05:01,874 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741851_1027 src: /127.0.0.1:60911 dest: /127.0.0.1:60689
2015-03-13 10:05:01,879 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741852_1028 src: /127.0.0.1:60909 dest: /127.0.0.1:60689
2015-03-13 10:05:01,882 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741852_1028 src: /127.0.0.1:60912 dest: /127.0.0.1:60686
2015-03-13 10:05:01,883 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741852_1028 src: /127.0.0.1:60913 dest: /127.0.0.1:60693
2015-03-13 10:05:01,894 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60913, dest: /127.0.0.1:60693, bytes: 114, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0002_m_000000_0_-505175701_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741852_1028, duration: 8841000
2015-03-13 10:05:01,894 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741852_1028, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:01,894 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741852_1028{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:01,895 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60912, dest: /127.0.0.1:60686, bytes: 114, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0002_m_000000_0_-505175701_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741852_1028, duration: 9654000
2015-03-13 10:05:01,895 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741852_1028, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:01,896 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741852_1028{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:01,896 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60909, dest: /127.0.0.1:60689, bytes: 114, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0002_m_000000_0_-505175701_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741852_1028, duration: 10912000
2015-03-13 10:05:01,896 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741852_1028, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:01,897 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741852_1028{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:01,899 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60911, dest: /127.0.0.1:60689, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0002_m_000001_0_-2010036668_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741851_1027, duration: 23976000
2015-03-13 10:05:01,900 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741851_1027, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:01,900 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741851_1027{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:01,900 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60910, dest: /127.0.0.1:60696, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0002_m_000001_0_-2010036668_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741851_1027, duration: 24750000
2015-03-13 10:05:01,901 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741851_1027, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:01,901 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741851_1027{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:01,901 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60908, dest: /127.0.0.1:60686, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0002_m_000001_0_-2010036668_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741851_1027, duration: 25726000
2015-03-13 10:05:01,902 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741851_1027, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:01,902 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741851_1027{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:01,909 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/_temporary/attempt_1426266260362_0002_m_000001_0/part-00001 is closed by DFSClient_attempt_1426266260362_0002_m_000001_0_-2010036668_1
2015-03-13 10:05:01,910 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/_temporary/attempt_1426266260362_0002_m_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0002_m_000000_0_-505175701_1
2015-03-13 10:05:01,919 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/_temporary/attempt_1426266260362_0002_m_000000_0	dst=null	perm=null
2015-03-13 10:05:01,923 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/_temporary/attempt_1426266260362_0002_m_000001_0	dst=null	perm=null
2015-03-13 10:05:01,935 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/_temporary/attempt_1426266260362_0002_m_000001_0	dst=null	perm=null
2015-03-13 10:05:01,937 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/task_1426266260362_0002_m_000001	dst=null	perm=null
2015-03-13 10:05:01,940 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/_temporary/attempt_1426266260362_0002_m_000001_0	dst=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/task_1426266260362_0002_m_000001	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:05:01,953 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/_temporary/attempt_1426266260362_0002_m_000000_0	dst=null	perm=null
2015-03-13 10:05:01,953 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0002_01_000003
2015-03-13 10:05:01,953 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0002	CONTAINERID=container_1426266260362_0002_01_000003
2015-03-13 10:05:01,953 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:05:01,954 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0002_01_000003
2015-03-13 10:05:01,954 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:01,954 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:05:01,955 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/task_1426266260362_0002_m_000000	dst=null	perm=null
2015-03-13 10:05:01,964 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/_temporary/attempt_1426266260362_0002_m_000000_0	dst=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/task_1426266260362_0002_m_000000	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:05:01,967 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0002_01_000003 is : 143
2015-03-13 10:05:01,980 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:05:01,981 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000003
2015-03-13 10:05:01,981 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000003
2015-03-13 10:05:01,981 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000003
2015-03-13 10:05:01,981 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000003
2015-03-13 10:05:01,981 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0002	CONTAINERID=container_1426266260362_0002_01_000003
2015-03-13 10:05:01,982 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:05:01,982 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0002_01_000003 from application application_1426266260362_0002
2015-03-13 10:05:01,982 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:01,982 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0002
2015-03-13 10:05:01,990 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0002_01_000002
2015-03-13 10:05:01,990 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0002	CONTAINERID=container_1426266260362_0002_01_000002
2015-03-13 10:05:01,990 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:05:01,990 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0002_01_000002
2015-03-13 10:05:01,991 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:05:01,991 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:05:01,991 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0002_01_000003
2015-03-13 10:05:01,992 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0002_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:05:01,992 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0002_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:05:01,992 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0002	CONTAINERID=container_1426266260362_0002_01_000003
2015-03-13 10:05:01,992 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0002_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:05:01,992 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:05:01,992 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0002_01_000003, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:01,992 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:01,993 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:05:01,993 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0002_000001 released container container_1426266260362_0002_01_000003 on node: host: 10.1.1.144:60723 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:05:01,995 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:01,998 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_1214526405_1
2015-03-13 10:05:02,002 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1	dst=null	perm=null
2015-03-13 10:05:02,003 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0002_01_000002 is : 143
2015-03-13 10:05:02,009 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833	dst=null	perm=null
2015-03-13 10:05:02,010 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833	dst=null	perm=null
2015-03-13 10:05:02,012 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/task_1426266260362_0002_m_000000	dst=null	perm=null
2015-03-13 10:05:02,013 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/part-00000	dst=null	perm=null
2015-03-13 10:05:02,017 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:05:02,017 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/task_1426266260362_0002_m_000000/part-00000	dst=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/part-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:02,018 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000002
2015-03-13 10:05:02,018 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0002	CONTAINERID=container_1426266260362_0002_01_000002
2015-03-13 10:05:02,018 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:05:02,018 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000002
2015-03-13 10:05:02,019 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000002
2015-03-13 10:05:02,019 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000002
2015-03-13 10:05:02,018 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0002_01_000002 from application application_1426266260362_0002
2015-03-13 10:05:02,019 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:02,019 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0002
2015-03-13 10:05:02,021 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833	dst=null	perm=null
2015-03-13 10:05:02,022 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833	dst=null	perm=null
2015-03-13 10:05:02,023 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/task_1426266260362_0002_m_000001	dst=null	perm=null
2015-03-13 10:05:02,025 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/part-00001	dst=null	perm=null
2015-03-13 10:05:02,027 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/task_1426266260362_0002_m_000001/part-00001	dst=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/part-00001	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:02,028 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833	dst=null	perm=null
2015-03-13 10:05:02,029 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833	dst=null	perm=null
2015-03-13 10:05:02,030 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/task_1426266260362_0002_m_000002	dst=null	perm=null
2015-03-13 10:05:02,032 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/part-00002	dst=null	perm=null
2015-03-13 10:05:02,035 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/task_1426266260362_0002_m_000002/part-00002	dst=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/part-00002	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:02,036 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833	dst=null	perm=null
2015-03-13 10:05:02,037 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833	dst=null	perm=null
2015-03-13 10:05:02,039 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/task_1426266260362_0002_m_000003	dst=null	perm=null
2015-03-13 10:05:02,040 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/part-00003	dst=null	perm=null
2015-03-13 10:05:02,043 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/task_1426266260362_0002_m_000003/part-00003	dst=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/part-00003	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:02,044 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833	dst=null	perm=null
2015-03-13 10:05:02,045 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833	dst=null	perm=null
2015-03-13 10:05:02,047 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/task_1426266260362_0002_m_000004	dst=null	perm=null
2015-03-13 10:05:02,048 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/part-00004	dst=null	perm=null
2015-03-13 10:05:02,051 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/task_1426266260362_0002_m_000004/part-00004	dst=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/part-00004	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:02,055 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary	dst=null	perm=null
2015-03-13 10:05:02,059 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:02,061 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_SUCCESS is closed by DFSClient_NONMAPREDUCE_1214526405_1
2015-03-13 10:05:02,064 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:02,067 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_1214526405_1
2015-03-13 10:05:02,084 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60902, dest: /127.0.0.1:60696, bytes: 53333, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1214526405_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741850_1026, duration: 526956000
2015-03-13 10:05:02,084 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741850_1026, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:02,085 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741850_1026{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:05:02,085 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60901, dest: /127.0.0.1:60686, bytes: 53333, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1214526405_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741850_1026, duration: 528256000
2015-03-13 10:05:02,085 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741850_1026, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:02,086 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741850_1026{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:05:02,087 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60900, dest: /127.0.0.1:60693, bytes: 53333, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1214526405_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741850_1026, duration: 528916000
2015-03-13 10:05:02,087 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741850_1026, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:02,087 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741850_1026{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:05:02,089 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job_1426266260362_0002_1.jhist is closed by DFSClient_NONMAPREDUCE_1214526405_1
2015-03-13 10:05:02,091 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0002.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:02,095 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0002.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741853_1029{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:05:02,097 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741853_1029 src: /127.0.0.1:60914 dest: /127.0.0.1:60696
2015-03-13 10:05:02,099 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741853_1029 src: /127.0.0.1:60915 dest: /127.0.0.1:60689
2015-03-13 10:05:02,100 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741853_1029 src: /127.0.0.1:60916 dest: /127.0.0.1:60686
2015-03-13 10:05:02,104 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60916, dest: /127.0.0.1:60686, bytes: 419, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1214526405_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741853_1029, duration: 1585000
2015-03-13 10:05:02,104 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741853_1029, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:02,104 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741853_1029{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:02,104 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60915, dest: /127.0.0.1:60689, bytes: 419, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1214526405_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741853_1029, duration: 2425000
2015-03-13 10:05:02,105 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741853_1029, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:02,105 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741853_1029{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:02,105 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60914, dest: /127.0.0.1:60696, bytes: 419, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1214526405_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741853_1029, duration: 3290000
2015-03-13 10:05:02,106 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741853_1029, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:02,106 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741853_1029{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:02,107 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0002.summary_tmp is closed by DFSClient_NONMAPREDUCE_1214526405_1
2015-03-13 10:05:02,111 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0002.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:05:02,117 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job_1426266260362_0002_1.jhist	dst=null	perm=null
2015-03-13 10:05:02,119 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0002-1426266286369-soberoi-%5BB229A65FB52F476791CA626E2F4F95DF%2FB348F1FAB7B345A4-1426266302068-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:05:02,123 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job_1426266260362_0002_1.jhist	dst=null	perm=null
2015-03-13 10:05:02,124 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0002-1426266286369-soberoi-%5BB229A65FB52F476791CA626E2F4F95DF%2FB348F1FAB7B345A4-1426266302068-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:05:02,125 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job_1426266260362_0002_1.jhist	dst=null	perm=null
2015-03-13 10:05:02,128 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0002-1426266286369-soberoi-%5BB229A65FB52F476791CA626E2F4F95DF%2FB348F1FAB7B345A4-1426266302068-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:02,131 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:60917, bytes: 53753, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1214526405_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741850_1026, duration: 218000
2015-03-13 10:05:02,133 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0002-1426266286369-soberoi-%5BB229A65FB52F476791CA626E2F4F95DF%2FB348F1FAB7B345A4-1426266302068-5-0-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741854_1030{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:05:02,135 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741854_1030 src: /127.0.0.1:60918 dest: /127.0.0.1:60696
2015-03-13 10:05:02,136 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741854_1030 src: /127.0.0.1:60919 dest: /127.0.0.1:60689
2015-03-13 10:05:02,137 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741854_1030 src: /127.0.0.1:60920 dest: /127.0.0.1:60693
2015-03-13 10:05:02,142 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60920, dest: /127.0.0.1:60693, bytes: 53333, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1214526405_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741854_1030, duration: 3300000
2015-03-13 10:05:02,142 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741854_1030, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:02,143 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60919, dest: /127.0.0.1:60689, bytes: 53333, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1214526405_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741854_1030, duration: 4037000
2015-03-13 10:05:02,143 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741854_1030{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:02,143 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741854_1030, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:02,144 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60918, dest: /127.0.0.1:60696, bytes: 53333, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1214526405_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741854_1030, duration: 4872000
2015-03-13 10:05:02,144 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741854_1030, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:02,145 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741854_1030{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:02,145 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741854_1030{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:02,146 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0002-1426266286369-soberoi-%5BB229A65FB52F476791CA626E2F4F95DF%2FB348F1FAB7B345A4-1426266302068-5-0-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_1214526405_1
2015-03-13 10:05:02,149 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0002-1426266286369-soberoi-%5BB229A65FB52F476791CA626E2F4F95DF%2FB348F1FAB7B345A4-1426266302068-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:05:02,150 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job_1426266260362_0002_1_conf.xml	dst=null	perm=null
2015-03-13 10:05:02,152 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0002_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:05:02,153 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job_1426266260362_0002_1_conf.xml	dst=null	perm=null
2015-03-13 10:05:02,154 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0002_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:05:02,156 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job_1426266260362_0002_1_conf.xml	dst=null	perm=null
2015-03-13 10:05:02,158 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0002_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:02,161 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:60917, bytes: 90072, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1214526405_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741846_1022, duration: 350000
2015-03-13 10:05:02,163 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0002_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741855_1031{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:05:02,165 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741855_1031 src: /127.0.0.1:60921 dest: /127.0.0.1:60689
2015-03-13 10:05:02,166 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741855_1031 src: /127.0.0.1:60922 dest: /127.0.0.1:60693
2015-03-13 10:05:02,168 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741855_1031 src: /127.0.0.1:60923 dest: /127.0.0.1:60696
2015-03-13 10:05:02,173 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60923, dest: /127.0.0.1:60696, bytes: 89372, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1214526405_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741855_1031, duration: 3379000
2015-03-13 10:05:02,173 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741855_1031, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:02,174 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60922, dest: /127.0.0.1:60693, bytes: 89372, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1214526405_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741855_1031, duration: 4304000
2015-03-13 10:05:02,174 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741855_1031, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:02,175 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60921, dest: /127.0.0.1:60689, bytes: 89372, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1214526405_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741855_1031, duration: 5540000
2015-03-13 10:05:02,175 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741855_1031, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:02,176 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741855_1031{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:05:02,177 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741855_1031{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:05:02,177 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741855_1031{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:05:02,179 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0002_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_1214526405_1
2015-03-13 10:05:02,181 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0002_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:05:02,183 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0002.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0002.summary	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:05:02,185 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0002_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0002_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:05:02,188 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0002-1426266286369-soberoi-%5BB229A65FB52F476791CA626E2F4F95DF%2FB348F1FAB7B345A4-1426266302068-5-0-SUCCEEDED-default.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0002-1426266286369-soberoi-%5BB229A65FB52F476791CA626E2F4F95DF%2FB348F1FAB7B345A4-1426266302068-5-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:05:02,196 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0002_000001 State change from RUNNING to FINISHING
2015-03-13 10:05:02,196 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0002
2015-03-13 10:05:02,196 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0002
2015-03-13 10:05:02,196 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0002 State change from RUNNING to REMOVING
2015-03-13 10:05:02,197 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0002 State change from REMOVING to FINISHING
2015-03-13 10:05:02,683 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:05:02,683 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0002_01_000004
2015-03-13 10:05:02,684 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:05:02,684 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0002_01_000006
2015-03-13 10:05:02,685 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0002_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:05:02,685 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0002_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:05:02,685 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0002	CONTAINERID=container_1426266260362_0002_01_000004
2015-03-13 10:05:02,685 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0002_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:05:02,685 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:05:02,686 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0002_01_000004, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:02,686 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:02,686 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:05:02,686 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0002_000001 released container container_1426266260362_0002_01_000004 on node: host: 10.1.1.144:60711 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:05:02,687 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0002_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:05:02,687 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0002_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:05:02,687 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0002	CONTAINERID=container_1426266260362_0002_01_000006
2015-03-13 10:05:02,687 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0002_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:05:02,687 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:05:02,687 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0002_01_000006, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:02,688 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:02,688 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:05:02,688 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0002_000001 released container container_1426266260362_0002_01_000006 on node: host: 10.1.1.144:60711 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:05:02,698 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:02,997 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:05:02,997 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0002_01_000002
2015-03-13 10:05:02,998 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0002_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:05:02,998 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0002_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:05:02,998 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0002	CONTAINERID=container_1426266260362_0002_01_000002
2015-03-13 10:05:02,998 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0002_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:05:02,999 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:05:02,999 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0002_01_000002, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:02,999 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:02,999 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:05:03,000 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0002_000001 released container container_1426266260362_0002_01_000002 on node: host: 10.1.1.144:60723 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:05:03,204 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741842_1018 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60689 
2015-03-13 10:05:03,205 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741843_1019 127.0.0.1:60686 127.0.0.1:60693 127.0.0.1:60689 127.0.0.1:60696 
2015-03-13 10:05:03,205 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741844_1020 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60689 
2015-03-13 10:05:03,205 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741845_1021 127.0.0.1:60689 127.0.0.1:60686 127.0.0.1:60696 
2015-03-13 10:05:03,205 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741850_1026 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60696 
2015-03-13 10:05:03,206 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741846_1022 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60693 
2015-03-13 10:05:03,206 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002	dst=null	perm=null
2015-03-13 10:05:03,229 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [upper1*upper2*lower] starting step: (1/2) ...rm/joinaroundjoinleftmost
2015-03-13 10:05:03,237 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:05:03,247 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:05:03,248 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost	dst=null	perm=null
2015-03-13 10:05:03,249 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:05:03,250 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:05:03,252 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 3
2015-03-13 10:05:03,253 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003	dst=null	perm=null
2015-03-13 10:05:03,254 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003	dst=null	perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:05:03,256 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003	dst=null	perm=soberoi:supergroup:rwx------
2015-03-13 10:05:03,256 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.jar	dst=null	perm=null
2015-03-13 10:05:03,258 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:03,260 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073741856_1032{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:05:03,261 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741856_1032 src: /127.0.0.1:60925 dest: /127.0.0.1:60686
2015-03-13 10:05:03,262 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741856_1032 src: /127.0.0.1:60926 dest: /127.0.0.1:60696
2015-03-13 10:05:03,263 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741856_1032 src: /127.0.0.1:60927 dest: /127.0.0.1:60689
2015-03-13 10:05:03,268 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60927, dest: /127.0.0.1:60689, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741856_1032, duration: 2775000
2015-03-13 10:05:03,268 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741856_1032, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:03,268 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741856_1032{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:03,268 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60926, dest: /127.0.0.1:60696, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741856_1032, duration: 2941000
2015-03-13 10:05:03,269 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741856_1032, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:03,269 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741856_1032{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:03,269 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60925, dest: /127.0.0.1:60686, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741856_1032, duration: 4049000
2015-03-13 10:05:03,269 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741856_1032, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:03,272 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741856_1032{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:03,273 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:05:03,274 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.jar
2015-03-13 10:05:03,274 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.jar	dst=null	perm=null
2015-03-13 10:05:03,275 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:03,276 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:05:03,277 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:05:03,278 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:05:03,279 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:05:03,279 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:05:03,280 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:05:03,281 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:05:03,281 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:05:03,282 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:05:03,284 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833	dst=null	perm=null
2015-03-13 10:05:03,285 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833	dst=null	perm=null
2015-03-13 10:05:03,286 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833	dst=null	perm=null
2015-03-13 10:05:03,288 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:05:03,290 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:03,293 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:03,294 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.split
2015-03-13 10:05:03,295 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.split	dst=null	perm=null
2015-03-13 10:05:03,296 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073741857_1033{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:05:03,297 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741857_1033 src: /127.0.0.1:60928 dest: /127.0.0.1:60693
2015-03-13 10:05:03,299 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741857_1033 src: /127.0.0.1:60929 dest: /127.0.0.1:60689
2015-03-13 10:05:03,300 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741857_1033 src: /127.0.0.1:60930 dest: /127.0.0.1:60686
2015-03-13 10:05:03,301 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741857_1033 src: /127.0.0.1:60931 dest: /127.0.0.1:60696
2015-03-13 10:05:03,304 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60931, dest: /127.0.0.1:60696, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741857_1033, duration: 1608000
2015-03-13 10:05:03,305 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741857_1033, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:03,305 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741857_1033{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:05:03,305 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60930, dest: /127.0.0.1:60686, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741857_1033, duration: 2183000
2015-03-13 10:05:03,306 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741857_1033, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:03,306 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741857_1033{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:05:03,306 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60929, dest: /127.0.0.1:60689, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741857_1033, duration: 3065000
2015-03-13 10:05:03,306 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741857_1033, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:03,307 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741857_1033{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:05:03,307 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60928, dest: /127.0.0.1:60693, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741857_1033, duration: 4152000
2015-03-13 10:05:03,307 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741857_1033, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:03,308 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741857_1033{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:05:03,309 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:05:03,311 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:03,316 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:03,317 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073741858_1034{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:05:03,319 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741858_1034 src: /127.0.0.1:60932 dest: /127.0.0.1:60696
2015-03-13 10:05:03,320 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741858_1034 src: /127.0.0.1:60933 dest: /127.0.0.1:60693
2015-03-13 10:05:03,321 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741858_1034 src: /127.0.0.1:60934 dest: /127.0.0.1:60689
2015-03-13 10:05:03,324 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60934, dest: /127.0.0.1:60689, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741858_1034, duration: 1568000
2015-03-13 10:05:03,324 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741858_1034, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:03,324 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741858_1034{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:03,325 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60933, dest: /127.0.0.1:60693, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741858_1034, duration: 2061000
2015-03-13 10:05:03,325 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741858_1034, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:03,325 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741858_1034{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:03,325 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60932, dest: /127.0.0.1:60696, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741858_1034, duration: 2907000
2015-03-13 10:05:03,326 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741858_1034, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:03,326 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741858_1034{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:03,328 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:05:03,328 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:05:03,330 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:03,332 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:03,333 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:05:03,333 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:05:03,334 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:05:03,344 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073741859_1035{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:05:03,346 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741859_1035 src: /127.0.0.1:60935 dest: /127.0.0.1:60693
2015-03-13 10:05:03,347 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741859_1035 src: /127.0.0.1:60936 dest: /127.0.0.1:60686
2015-03-13 10:05:03,349 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741859_1035 src: /127.0.0.1:60937 dest: /127.0.0.1:60689
2015-03-13 10:05:03,353 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60937, dest: /127.0.0.1:60689, bytes: 98867, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741859_1035, duration: 2087000
2015-03-13 10:05:03,353 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741859_1035, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:03,354 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741859_1035{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:03,354 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60936, dest: /127.0.0.1:60686, bytes: 98867, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741859_1035, duration: 2643000
2015-03-13 10:05:03,354 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741859_1035, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:03,355 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741859_1035{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:03,355 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60935, dest: /127.0.0.1:60693, bytes: 98867, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741859_1035, duration: 3712000
2015-03-13 10:05:03,355 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741859_1035, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:03,356 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741859_1035{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:03,359 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:05:03,359 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0003
2015-03-13 10:05:03,361 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003	dst=null	perm=null
2015-03-13 10:05:03,362 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.xml	dst=null	perm=null
2015-03-13 10:05:03,363 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.xml	dst=null	perm=null
2015-03-13 10:05:03,364 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.jar	dst=null	perm=null
2015-03-13 10:05:03,365 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.jar	dst=null	perm=null
2015-03-13 10:05:03,366 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.split	dst=null	perm=null
2015-03-13 10:05:03,367 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.split	dst=null	perm=null
2015-03-13 10:05:03,367 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:05:03,368 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:05:03,370 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:05:03,371 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:05:03,372 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:05:03,373 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:05:03,373 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:05:03,374 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:05:03,375 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 3 submitted by user soberoi
2015-03-13 10:05:03,375 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0003
2015-03-13 10:05:03,376 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	IP=10.1.1.144	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1426266260362_0003
2015-03-13 10:05:03,376 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0003
2015-03-13 10:05:03,376 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0003 State change from NEW to NEW_SAVING
2015-03-13 10:05:03,377 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0003 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:05:03,377 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0003_000001
2015-03-13 10:05:03,377 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0003_000001 State change from NEW to SUBMITTED
2015-03-13 10:05:03,377 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0003 from user: soberoi activated in queue: default
2015-03-13 10:05:03,377 INFO  capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0003 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:05:03,378 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0003 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:05:03,378 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0003 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:05:03,378 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0003_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:05:03,378 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0003_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:05:03,379 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0003 State change from SUBMITTED to ACCEPTED
2015-03-13 10:05:03,380 INFO  mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0003/
2015-03-13 10:05:03,380 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [upper1*upper2*lower] submitted hadoop job: job_1426266260362_0003
2015-03-13 10:05:03,380 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [upper1*upper2*lower] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0003/
2015-03-13 10:05:03,658 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60696 to replicate blk_1073741856_1032 to datanode(s) 127.0.0.1:60693
2015-03-13 10:05:03,658 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073741842_1018, blk_1073741843_1019, blk_1073741844_1020, blk_1073741845_1021, blk_1073741846_1022, blk_1073741850_1026]
2015-03-13 10:05:03,658 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073741842_1018, blk_1073741843_1019, blk_1073741844_1020, blk_1073741845_1021, blk_1073741850_1026]
2015-03-13 10:05:03,688 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0003_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:05:03,689 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0003	CONTAINERID=container_1426266260362_0003_01_000001
2015-03-13 10:05:03,689 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0003_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:05:03,689 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0003 container=Container: [ContainerId: container_1426266260362_0003_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0003_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:03,689 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:05:03,690 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0003_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:05:03,690 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:03,691 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0003 AttemptId: appattempt_1426266260362_0003_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0003_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ]
2015-03-13 10:05:03,691 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0003_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:05:03,691 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0003_000001
2015-03-13 10:05:03,691 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0003_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:05:03,692 INFO  amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0003_000001
2015-03-13 10:05:03,693 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0003_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] for AM appattempt_1426266260362_0003_000001
2015-03-13 10:05:03,693 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0003_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-03-13 10:05:03,695 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0003_000001 (auth:SIMPLE)
2015-03-13 10:05:03,698 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0003_01_000001 by user soberoi
2015-03-13 10:05:03,698 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0003
2015-03-13 10:05:03,698 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0003	CONTAINERID=container_1426266260362_0003_01_000001
2015-03-13 10:05:03,698 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0003 transitioned from NEW to INITING
2015-03-13 10:05:03,698 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0003_01_000001 to application application_1426266260362_0003
2015-03-13 10:05:03,699 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0003 transitioned from INITING to RUNNING
2015-03-13 10:05:03,699 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0003_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] for AM appattempt_1426266260362_0003_000001
2015-03-13 10:05:03,699 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0003_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:05:03,699 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:05:03,699 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:03,699 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0003
2015-03-13 10:05:03,700 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:05:03,700 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:05:03,700 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:05:03,700 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:05:03,700 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0003_01_000001
2015-03-13 10:05:03,709 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0003_01_000001.tokens. Credentials list: 
2015-03-13 10:05:03,724 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:05:03,814 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0003_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000001.tokens
2015-03-13 10:05:03,814 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0003 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0003
2015-03-13 10:05:03,878 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.jar	dst=null	perm=null
2015-03-13 10:05:03,879 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.jar	dst=null	perm=null
2015-03-13 10:05:03,880 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.jar	dst=null	perm=null
2015-03-13 10:05:03,887 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:60941, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1705763075_2037, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741856_1032, duration: 607000
2015-03-13 10:05:03,906 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:05:03,923 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:05:03,924 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:05:03,925 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:05:03,931 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:60941, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1705763075_2037, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741858_1034, duration: 196000
2015-03-13 10:05:03,944 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:05:03,961 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.split	dst=null	perm=null
2015-03-13 10:05:03,961 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.split	dst=null	perm=null
2015-03-13 10:05:03,962 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.split	dst=null	perm=null
2015-03-13 10:05:03,969 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60942, bytes: 1748, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1705763075_2037, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741857_1033, duration: 220000
2015-03-13 10:05:03,981 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:05:04,000 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.xml	dst=null	perm=null
2015-03-13 10:05:04,001 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.xml	dst=null	perm=null
2015-03-13 10:05:04,002 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.xml	dst=null	perm=null
2015-03-13 10:05:04,008 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60942, bytes: 99643, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1705763075_2037, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741859_1035, duration: 322000
2015-03-13 10:05:04,021 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:05:04,021 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:05:04,046 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:05:04,047 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:04,114 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000001/default_container_executor.sh]
2015-03-13 10:05:04,273 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741849_1025
2015-03-13 10:05:04,273 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741851_1027
2015-03-13 10:05:04,274 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741850_1026
2015-03-13 10:05:04,275 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741859_1035
2015-03-13 10:05:04,275 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741852_1028
2015-03-13 10:05:04,276 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741853_1029
2015-03-13 10:05:04,276 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741857_1033
2015-03-13 10:05:04,277 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741856_1032
2015-03-13 10:05:04,294 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741853_1029
2015-03-13 10:05:04,294 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741858_1034
2015-03-13 10:05:04,295 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741851_1027
2015-03-13 10:05:04,295 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741848_1024
2015-03-13 10:05:04,297 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741856_1032
2015-03-13 10:05:04,298 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741852_1028
2015-03-13 10:05:04,315 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741842_1018 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741842 for deletion
2015-03-13 10:05:04,315 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741843_1019 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741843 for deletion
2015-03-13 10:05:04,315 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741844_1020 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741844 for deletion
2015-03-13 10:05:04,315 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741845_1021 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741845 for deletion
2015-03-13 10:05:04,316 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741850_1026 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741850 for deletion
2015-03-13 10:05:04,315 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741842_1018 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741842
2015-03-13 10:05:04,316 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741843_1019 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741843
2015-03-13 10:05:04,316 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741844_1020 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741844
2015-03-13 10:05:04,316 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741845_1021 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741845
2015-03-13 10:05:04,316 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741850_1026 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741850
2015-03-13 10:05:04,492 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741859_1035
2015-03-13 10:05:04,493 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741850_1026
2015-03-13 10:05:04,493 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741848_1024
2015-03-13 10:05:04,494 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741847_1023
2015-03-13 10:05:04,494 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741857_1033
2015-03-13 10:05:04,495 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741849_1025
2015-03-13 10:05:04,495 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741855_1031
2015-03-13 10:05:04,496 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741852_1028
2015-03-13 10:05:04,497 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741854_1030
2015-03-13 10:05:04,497 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741858_1034
2015-03-13 10:05:04,502 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741859_1035
2015-03-13 10:05:04,503 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741854_1030
2015-03-13 10:05:04,503 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741847_1023
2015-03-13 10:05:04,504 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741857_1033
2015-03-13 10:05:04,504 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741855_1031
2015-03-13 10:05:04,659 INFO  datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-318492837-10.1.1.144-60696-1426266259571, infoPort=60697, ipcPort=60698, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073741856_1032 to 127.0.0.1:60693 
2015-03-13 10:05:04,660 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741842_1018 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741842 for deletion
2015-03-13 10:05:04,660 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741843_1019 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741843 for deletion
2015-03-13 10:05:04,660 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741844_1020 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741844 for deletion
2015-03-13 10:05:04,661 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741845_1021 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741845 for deletion
2015-03-13 10:05:04,661 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741846_1022 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741846 for deletion
2015-03-13 10:05:04,660 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741842_1018 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741842
2015-03-13 10:05:04,661 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741843_1019 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741843
2015-03-13 10:05:04,661 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741850_1026 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741850 for deletion
2015-03-13 10:05:04,661 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741844_1020 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741844
2015-03-13 10:05:04,661 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741845_1021 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741845
2015-03-13 10:05:04,661 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741846_1022 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741846
2015-03-13 10:05:04,662 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741856_1032 src: /127.0.0.1:60943 dest: /127.0.0.1:60693
2015-03-13 10:05:04,661 INFO  datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073741856_1032 (numBytes=254067) to /127.0.0.1:60693
2015-03-13 10:05:04,662 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741850_1026 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741850
2015-03-13 10:05:04,663 INFO  datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073741856_1032 src: /127.0.0.1:60943 dest: /127.0.0.1:60693 of size 254067
2015-03-13 10:05:04,664 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741856_1032 size 254067
2015-03-13 10:05:04,665 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741857_1033
2015-03-13 10:05:04,666 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741847_1023
2015-03-13 10:05:04,666 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741853_1029
2015-03-13 10:05:04,666 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741858_1034
2015-03-13 10:05:04,667 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741848_1024
2015-03-13 10:05:04,667 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741851_1027
2015-03-13 10:05:04,667 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741849_1025
2015-03-13 10:05:04,668 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741855_1031
2015-03-13 10:05:04,669 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741856_1032
2015-03-13 10:05:04,691 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:04,692 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0003_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:05:04,705 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:04,873 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741854_1030
2015-03-13 10:05:05,694 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:05,707 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:05,728 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:05:05,750 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/COMMIT_STARTED	dst=null	perm=null
2015-03-13 10:05:05,752 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/COMMIT_SUCCESS	dst=null	perm=null
2015-03-13 10:05:05,753 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/COMMIT_FAIL	dst=null	perm=null
2015-03-13 10:05:05,806 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003	dst=null	perm=null
2015-03-13 10:05:05,807 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:05:05,809 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:05:06,120 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:05:06,127 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:05:06,185 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:60945, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1042308078_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741858_1034, duration: 158000
2015-03-13 10:05:06,660 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073741842_1018, blk_1073741843_1019, blk_1073741844_1020, blk_1073741845_1021, blk_1073741846_1022]
2015-03-13 10:05:06,661 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073741842_1018, blk_1073741843_1019, blk_1073741846_1022, blk_1073741850_1026]
2015-03-13 10:05:06,697 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:06,708 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:06,971 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0003_000001 (auth:SIMPLE)
2015-03-13 10:05:06,973 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0003_000001
2015-03-13 10:05:06,973 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi	IP=10.1.1.144	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1426266260362_0003	APPATTEMPTID=appattempt_1426266260362_0003_000001
2015-03-13 10:05:06,973 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0003_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:05:06,973 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0003 State change from ACCEPTED to RUNNING
2015-03-13 10:05:06,996 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job_1426266260362_0003_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:06,998 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:05:07,061 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job_1426266260362_0003_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:07,186 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job_1426266260362_0003_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073741860_1036{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:05:07,225 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741860_1036 src: /127.0.0.1:60951 dest: /127.0.0.1:60696
2015-03-13 10:05:07,227 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741860_1036 src: /127.0.0.1:60952 dest: /127.0.0.1:60686
2015-03-13 10:05:07,228 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741860_1036 src: /127.0.0.1:60953 dest: /127.0.0.1:60689
2015-03-13 10:05:07,235 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60953, dest: /127.0.0.1:60689, bytes: 91710, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1042308078_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741860_1036, duration: 5341000
2015-03-13 10:05:07,235 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741860_1036, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:07,235 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741860_1036{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:07,236 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60952, dest: /127.0.0.1:60686, bytes: 91710, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1042308078_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741860_1036, duration: 6064000
2015-03-13 10:05:07,236 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741860_1036, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:07,237 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741860_1036{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:07,237 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60951, dest: /127.0.0.1:60696, bytes: 91710, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1042308078_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741860_1036, duration: 7033000
2015-03-13 10:05:07,237 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741860_1036, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:07,237 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741860_1036{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:07,243 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job_1426266260362_0003_1_conf.xml is closed by DFSClient_NONMAPREDUCE_1042308078_1
2015-03-13 10:05:07,318 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741842_1018 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741842 for deletion
2015-03-13 10:05:07,319 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741843_1019 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741843 for deletion
2015-03-13 10:05:07,319 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741844_1020 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741844 for deletion
2015-03-13 10:05:07,319 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741842_1018 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741842
2015-03-13 10:05:07,319 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741845_1021 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741845 for deletion
2015-03-13 10:05:07,319 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741843_1019 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741843
2015-03-13 10:05:07,319 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741844_1020 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741844
2015-03-13 10:05:07,319 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741846_1022 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741846 for deletion
2015-03-13 10:05:07,320 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741845_1021 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741845
2015-03-13 10:05:07,320 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741846_1022 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741846
2015-03-13 10:05:07,493 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741842_1018 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741842 for deletion
2015-03-13 10:05:07,493 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741843_1019 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741843 for deletion
2015-03-13 10:05:07,493 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741846_1022 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741846 for deletion
2015-03-13 10:05:07,493 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741842_1018 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741842
2015-03-13 10:05:07,493 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741843_1019 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741843
2015-03-13 10:05:07,493 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741850_1026 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741850 for deletion
2015-03-13 10:05:07,494 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741846_1022 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741846
2015-03-13 10:05:07,494 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741850_1026 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741850
2015-03-13 10:05:07,701 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:07,714 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:08,005 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0003_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:05:08,005 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0003	CONTAINERID=container_1426266260362_0003_01_000002
2015-03-13 10:05:08,005 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0003_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:05:08,005 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0003 container=Container: [ContainerId: container_1426266260362_0003_01_000002, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0003_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:08,006 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:05:08,006 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:08,006 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0003_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:05:08,006 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0003	CONTAINERID=container_1426266260362_0003_01_000003
2015-03-13 10:05:08,006 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0003_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:05:08,006 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0003 container=Container: [ContainerId: container_1426266260362_0003_01_000003, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0003_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:08,007 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:05:08,007 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:08,007 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0003_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:05:08,007 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0003	CONTAINERID=container_1426266260362_0003_01_000004
2015-03-13 10:05:08,008 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0003_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:05:08,008 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0003 container=Container: [ContainerId: container_1426266260362_0003_01_000004, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0003_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:08,008 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:05:08,008 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:08,008 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0003_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:05:08,008 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0003	CONTAINERID=container_1426266260362_0003_01_000005
2015-03-13 10:05:08,009 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0003_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:05:08,009 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0003 container=Container: [ContainerId: container_1426266260362_0003_01_000005, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0003_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:08,009 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:05:08,009 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:08,235 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0002_01_000001 succeeded 
2015-03-13 10:05:08,235 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:05:08,235 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0002_01_000001
2015-03-13 10:05:08,244 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000001
2015-03-13 10:05:08,244 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000001
2015-03-13 10:05:08,244 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000001
2015-03-13 10:05:08,244 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000001
2015-03-13 10:05:08,244 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0002	CONTAINERID=container_1426266260362_0002_01_000001
2015-03-13 10:05:08,245 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:05:08,245 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0002_01_000001 from application application_1426266260362_0002
2015-03-13 10:05:08,245 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:08,245 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0002
2015-03-13 10:05:08,707 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:08,708 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0003_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:05:08,708 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0003	CONTAINERID=container_1426266260362_0003_01_000006
2015-03-13 10:05:08,708 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0003_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:05:08,708 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0003 container=Container: [ContainerId: container_1426266260362_0003_01_000006, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0003_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:08,709 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7
2015-03-13 10:05:08,709 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:08,719 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:05:08,719 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0002_01_000001
2015-03-13 10:05:08,719 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0002_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:05:08,720 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0002_000001
2015-03-13 10:05:08,720 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0002_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:05:08,720 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0002_000001 State change from FINISHING to FINISHED
2015-03-13 10:05:08,720 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0002	CONTAINERID=container_1426266260362_0002_01_000001
2015-03-13 10:05:08,720 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0002 State change from FINISHING to FINISHED
2015-03-13 10:05:08,720 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0002_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60715, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:05:08,721 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1426266260362_0002
2015-03-13 10:05:08,721 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:7168, vCores:6> numContainers=6 user=soberoi user-resources=<memory:7168, vCores:6>
2015-03-13 10:05:08,721 INFO  amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0002_000001
2015-03-13 10:05:08,721 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0002_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:08,722 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:08,722 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6
2015-03-13 10:05:08,722 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0002_000001 released container container_1426266260362_0002_01_000001 on node: host: 10.1.1.144:60715 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:05:08,722 INFO  capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0002_000001 is done. finalState=FINISHED
2015-03-13 10:05:08,722 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0002 requests cleared
2015-03-13 10:05:08,723 INFO  capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0002 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:05:08,723 INFO  capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0002 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:05:08,721 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0002,name=[B229A65FB52F476791CA626E2F4F95DF/B348F1FAB7B345A48FA5BE9A6836732D] upper1*upper2*lower/(2/2),user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0002/jobhistory/job/job_1426266260362_0002,appMasterHost=Edinburgh.local,startTime=1426266286369,finishTime=1426266302197,finalStatus=SUCCEEDED
2015-03-13 10:05:08,725 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0002_000001 (auth:SIMPLE)
2015-03-13 10:05:08,727 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0002_01_000001
2015-03-13 10:05:09,005 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0002 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:05:09,006 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0002
2015-03-13 10:05:09,007 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0002
2015-03-13 10:05:09,007 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0002
2015-03-13 10:05:09,007 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0003_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:05:09,007 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0002
2015-03-13 10:05:09,007 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0002 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:05:09,008 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0002, with delay of 10800 seconds
2015-03-13 10:05:09,008 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0002
2015-03-13 10:05:09,007 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0003_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:05:09,008 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0003_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:05:09,009 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0003_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:05:09,009 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0003_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:05:09,035 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.jar	dst=null	perm=null
2015-03-13 10:05:09,036 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.jar	dst=null	perm=null
2015-03-13 10:05:09,045 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.xml	dst=null	perm=null
2015-03-13 10:05:09,046 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.xml	dst=null	perm=null
2015-03-13 10:05:09,048 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:05:09,050 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:05:09,055 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:05:09,056 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:05:09,058 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:05:09,059 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:05:09,133 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0003_000001 (auth:SIMPLE)
2015-03-13 10:05:09,133 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0003_000001 (auth:SIMPLE)
2015-03-13 10:05:09,137 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0003_01_000006 by user soberoi
2015-03-13 10:05:09,137 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0003	CONTAINERID=container_1426266260362_0003_01_000006
2015-03-13 10:05:09,137 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0003_01_000003 by user soberoi
2015-03-13 10:05:09,137 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0003
2015-03-13 10:05:09,138 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0003	CONTAINERID=container_1426266260362_0003_01_000003
2015-03-13 10:05:09,138 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0003_01_000005 by user soberoi
2015-03-13 10:05:09,138 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0003	CONTAINERID=container_1426266260362_0003_01_000005
2015-03-13 10:05:09,138 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0003_01_000004 by user soberoi
2015-03-13 10:05:09,139 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0003	CONTAINERID=container_1426266260362_0003_01_000004
2015-03-13 10:05:09,139 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0003_01_000006 to application application_1426266260362_0003
2015-03-13 10:05:09,137 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0003_01_000002 by user soberoi
2015-03-13 10:05:09,139 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0003 transitioned from NEW to INITING
2015-03-13 10:05:09,139 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:05:09,139 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0003_01_000003 to application application_1426266260362_0003
2015-03-13 10:05:09,139 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0003_01_000005 to application application_1426266260362_0003
2015-03-13 10:05:09,140 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0003_01_000004 to application application_1426266260362_0003
2015-03-13 10:05:09,140 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0003_01_000002 to application application_1426266260362_0003
2015-03-13 10:05:09,140 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0003 transitioned from INITING to RUNNING
2015-03-13 10:05:09,140 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:05:09,140 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:05:09,141 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:05:09,139 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0003
2015-03-13 10:05:09,141 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0003
2015-03-13 10:05:09,141 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:05:09,141 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0003
2015-03-13 10:05:09,139 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0003	CONTAINERID=container_1426266260362_0003_01_000002
2015-03-13 10:05:09,142 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:05:09,141 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:05:09,142 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0003
2015-03-13 10:05:09,142 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0003
2015-03-13 10:05:09,142 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:05:09,142 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0003
2015-03-13 10:05:09,143 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:05:09,143 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:05:09,146 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0003
2015-03-13 10:05:09,146 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0003
2015-03-13 10:05:09,146 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:05:09,146 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0003
2015-03-13 10:05:09,147 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0003
2015-03-13 10:05:09,147 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0003
2015-03-13 10:05:09,147 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:05:09,147 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0003
2015-03-13 10:05:09,147 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0003
2015-03-13 10:05:09,147 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0003
2015-03-13 10:05:09,147 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:05:09,148 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0003
2015-03-13 10:05:09,148 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0003_01_000004
2015-03-13 10:05:09,150 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0003_01_000002
2015-03-13 10:05:09,153 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0003_01_000003
2015-03-13 10:05:09,154 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0003_01_000005
2015-03-13 10:05:09,172 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426266260362_0003_01_000004.tokens. Credentials list: 
2015-03-13 10:05:09,173 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1426266260362_0003_01_000003.tokens. Credentials list: 
2015-03-13 10:05:09,173 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426266260362_0003_01_000005.tokens. Credentials list: 
2015-03-13 10:05:09,174 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426266260362_0003_01_000002.tokens. Credentials list: 
2015-03-13 10:05:09,192 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:05:09,197 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:05:09,197 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:09,275 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000006/default_container_executor.sh]
2015-03-13 10:05:09,276 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1426266260362_0003_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000003.tokens
2015-03-13 10:05:09,276 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0003 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0003
2015-03-13 10:05:09,285 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741860_1036
2015-03-13 10:05:09,347 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.jar	dst=null	perm=null
2015-03-13 10:05:09,348 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.jar	dst=null	perm=null
2015-03-13 10:05:09,349 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.jar	dst=null	perm=null
2015-03-13 10:05:09,357 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:60959, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1076734043_2174, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741856_1032, duration: 432000
2015-03-13 10:05:09,378 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:05:09,397 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.xml	dst=null	perm=null
2015-03-13 10:05:09,398 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.xml	dst=null	perm=null
2015-03-13 10:05:09,399 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.xml	dst=null	perm=null
2015-03-13 10:05:09,407 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60960, bytes: 99643, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1076734043_2174, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741859_1035, duration: 345000
2015-03-13 10:05:09,421 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:05:09,421 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:05:09,422 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:05:09,422 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:05:09,422 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:05:09,493 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:05:09,493 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:09,498 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:05:09,498 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:09,500 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:05:09,500 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:09,503 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741856_1032
2015-03-13 10:05:09,504 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:05:09,504 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:09,511 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741860_1036
2015-03-13 10:05:09,655 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000005/default_container_executor.sh]
2015-03-13 10:05:09,655 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000003/default_container_executor.sh]
2015-03-13 10:05:09,655 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000004/default_container_executor.sh]
2015-03-13 10:05:09,664 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000002/default_container_executor.sh]
2015-03-13 10:05:09,710 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:09,711 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:09,711 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0003_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:05:09,712 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0002 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:05:09,712 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0002
2015-03-13 10:05:09,712 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0002 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:05:09,712 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0002, with delay of 10800 seconds
2015-03-13 10:05:09,713 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0002
2015-03-13 10:05:09,714 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0002
2015-03-13 10:05:09,714 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0002
2015-03-13 10:05:09,714 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0002
2015-03-13 10:05:09,721 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0002 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:05:09,721 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0002
2015-03-13 10:05:09,722 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0002
2015-03-13 10:05:09,722 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0002 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:05:09,722 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0002, with delay of 10800 seconds
2015-03-13 10:05:09,722 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0002
2015-03-13 10:05:09,722 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0002
2015-03-13 10:05:09,721 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0002
2015-03-13 10:05:09,877 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741860_1036
2015-03-13 10:05:10,006 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:10,007 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:10,007 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:10,007 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:10,008 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0003_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:05:10,008 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0003_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:05:10,008 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0003_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:05:10,008 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0003_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:05:10,027 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:05:10,454 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:05:10,577 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426266260362_0003_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000002.tokens
2015-03-13 10:05:10,577 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0003 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0003
2015-03-13 10:05:10,688 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:05:10,715 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:10,716 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:10,809 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426266260362_0003_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000005.tokens
2015-03-13 10:05:10,810 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0003 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0003
2015-03-13 10:05:10,926 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:05:11,009 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:11,009 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:11,010 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:11,010 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:11,042 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426266260362_0003_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000004.tokens
2015-03-13 10:05:11,043 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0003 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0003
2015-03-13 10:05:11,718 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:11,718 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:12,014 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:12,015 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:12,015 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:12,015 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:12,720 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:12,720 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:13,020 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:13,021 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:13,021 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:13,021 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:13,723 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:13,724 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:14,026 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:14,026 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:14,027 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:14,027 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:14,733 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:14,734 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:15,031 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:15,032 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:15,032 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:15,032 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:15,738 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:15,738 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:16,033 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:16,034 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:16,034 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:16,034 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:16,743 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:16,743 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:17,039 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:17,039 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:17,039 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:17,040 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:17,067 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.split	dst=null	perm=null
2015-03-13 10:05:17,229 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:60970, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0003_m_000004_0_-572601728_1, offset: 1024, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741857_1033, duration: 233000
2015-03-13 10:05:17,257 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.split	dst=null	perm=null
2015-03-13 10:05:17,349 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.split	dst=null	perm=null
2015-03-13 10:05:17,443 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/part-00004	dst=null	perm=null
2015-03-13 10:05:17,453 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.split	dst=null	perm=null
2015-03-13 10:05:17,467 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/part-00004	dst=null	perm=null
2015-03-13 10:05:17,473 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60975, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0003_m_000004_0_-572601728_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741849_1025, duration: 164000
2015-03-13 10:05:17,474 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:60973, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0003_m_000000_0_1051762262_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741857_1033, duration: 190000
2015-03-13 10:05:17,527 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/_temporary/attempt_1426266260362_0003_m_000004_0/part-00004	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:17,535 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.split	dst=null	perm=null
2015-03-13 10:05:17,550 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:60976, bytes: 1232, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0003_m_000002_0_-1717617226_1, offset: 512, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741857_1033, duration: 186000
2015-03-13 10:05:17,623 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:60978, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0003_m_000003_0_-1674850856_1, offset: 1024, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741857_1033, duration: 182000
2015-03-13 10:05:17,627 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/part-00000	dst=null	perm=null
2015-03-13 10:05:17,637 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/part-00000	dst=null	perm=null
2015-03-13 10:05:17,640 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:60973, bytes: 118, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0003_m_000000_0_1051762262_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741852_1028, duration: 230000
2015-03-13 10:05:17,691 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/part-00002	dst=null	perm=null
2015-03-13 10:05:17,699 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/_temporary/attempt_1426266260362_0003_m_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:17,703 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/part-00002	dst=null	perm=null
2015-03-13 10:05:17,704 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:60979, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0003_m_000001_0_-1679870296_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741857_1033, duration: 178000
2015-03-13 10:05:17,710 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:60980, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0003_m_000002_0_-1717617226_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741848_1024, duration: 201000
2015-03-13 10:05:17,744 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/_temporary/attempt_1426266260362_0003_m_000002_0/part-00002	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:17,745 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:17,745 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:17,764 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/part-00003	dst=null	perm=null
2015-03-13 10:05:17,772 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/part-00003	dst=null	perm=null
2015-03-13 10:05:17,774 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:60978, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0003_m_000003_0_-1674850856_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741847_1023, duration: 190000
2015-03-13 10:05:17,834 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/_temporary/attempt_1426266260362_0003_m_000003_0/part-00003	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:17,842 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/part-00001	dst=null	perm=null
2015-03-13 10:05:17,851 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/part-00001	dst=null	perm=null
2015-03-13 10:05:17,854 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60981, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0003_m_000001_0_-1679870296_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741851_1027, duration: 214000
2015-03-13 10:05:17,904 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/_temporary/attempt_1426266260362_0003_m_000001_0/part-00001	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:17,935 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:05:17,942 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:05:17,953 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:05:17,959 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60982, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0003_m_000004_0_-572601728_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 178000
2015-03-13 10:05:17,965 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:05:17,967 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:05:17,970 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:05:17,975 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:60983, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0003_m_000004_0_-572601728_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 2510000
2015-03-13 10:05:17,993 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/_temporary/attempt_1426266260362_0003_m_000004_0/part-00004 is closed by DFSClient_attempt_1426266260362_0003_m_000004_0_-572601728_1
2015-03-13 10:05:18,002 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/_temporary/attempt_1426266260362_0003_m_000004_0	dst=null	perm=null
2015-03-13 10:05:18,008 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/_temporary/attempt_1426266260362_0003_m_000004_0	dst=null	perm=null
2015-03-13 10:05:18,009 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/task_1426266260362_0003_m_000004	dst=null	perm=null
2015-03-13 10:05:18,013 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/_temporary/attempt_1426266260362_0003_m_000004_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/task_1426266260362_0003_m_000004	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:05:18,033 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0003_01_000006
2015-03-13 10:05:18,034 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0003	CONTAINERID=container_1426266260362_0003_01_000006
2015-03-13 10:05:18,034 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:05:18,034 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0003_01_000006
2015-03-13 10:05:18,034 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:18,034 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:05:18,041 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:18,041 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:18,041 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:18,042 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:18,047 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0003_01_000006 is : 143
2015-03-13 10:05:18,048 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job_1426266260362_0003_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073741861_1037{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:05:18,050 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741861_1037 src: /127.0.0.1:60984 dest: /127.0.0.1:60689
2015-03-13 10:05:18,051 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741861_1037 src: /127.0.0.1:60985 dest: /127.0.0.1:60693
2015-03-13 10:05:18,053 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741861_1037 src: /127.0.0.1:60986 dest: /127.0.0.1:60696
2015-03-13 10:05:18,057 INFO  hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job_1426266260362_0003_1.jhist for DFSClient_NONMAPREDUCE_1042308078_1
2015-03-13 10:05:18,061 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:05:18,062 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000006
2015-03-13 10:05:18,062 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0003	CONTAINERID=container_1426266260362_0003_01_000006
2015-03-13 10:05:18,062 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000006
2015-03-13 10:05:18,062 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000006
2015-03-13 10:05:18,062 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000006
2015-03-13 10:05:18,062 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:05:18,062 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0003_01_000006 from application application_1426266260362_0003
2015-03-13 10:05:18,063 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:18,063 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0003
2015-03-13 10:05:18,152 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:05:18,158 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:05:18,172 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:05:18,178 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60987, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0003_m_000000_0_1051762262_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 180000
2015-03-13 10:05:18,185 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:05:18,187 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:05:18,190 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:05:18,193 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:60988, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0003_m_000000_0_1051762262_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 190000
2015-03-13 10:05:18,199 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:05:18,205 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:05:18,210 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:05:18,219 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:60989, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0003_m_000002_0_-1717617226_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 164000
2015-03-13 10:05:18,220 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/_temporary/attempt_1426266260362_0003_m_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073741862_1038{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:05:18,225 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:05:18,227 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:05:18,230 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:05:18,233 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:60976, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0003_m_000002_0_-1717617226_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 172000
2015-03-13 10:05:18,264 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741862_1038 src: /127.0.0.1:60990 dest: /127.0.0.1:60696
2015-03-13 10:05:18,266 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741862_1038 src: /127.0.0.1:60991 dest: /127.0.0.1:60689
2015-03-13 10:05:18,267 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741862_1038 src: /127.0.0.1:60992 dest: /127.0.0.1:60686
2015-03-13 10:05:18,275 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60992, dest: /127.0.0.1:60686, bytes: 24, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0003_m_000000_0_1051762262_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741862_1038, duration: 6442000
2015-03-13 10:05:18,276 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741862_1038, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:18,276 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60991, dest: /127.0.0.1:60689, bytes: 24, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0003_m_000000_0_1051762262_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741862_1038, duration: 7699000
2015-03-13 10:05:18,277 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741862_1038, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:18,276 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741862_1038{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:18,278 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60990, dest: /127.0.0.1:60696, bytes: 24, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0003_m_000000_0_1051762262_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741862_1038, duration: 9507000
2015-03-13 10:05:18,278 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741862_1038, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:18,278 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741862_1038{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:18,279 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741862_1038{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:18,279 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/_temporary/attempt_1426266260362_0003_m_000002_0/part-00002. BP-1005356445-10.1.1.144-1426266257849 blk_1073741863_1039{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:05:18,284 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/_temporary/attempt_1426266260362_0003_m_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0003_m_000000_0_1051762262_1
2015-03-13 10:05:18,287 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:05:18,293 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:05:18,302 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:05:18,302 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/_temporary/attempt_1426266260362_0003_m_000000_0	dst=null	perm=null
2015-03-13 10:05:18,309 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/_temporary/attempt_1426266260362_0003_m_000000_0	dst=null	perm=null
2015-03-13 10:05:18,311 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/task_1426266260362_0003_m_000000	dst=null	perm=null
2015-03-13 10:05:18,313 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60994, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0003_m_000003_0_-1674850856_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 175000
2015-03-13 10:05:18,318 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/_temporary/attempt_1426266260362_0003_m_000000_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/task_1426266260362_0003_m_000000	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:05:18,320 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:05:18,322 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:05:18,326 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741863_1039 src: /127.0.0.1:60993 dest: /127.0.0.1:60693
2015-03-13 10:05:18,328 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741863_1039 src: /127.0.0.1:60995 dest: /127.0.0.1:60696
2015-03-13 10:05:18,330 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741863_1039 src: /127.0.0.1:60996 dest: /127.0.0.1:60689
2015-03-13 10:05:18,332 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0003_01_000002
2015-03-13 10:05:18,332 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0003	CONTAINERID=container_1426266260362_0003_01_000002
2015-03-13 10:05:18,332 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:05:18,332 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0003_01_000002
2015-03-13 10:05:18,333 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:05:18,333 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:18,333 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:18,333 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:18,346 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:05:18,346 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60996, dest: /127.0.0.1:60689, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0003_m_000002_0_-1717617226_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741863_1039, duration: 14945000
2015-03-13 10:05:18,347 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741863_1039, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:18,346 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0003_01_000002 is : 143
2015-03-13 10:05:18,348 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60995, dest: /127.0.0.1:60696, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0003_m_000002_0_-1717617226_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741863_1039, duration: 16601000
2015-03-13 10:05:18,348 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741863_1039{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:18,348 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741863_1039, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:18,349 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60993, dest: /127.0.0.1:60693, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0003_m_000002_0_-1717617226_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741863_1039, duration: 17835000
2015-03-13 10:05:18,349 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741863_1039, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:18,350 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741863_1039{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:18,351 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741863_1039{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:18,359 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:05:18,360 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000002
2015-03-13 10:05:18,360 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000002
2015-03-13 10:05:18,360 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000002
2015-03-13 10:05:18,361 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000002
2015-03-13 10:05:18,360 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0003	CONTAINERID=container_1426266260362_0003_01_000002
2015-03-13 10:05:18,361 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:05:18,361 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0003_01_000002 from application application_1426266260362_0003
2015-03-13 10:05:18,361 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:18,362 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0003
2015-03-13 10:05:18,365 INFO  namenode.FSEditLog (FSEditLog.java:printStatistics(663)) - Number of transactions: 338 Total time for transactions(ms): 23 Number of transactions batched in Syncs: 0 Number of syncs: 174 SyncTimes(ms): 63 37 
2015-03-13 10:05:18,366 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/_temporary/attempt_1426266260362_0003_m_000002_0/part-00002 is closed by DFSClient_attempt_1426266260362_0003_m_000002_0_-1717617226_1
2015-03-13 10:05:18,369 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:60997, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0003_m_000003_0_-1674850856_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 160000
2015-03-13 10:05:18,375 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/_temporary/attempt_1426266260362_0003_m_000002_0	dst=null	perm=null
2015-03-13 10:05:18,381 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/_temporary/attempt_1426266260362_0003_m_000002_0	dst=null	perm=null
2015-03-13 10:05:18,382 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/task_1426266260362_0003_m_000002	dst=null	perm=null
2015-03-13 10:05:18,386 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/_temporary/attempt_1426266260362_0003_m_000002_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/task_1426266260362_0003_m_000002	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:05:18,396 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:05:18,399 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0003_01_000004
2015-03-13 10:05:18,399 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0003	CONTAINERID=container_1426266260362_0003_01_000004
2015-03-13 10:05:18,399 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:05:18,399 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0003_01_000004
2015-03-13 10:05:18,399 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:05:18,399 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0003_01_000002
2015-03-13 10:05:18,400 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:18,399 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/_temporary/attempt_1426266260362_0003_m_000003_0/part-00003. BP-1005356445-10.1.1.144-1426266257849 blk_1073741864_1040{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:05:18,400 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:05:18,400 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:18,401 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0003_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:05:18,401 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0003_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:05:18,401 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0003	CONTAINERID=container_1426266260362_0003_01_000002
2015-03-13 10:05:18,401 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0003_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:05:18,401 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:05:18,401 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0003_01_000002, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:18,401 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:18,402 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:05:18,402 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0003_000001 released container container_1426266260362_0003_01_000002 on node: host: 10.1.1.144:60723 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:05:18,412 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0003_01_000004 is : 143
2015-03-13 10:05:18,414 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:05:18,420 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:05:18,425 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:60979, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0003_m_000001_0_-1679870296_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 190000
2015-03-13 10:05:18,427 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:05:18,427 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000004
2015-03-13 10:05:18,427 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000004
2015-03-13 10:05:18,428 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000004
2015-03-13 10:05:18,430 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000004
2015-03-13 10:05:18,430 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0003	CONTAINERID=container_1426266260362_0003_01_000004
2015-03-13 10:05:18,430 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:05:18,431 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0003_01_000004 from application application_1426266260362_0003
2015-03-13 10:05:18,431 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:18,431 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0003
2015-03-13 10:05:18,433 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:05:18,434 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:05:18,437 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:05:18,440 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60999, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0003_m_000001_0_-1679870296_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 184000
2015-03-13 10:05:18,445 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741864_1040 src: /127.0.0.1:60998 dest: /127.0.0.1:60686
2015-03-13 10:05:18,446 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741864_1040 src: /127.0.0.1:61000 dest: /127.0.0.1:60693
2015-03-13 10:05:18,447 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741864_1040 src: /127.0.0.1:61001 dest: /127.0.0.1:60689
2015-03-13 10:05:18,455 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61001, dest: /127.0.0.1:60689, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0003_m_000003_0_-1674850856_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741864_1040, duration: 6253000
2015-03-13 10:05:18,456 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741864_1040, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:18,456 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741864_1040{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:18,456 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61000, dest: /127.0.0.1:60693, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0003_m_000003_0_-1674850856_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741864_1040, duration: 7304000
2015-03-13 10:05:18,457 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741864_1040, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:18,457 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60998, dest: /127.0.0.1:60686, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0003_m_000003_0_-1674850856_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741864_1040, duration: 8245000
2015-03-13 10:05:18,457 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741864_1040{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:18,457 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741864_1040, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:18,458 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741864_1040{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:18,463 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/_temporary/attempt_1426266260362_0003_m_000003_0/part-00003 is closed by DFSClient_attempt_1426266260362_0003_m_000003_0_-1674850856_1
2015-03-13 10:05:18,466 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/_temporary/attempt_1426266260362_0003_m_000001_0/part-00001. BP-1005356445-10.1.1.144-1426266257849 blk_1073741865_1041{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:05:18,471 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/_temporary/attempt_1426266260362_0003_m_000003_0	dst=null	perm=null
2015-03-13 10:05:18,477 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/_temporary/attempt_1426266260362_0003_m_000003_0	dst=null	perm=null
2015-03-13 10:05:18,480 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/task_1426266260362_0003_m_000003	dst=null	perm=null
2015-03-13 10:05:18,484 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/_temporary/attempt_1426266260362_0003_m_000003_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/task_1426266260362_0003_m_000003	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:05:18,498 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0003_01_000005
2015-03-13 10:05:18,498 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0003	CONTAINERID=container_1426266260362_0003_01_000005
2015-03-13 10:05:18,498 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:05:18,499 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:18,499 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0003_01_000005
2015-03-13 10:05:18,499 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:05:18,499 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0003_01_000004
2015-03-13 10:05:18,499 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:05:18,500 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0003_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:05:18,500 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0003_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:05:18,500 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0003	CONTAINERID=container_1426266260362_0003_01_000004
2015-03-13 10:05:18,500 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0003_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:05:18,500 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:05:18,501 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0003_01_000004, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:18,501 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:18,501 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:05:18,501 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0003_000001 released container container_1426266260362_0003_01_000004 on node: host: 10.1.1.144:60723 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:05:18,513 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0003_01_000005 is : 143
2015-03-13 10:05:18,520 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741865_1041 src: /127.0.0.1:61002 dest: /127.0.0.1:60696
2015-03-13 10:05:18,521 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741865_1041 src: /127.0.0.1:61003 dest: /127.0.0.1:60689
2015-03-13 10:05:18,523 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741865_1041 src: /127.0.0.1:61004 dest: /127.0.0.1:60693
2015-03-13 10:05:18,528 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:05:18,529 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000005
2015-03-13 10:05:18,529 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000005
2015-03-13 10:05:18,530 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000005
2015-03-13 10:05:18,530 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000005
2015-03-13 10:05:18,530 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0003	CONTAINERID=container_1426266260362_0003_01_000005
2015-03-13 10:05:18,530 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:05:18,531 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61004, dest: /127.0.0.1:60693, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0003_m_000001_0_-1679870296_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741865_1041, duration: 7075000
2015-03-13 10:05:18,532 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741865_1041, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:18,532 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741865_1041{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:18,532 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61003, dest: /127.0.0.1:60689, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0003_m_000001_0_-1679870296_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741865_1041, duration: 8005000
2015-03-13 10:05:18,532 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0003_01_000005 from application application_1426266260362_0003
2015-03-13 10:05:18,533 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61002, dest: /127.0.0.1:60696, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0003_m_000001_0_-1679870296_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741865_1041, duration: 8823000
2015-03-13 10:05:18,533 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741865_1041{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:18,533 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741865_1041, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:18,534 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741865_1041{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:18,534 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741865_1041, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:18,533 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:18,534 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0003
2015-03-13 10:05:18,539 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/_temporary/attempt_1426266260362_0003_m_000001_0/part-00001 is closed by DFSClient_attempt_1426266260362_0003_m_000001_0_-1679870296_1
2015-03-13 10:05:18,547 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/_temporary/attempt_1426266260362_0003_m_000001_0	dst=null	perm=null
2015-03-13 10:05:18,553 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/_temporary/attempt_1426266260362_0003_m_000001_0	dst=null	perm=null
2015-03-13 10:05:18,554 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/task_1426266260362_0003_m_000001	dst=null	perm=null
2015-03-13 10:05:18,558 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/_temporary/attempt_1426266260362_0003_m_000001_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/task_1426266260362_0003_m_000001	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:05:18,569 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0003_01_000003
2015-03-13 10:05:18,569 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0003	CONTAINERID=container_1426266260362_0003_01_000003
2015-03-13 10:05:18,569 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:05:18,569 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0003_01_000003
2015-03-13 10:05:18,570 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:05:18,570 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:05:18,570 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0003_01_000005
2015-03-13 10:05:18,571 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0003_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:05:18,571 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0003_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:05:18,571 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0003	CONTAINERID=container_1426266260362_0003_01_000005
2015-03-13 10:05:18,571 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0003_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:05:18,571 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:05:18,571 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0003_01_000005, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:18,571 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:18,571 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:05:18,572 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0003_000001 released container container_1426266260362_0003_01_000005 on node: host: 10.1.1.144:60723 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:05:18,573 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:18,576 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_1042308078_1
2015-03-13 10:05:18,579 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1	dst=null	perm=null
2015-03-13 10:05:18,581 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0003_01_000003 is : 143
2015-03-13 10:05:18,586 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost	dst=null	perm=null
2015-03-13 10:05:18,587 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost	dst=null	perm=null
2015-03-13 10:05:18,588 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/task_1426266260362_0003_m_000000	dst=null	perm=null
2015-03-13 10:05:18,590 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00000	dst=null	perm=null
2015-03-13 10:05:18,593 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/task_1426266260362_0003_m_000000/part-00000	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:18,595 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:05:18,595 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000003
2015-03-13 10:05:18,596 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000003
2015-03-13 10:05:18,596 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost	dst=null	perm=null
2015-03-13 10:05:18,596 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000003
2015-03-13 10:05:18,597 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000003
2015-03-13 10:05:18,597 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0003	CONTAINERID=container_1426266260362_0003_01_000003
2015-03-13 10:05:18,597 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:05:18,597 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0003_01_000003 from application application_1426266260362_0003
2015-03-13 10:05:18,598 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost	dst=null	perm=null
2015-03-13 10:05:18,600 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:18,601 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/task_1426266260362_0003_m_000001	dst=null	perm=null
2015-03-13 10:05:18,602 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0003
2015-03-13 10:05:18,605 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00001	dst=null	perm=null
2015-03-13 10:05:18,607 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/task_1426266260362_0003_m_000001/part-00001	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00001	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:18,608 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost	dst=null	perm=null
2015-03-13 10:05:18,610 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost	dst=null	perm=null
2015-03-13 10:05:18,611 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/task_1426266260362_0003_m_000002	dst=null	perm=null
2015-03-13 10:05:18,612 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00002	dst=null	perm=null
2015-03-13 10:05:18,614 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/task_1426266260362_0003_m_000002/part-00002	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00002	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:18,616 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost	dst=null	perm=null
2015-03-13 10:05:18,617 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost	dst=null	perm=null
2015-03-13 10:05:18,618 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/task_1426266260362_0003_m_000003	dst=null	perm=null
2015-03-13 10:05:18,619 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00003	dst=null	perm=null
2015-03-13 10:05:18,621 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/task_1426266260362_0003_m_000003/part-00003	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00003	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:18,622 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost	dst=null	perm=null
2015-03-13 10:05:18,623 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost	dst=null	perm=null
2015-03-13 10:05:18,624 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/task_1426266260362_0003_m_000004	dst=null	perm=null
2015-03-13 10:05:18,626 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00004	dst=null	perm=null
2015-03-13 10:05:18,627 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/task_1426266260362_0003_m_000004/part-00004	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00004	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:18,634 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary	dst=null	perm=null
2015-03-13 10:05:18,638 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:18,641 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_SUCCESS is closed by DFSClient_NONMAPREDUCE_1042308078_1
2015-03-13 10:05:18,644 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:18,646 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_1042308078_1
2015-03-13 10:05:18,660 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60986, dest: /127.0.0.1:60696, bytes: 53247, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1042308078_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741861_1037, duration: 605647000
2015-03-13 10:05:18,660 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741861_1037, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:18,661 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741861_1037{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:05:18,661 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60985, dest: /127.0.0.1:60693, bytes: 53247, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1042308078_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741861_1037, duration: 606779000
2015-03-13 10:05:18,662 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741861_1037, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:18,662 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741861_1037{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:05:18,663 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60984, dest: /127.0.0.1:60689, bytes: 53247, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1042308078_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741861_1037, duration: 608324000
2015-03-13 10:05:18,663 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741861_1037, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:18,663 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741861_1037{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:05:18,665 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job_1426266260362_0003_1.jhist is closed by DFSClient_NONMAPREDUCE_1042308078_1
2015-03-13 10:05:18,668 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0003.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:18,670 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0003.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741866_1042{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:05:18,672 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741866_1042 src: /127.0.0.1:61005 dest: /127.0.0.1:60693
2015-03-13 10:05:18,674 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741866_1042 src: /127.0.0.1:61006 dest: /127.0.0.1:60689
2015-03-13 10:05:18,675 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741866_1042 src: /127.0.0.1:61007 dest: /127.0.0.1:60686
2015-03-13 10:05:18,678 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61007, dest: /127.0.0.1:60686, bytes: 448, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1042308078_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741866_1042, duration: 1220000
2015-03-13 10:05:18,678 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741866_1042, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:18,678 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741866_1042{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:18,678 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61006, dest: /127.0.0.1:60689, bytes: 448, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1042308078_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741866_1042, duration: 1630000
2015-03-13 10:05:18,679 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741866_1042, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:18,679 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741866_1042{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:18,679 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61005, dest: /127.0.0.1:60693, bytes: 448, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1042308078_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741866_1042, duration: 2499000
2015-03-13 10:05:18,680 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741866_1042, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:18,680 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741866_1042{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:18,681 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0003.summary_tmp is closed by DFSClient_NONMAPREDUCE_1042308078_1
2015-03-13 10:05:18,685 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0003.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:05:18,689 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job_1426266260362_0003_1.jhist	dst=null	perm=null
2015-03-13 10:05:18,690 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0003-1426266303375-soberoi-%5BB229A65FB52F476791CA626E2F4F95DF%2F98FC3601A29C48A6-1426266318647-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:05:18,694 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job_1426266260362_0003_1.jhist	dst=null	perm=null
2015-03-13 10:05:18,696 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0003-1426266303375-soberoi-%5BB229A65FB52F476791CA626E2F4F95DF%2F98FC3601A29C48A6-1426266318647-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:05:18,697 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job_1426266260362_0003_1.jhist	dst=null	perm=null
2015-03-13 10:05:18,700 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0003-1426266303375-soberoi-%5BB229A65FB52F476791CA626E2F4F95DF%2F98FC3601A29C48A6-1426266318647-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:18,702 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61008, bytes: 53663, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1042308078_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741861_1037, duration: 215000
2015-03-13 10:05:18,704 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0003-1426266303375-soberoi-%5BB229A65FB52F476791CA626E2F4F95DF%2F98FC3601A29C48A6-1426266318647-5-0-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741867_1043{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:05:18,706 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741867_1043 src: /127.0.0.1:61009 dest: /127.0.0.1:60696
2015-03-13 10:05:18,708 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741867_1043 src: /127.0.0.1:61010 dest: /127.0.0.1:60686
2015-03-13 10:05:18,709 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741867_1043 src: /127.0.0.1:61011 dest: /127.0.0.1:60693
2015-03-13 10:05:18,713 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61011, dest: /127.0.0.1:60693, bytes: 53247, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1042308078_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741867_1043, duration: 1976000
2015-03-13 10:05:18,713 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741867_1043, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:18,713 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741867_1043{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:18,714 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61010, dest: /127.0.0.1:60686, bytes: 53247, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1042308078_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741867_1043, duration: 2658000
2015-03-13 10:05:18,714 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741867_1043, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:18,714 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741867_1043{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:18,714 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61009, dest: /127.0.0.1:60696, bytes: 53247, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1042308078_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741867_1043, duration: 3498000
2015-03-13 10:05:18,715 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741867_1043, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:18,715 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741867_1043{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:18,716 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0003-1426266303375-soberoi-%5BB229A65FB52F476791CA626E2F4F95DF%2F98FC3601A29C48A6-1426266318647-5-0-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_1042308078_1
2015-03-13 10:05:18,718 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0003-1426266303375-soberoi-%5BB229A65FB52F476791CA626E2F4F95DF%2F98FC3601A29C48A6-1426266318647-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:05:18,719 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job_1426266260362_0003_1_conf.xml	dst=null	perm=null
2015-03-13 10:05:18,720 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0003_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:05:18,721 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job_1426266260362_0003_1_conf.xml	dst=null	perm=null
2015-03-13 10:05:18,722 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0003_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:05:18,723 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job_1426266260362_0003_1_conf.xml	dst=null	perm=null
2015-03-13 10:05:18,725 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0003_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:18,727 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61012, bytes: 92430, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1042308078_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741860_1036, duration: 340000
2015-03-13 10:05:18,729 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0003_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741868_1044{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:05:18,731 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741868_1044 src: /127.0.0.1:61013 dest: /127.0.0.1:60696
2015-03-13 10:05:18,732 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741868_1044 src: /127.0.0.1:61014 dest: /127.0.0.1:60686
2015-03-13 10:05:18,733 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741868_1044 src: /127.0.0.1:61015 dest: /127.0.0.1:60689
2015-03-13 10:05:18,736 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61015, dest: /127.0.0.1:60689, bytes: 91710, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1042308078_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741868_1044, duration: 1906000
2015-03-13 10:05:18,737 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741868_1044, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:18,737 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741868_1044{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:18,737 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61014, dest: /127.0.0.1:60686, bytes: 91710, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1042308078_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741868_1044, duration: 2497000
2015-03-13 10:05:18,738 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741868_1044, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:18,738 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741868_1044{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:18,738 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61013, dest: /127.0.0.1:60696, bytes: 91710, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1042308078_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741868_1044, duration: 3542000
2015-03-13 10:05:18,739 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741868_1044, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:18,739 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741868_1044{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:18,740 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0003_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_1042308078_1
2015-03-13 10:05:18,742 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0003_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:05:18,744 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0003.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0003.summary	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:05:18,746 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0003_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0003_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:05:18,748 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0003-1426266303375-soberoi-%5BB229A65FB52F476791CA626E2F4F95DF%2F98FC3601A29C48A6-1426266318647-5-0-SUCCEEDED-default.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0003-1426266303375-soberoi-%5BB229A65FB52F476791CA626E2F4F95DF%2F98FC3601A29C48A6-1426266318647-5-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:05:18,756 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0003_000001 State change from RUNNING to FINISHING
2015-03-13 10:05:18,756 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0003
2015-03-13 10:05:18,756 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0003 State change from RUNNING to REMOVING
2015-03-13 10:05:18,756 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0003
2015-03-13 10:05:18,756 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0003 State change from REMOVING to FINISHING
2015-03-13 10:05:19,039 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:19,040 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:05:19,040 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0003_01_000006
2015-03-13 10:05:19,041 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0003_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:05:19,041 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0003_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:05:19,041 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0003	CONTAINERID=container_1426266260362_0003_01_000006
2015-03-13 10:05:19,041 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0003_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:05:19,041 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:05:19,041 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0003_01_000006, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:19,041 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:19,042 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:05:19,042 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0003_000001 released container container_1426266260362_0003_01_000006 on node: host: 10.1.1.144:60711 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:05:19,296 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741862_1038
2015-03-13 10:05:19,297 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741867_1043
2015-03-13 10:05:19,298 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741868_1044
2015-03-13 10:05:19,298 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741864_1040
2015-03-13 10:05:19,299 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741866_1042
2015-03-13 10:05:19,511 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741861_1037
2015-03-13 10:05:19,511 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741865_1041
2015-03-13 10:05:19,512 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741866_1042
2015-03-13 10:05:19,512 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741863_1039
2015-03-13 10:05:19,513 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741864_1040
2015-03-13 10:05:19,513 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741867_1043
2015-03-13 10:05:19,523 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741865_1041
2015-03-13 10:05:19,524 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741866_1042
2015-03-13 10:05:19,524 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741862_1038
2015-03-13 10:05:19,525 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741861_1037
2015-03-13 10:05:19,525 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741863_1039
2015-03-13 10:05:19,526 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741864_1040
2015-03-13 10:05:19,526 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741868_1044
2015-03-13 10:05:19,572 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:05:19,572 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0003_01_000003
2015-03-13 10:05:19,573 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0003_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:05:19,573 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0003_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:05:19,573 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0003	CONTAINERID=container_1426266260362_0003_01_000003
2015-03-13 10:05:19,574 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0003_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:05:19,574 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:05:19,574 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0003_01_000003, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:19,574 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:19,574 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:05:19,575 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0003_000001 released container container_1426266260362_0003_01_000003 on node: host: 10.1.1.144:60723 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:05:19,764 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741856_1032 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60693 
2015-03-13 10:05:19,764 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741857_1033 127.0.0.1:60693 127.0.0.1:60689 127.0.0.1:60686 127.0.0.1:60696 
2015-03-13 10:05:19,764 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741858_1034 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60689 
2015-03-13 10:05:19,765 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741859_1035 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60689 
2015-03-13 10:05:19,765 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741861_1037 127.0.0.1:60689 127.0.0.1:60693 127.0.0.1:60696 
2015-03-13 10:05:19,765 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741860_1036 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60689 
2015-03-13 10:05:19,765 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003	dst=null	perm=null
2015-03-13 10:05:19,803 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741852_1028 127.0.0.1:60689 127.0.0.1:60686 127.0.0.1:60693 
2015-03-13 10:05:19,803 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741851_1027 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60689 
2015-03-13 10:05:19,803 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741848_1024 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60689 
2015-03-13 10:05:19,803 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741847_1023 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60689 
2015-03-13 10:05:19,804 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741849_1025 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60696 
2015-03-13 10:05:19,804 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833	dst=null	perm=null
2015-03-13 10:05:19,805 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost	dst=null	perm=null
2015-03-13 10:05:19,805 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary
2015-03-13 10:05:19,806 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary	dst=null	perm=null
2015-03-13 10:05:19,814 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:05:19,815 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:05:19,816 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:05:19,817 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost	dst=null	perm=null
2015-03-13 10:05:19,818 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost	dst=null	perm=null
2015-03-13 10:05:19,819 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost	dst=null	perm=null
2015-03-13 10:05:19,820 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:05:19,821 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00000	dst=null	perm=null
2015-03-13 10:05:19,823 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61017, bytes: 28, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741862_1038, duration: 141000
2015-03-13 10:05:19,824 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00001	dst=null	perm=null
2015-03-13 10:05:19,825 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61017, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741865_1041, duration: 130000
2015-03-13 10:05:19,826 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00002	dst=null	perm=null
2015-03-13 10:05:19,828 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61018, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741863_1039, duration: 131000
2015-03-13 10:05:19,829 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00003	dst=null	perm=null
2015-03-13 10:05:19,831 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61019, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741864_1040, duration: 137000
2015-03-13 10:05:19,832 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00004	dst=null	perm=null
2015-03-13 10:05:19,840 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:05:19,841 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:05:19,842 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:05:19,843 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost	dst=null	perm=null
2015-03-13 10:05:19,844 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost	dst=null	perm=null
2015-03-13 10:05:19,844 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost	dst=null	perm=null
2015-03-13 10:05:19,846 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:05:19,847 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00000	dst=null	perm=null
2015-03-13 10:05:19,849 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61017, bytes: 28, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741862_1038, duration: 175000
2015-03-13 10:05:19,849 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00001	dst=null	perm=null
2015-03-13 10:05:19,850 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61017, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741865_1041, duration: 150000
2015-03-13 10:05:19,851 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00002	dst=null	perm=null
2015-03-13 10:05:19,853 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61019, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741863_1039, duration: 176000
2015-03-13 10:05:19,853 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00003	dst=null	perm=null
2015-03-13 10:05:19,855 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61020, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741864_1040, duration: 195000
2015-03-13 10:05:19,856 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00004	dst=null	perm=null
2015-03-13 10:05:19,856 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost
2015-03-13 10:05:19,857 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost	dst=null	perm=null
2015-03-13 10:05:19,857 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost	dst=null	perm=null
2015-03-13 10:05:19,858 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost	dst=null	perm=null
2015-03-13 10:05:19,859 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost	dst=null	perm=null
2015-03-13 10:05:19,860 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00000	dst=null	perm=null
2015-03-13 10:05:19,861 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00000	dst=null	perm=null
2015-03-13 10:05:19,862 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61018, bytes: 28, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741862_1038, duration: 192000
2015-03-13 10:05:19,863 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00001	dst=null	perm=null
2015-03-13 10:05:19,863 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00001	dst=null	perm=null
2015-03-13 10:05:19,865 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61018, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741865_1041, duration: 209000
2015-03-13 10:05:19,865 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00002	dst=null	perm=null
2015-03-13 10:05:19,866 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00002	dst=null	perm=null
2015-03-13 10:05:19,868 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61017, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741863_1039, duration: 175000
2015-03-13 10:05:19,868 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00003	dst=null	perm=null
2015-03-13 10:05:19,869 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00003	dst=null	perm=null
2015-03-13 10:05:19,870 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61019, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741864_1040, duration: 182000
2015-03-13 10:05:19,871 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00004	dst=null	perm=null
2015-03-13 10:05:19,872 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00004	dst=null	perm=null
2015-03-13 10:05:19,873 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:05:19,874 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:05:19,885 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:05:19,887 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741867_1043
2015-03-13 10:05:19,887 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741865_1041
2015-03-13 10:05:19,887 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741863_1039
2015-03-13 10:05:19,887 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:05:19,888 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:05:19,888 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741868_1044
2015-03-13 10:05:19,888 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741861_1037
2015-03-13 10:05:19,889 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741862_1038
2015-03-13 10:05:19,909 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes	dst=null	perm=null
2015-03-13 10:05:19,911 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [tail] starting
2015-03-13 10:05:19,911 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [tail]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt"]
2015-03-13 10:05:19,911 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [tail]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-03-13 10:05:19,911 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [tail]  sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes"]
2015-03-13 10:05:19,912 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [tail]  parallel execution is enabled: true
2015-03-13 10:05:19,912 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [tail]  starting jobs: 1
2015-03-13 10:05:19,912 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [tail]  allocating threads: 1
2015-03-13 10:05:19,913 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [tail] starting step: (1/1) ...ipesplatform/renamedpipes
2015-03-13 10:05:19,921 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:05:19,930 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:05:19,931 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes	dst=null	perm=null
2015-03-13 10:05:19,932 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:05:19,933 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:05:19,935 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 4
2015-03-13 10:05:19,936 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004	dst=null	perm=null
2015-03-13 10:05:19,938 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004	dst=null	perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:05:19,939 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004	dst=null	perm=soberoi:supergroup:rwx------
2015-03-13 10:05:19,940 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.jar	dst=null	perm=null
2015-03-13 10:05:19,942 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:19,944 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073741869_1045{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:05:19,945 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741869_1045 src: /127.0.0.1:61022 dest: /127.0.0.1:60689
2015-03-13 10:05:19,946 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741869_1045 src: /127.0.0.1:61023 dest: /127.0.0.1:60696
2015-03-13 10:05:19,947 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741869_1045 src: /127.0.0.1:61024 dest: /127.0.0.1:60693
2015-03-13 10:05:19,951 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61024, dest: /127.0.0.1:60693, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741869_1045, duration: 2822000
2015-03-13 10:05:19,952 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741869_1045, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:19,952 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741869_1045{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:19,952 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61023, dest: /127.0.0.1:60696, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741869_1045, duration: 2873000
2015-03-13 10:05:19,952 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741869_1045, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:19,953 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741869_1045{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:19,953 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61022, dest: /127.0.0.1:60689, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741869_1045, duration: 4334000
2015-03-13 10:05:19,953 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741869_1045, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:19,954 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741869_1045{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:19,955 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:05:19,956 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.jar
2015-03-13 10:05:19,957 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.jar	dst=null	perm=null
2015-03-13 10:05:19,958 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:19,959 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:05:19,960 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:05:19,961 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:05:19,962 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:05:19,963 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:05:19,964 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:05:19,965 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:05:19,965 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:05:19,966 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:05:19,968 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:05:19,968 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:05:19,969 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:05:19,971 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:19,972 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:19,973 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.split
2015-03-13 10:05:19,973 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.split	dst=null	perm=null
2015-03-13 10:05:19,975 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073741870_1046{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:05:19,976 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741870_1046 src: /127.0.0.1:61025 dest: /127.0.0.1:60689
2015-03-13 10:05:19,977 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741870_1046 src: /127.0.0.1:61026 dest: /127.0.0.1:60693
2015-03-13 10:05:19,978 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741870_1046 src: /127.0.0.1:61027 dest: /127.0.0.1:60696
2015-03-13 10:05:19,979 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741870_1046 src: /127.0.0.1:61028 dest: /127.0.0.1:60686
2015-03-13 10:05:19,982 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61028, dest: /127.0.0.1:60686, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741870_1046, duration: 1640000
2015-03-13 10:05:19,982 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741870_1046, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:19,983 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741870_1046{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:19,983 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61027, dest: /127.0.0.1:60696, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741870_1046, duration: 2043000
2015-03-13 10:05:19,983 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741870_1046, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:19,983 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61026, dest: /127.0.0.1:60693, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741870_1046, duration: 2797000
2015-03-13 10:05:19,983 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741870_1046{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:19,984 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741870_1046, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:19,984 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741870_1046{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:19,984 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61025, dest: /127.0.0.1:60689, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741870_1046, duration: 3646000
2015-03-13 10:05:19,985 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741870_1046, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:19,988 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741870_1046{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:19,989 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:05:19,990 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:19,992 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:19,994 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073741871_1047{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:05:19,995 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741871_1047 src: /127.0.0.1:61029 dest: /127.0.0.1:60693
2015-03-13 10:05:19,997 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741871_1047 src: /127.0.0.1:61030 dest: /127.0.0.1:60696
2015-03-13 10:05:19,998 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741871_1047 src: /127.0.0.1:61031 dest: /127.0.0.1:60689
2015-03-13 10:05:20,002 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61031, dest: /127.0.0.1:60689, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741871_1047, duration: 1444000
2015-03-13 10:05:20,002 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741871_1047, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:20,003 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741871_1047{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:20,003 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61030, dest: /127.0.0.1:60696, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741871_1047, duration: 2256000
2015-03-13 10:05:20,003 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741871_1047, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:20,003 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741871_1047{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:20,004 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61029, dest: /127.0.0.1:60693, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741871_1047, duration: 3580000
2015-03-13 10:05:20,004 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741871_1047, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:20,005 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741871_1047{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:20,006 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:05:20,007 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:05:20,008 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:20,010 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:20,012 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:05:20,012 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:05:20,013 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:05:20,021 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073741872_1048{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:05:20,023 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741872_1048 src: /127.0.0.1:61032 dest: /127.0.0.1:60689
2015-03-13 10:05:20,024 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741872_1048 src: /127.0.0.1:61033 dest: /127.0.0.1:60686
2015-03-13 10:05:20,025 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741872_1048 src: /127.0.0.1:61034 dest: /127.0.0.1:60693
2015-03-13 10:05:20,028 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61034, dest: /127.0.0.1:60693, bytes: 97850, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741872_1048, duration: 1772000
2015-03-13 10:05:20,028 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741872_1048, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:20,029 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61033, dest: /127.0.0.1:60686, bytes: 97850, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741872_1048, duration: 2244000
2015-03-13 10:05:20,029 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741872_1048{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:20,029 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741872_1048, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:20,029 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741872_1048{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:20,029 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61032, dest: /127.0.0.1:60689, bytes: 97850, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741872_1048, duration: 3089000
2015-03-13 10:05:20,030 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741872_1048, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:20,031 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741872_1048{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:20,032 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:05:20,032 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0004
2015-03-13 10:05:20,033 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004	dst=null	perm=null
2015-03-13 10:05:20,034 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.xml	dst=null	perm=null
2015-03-13 10:05:20,034 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.xml	dst=null	perm=null
2015-03-13 10:05:20,035 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.jar	dst=null	perm=null
2015-03-13 10:05:20,036 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.jar	dst=null	perm=null
2015-03-13 10:05:20,036 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.split	dst=null	perm=null
2015-03-13 10:05:20,037 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.split	dst=null	perm=null
2015-03-13 10:05:20,038 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:05:20,038 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:05:20,040 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:05:20,041 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:20,041 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:05:20,042 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:05:20,043 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:05:20,044 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:05:20,045 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:05:20,047 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 4 submitted by user soberoi
2015-03-13 10:05:20,047 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0004
2015-03-13 10:05:20,047 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	IP=10.1.1.144	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1426266260362_0004
2015-03-13 10:05:20,047 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0004
2015-03-13 10:05:20,047 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0004 State change from NEW to NEW_SAVING
2015-03-13 10:05:20,048 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0004 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:05:20,048 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0004_000001
2015-03-13 10:05:20,048 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0004_000001 State change from NEW to SUBMITTED
2015-03-13 10:05:20,048 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0004 from user: soberoi activated in queue: default
2015-03-13 10:05:20,049 INFO  capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0004 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:05:20,049 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0004 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:05:20,049 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0004 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:05:20,049 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0004_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:05:20,049 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0004_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:05:20,049 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0004 State change from SUBMITTED to ACCEPTED
2015-03-13 10:05:20,052 INFO  mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0004/
2015-03-13 10:05:20,052 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [tail] submitted hadoop job: job_1426266260362_0004
2015-03-13 10:05:20,052 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [tail] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0004/
2015-03-13 10:05:20,574 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0004_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:05:20,574 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0004	CONTAINERID=container_1426266260362_0004_01_000001
2015-03-13 10:05:20,575 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0004_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:05:20,575 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0004 container=Container: [ContainerId: container_1426266260362_0004_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0004_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:20,575 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:05:20,575 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:20,575 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0004_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:05:20,576 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0004 AttemptId: appattempt_1426266260362_0004_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0004_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ]
2015-03-13 10:05:20,576 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0004_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:05:20,577 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0004_000001
2015-03-13 10:05:20,577 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0004_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:05:20,577 INFO  amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0004_000001
2015-03-13 10:05:20,578 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0004_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] for AM appattempt_1426266260362_0004_000001
2015-03-13 10:05:20,578 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0004_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-03-13 10:05:20,581 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0004_000001 (auth:SIMPLE)
2015-03-13 10:05:20,583 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0004_01_000001 by user soberoi
2015-03-13 10:05:20,583 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0004
2015-03-13 10:05:20,583 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0004	CONTAINERID=container_1426266260362_0004_01_000001
2015-03-13 10:05:20,584 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0004 transitioned from NEW to INITING
2015-03-13 10:05:20,584 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0004_01_000001 to application application_1426266260362_0004
2015-03-13 10:05:20,584 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0004 transitioned from INITING to RUNNING
2015-03-13 10:05:20,584 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0004_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] for AM appattempt_1426266260362_0004_000001
2015-03-13 10:05:20,584 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:05:20,584 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0004_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:05:20,584 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0004
2015-03-13 10:05:20,585 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:05:20,585 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:05:20,585 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:05:20,585 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:05:20,585 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0004_01_000001
2015-03-13 10:05:20,595 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426266260362_0004_01_000001.tokens. Credentials list: 
2015-03-13 10:05:20,610 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:05:20,680 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426266260362_0004_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000001.tokens
2015-03-13 10:05:20,680 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0004 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0004
2015-03-13 10:05:20,743 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.jar	dst=null	perm=null
2015-03-13 10:05:20,744 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.jar	dst=null	perm=null
2015-03-13 10:05:20,745 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.jar	dst=null	perm=null
2015-03-13 10:05:20,751 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61017, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-828070478_2544, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741869_1045, duration: 510000
2015-03-13 10:05:20,769 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:05:20,786 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:05:20,786 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:05:20,787 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:05:20,793 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61019, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-828070478_2544, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741871_1047, duration: 174000
2015-03-13 10:05:20,806 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:05:20,823 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.split	dst=null	perm=null
2015-03-13 10:05:20,823 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.split	dst=null	perm=null
2015-03-13 10:05:20,824 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.split	dst=null	perm=null
2015-03-13 10:05:20,830 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61017, bytes: 1798, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-828070478_2544, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741870_1046, duration: 177000
2015-03-13 10:05:20,843 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:05:20,860 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.xml	dst=null	perm=null
2015-03-13 10:05:20,861 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.xml	dst=null	perm=null
2015-03-13 10:05:20,861 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.xml	dst=null	perm=null
2015-03-13 10:05:20,867 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61019, bytes: 98618, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-828070478_2544, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741872_1048, duration: 318000
2015-03-13 10:05:20,880 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:05:20,880 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:05:20,906 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:05:20,906 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:20,973 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000001/default_container_executor.sh]
2015-03-13 10:05:21,041 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:21,574 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:21,574 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0004_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:05:21,669 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60689 to replicate blk_1073741869_1045 to datanode(s) 127.0.0.1:60686
2015-03-13 10:05:21,669 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073741856_1032, blk_1073741857_1033, blk_1073741858_1034, blk_1073741859_1035, blk_1073741861_1037, blk_1073741847_1023, blk_1073741848_1024, blk_1073741849_1025, blk_1073741852_1028]
2015-03-13 10:05:21,669 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073741856_1032, blk_1073741857_1033, blk_1073741859_1035, blk_1073741860_1036, blk_1073741849_1025, blk_1073741851_1027, blk_1073741852_1028]
2015-03-13 10:05:22,048 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:22,341 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741856_1032 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741856 for deletion
2015-03-13 10:05:22,341 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741857_1033 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741857 for deletion
2015-03-13 10:05:22,341 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741859_1035 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741859 for deletion
2015-03-13 10:05:22,341 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741860_1036 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741860 for deletion
2015-03-13 10:05:22,341 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741856_1032 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741856
2015-03-13 10:05:22,342 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741859_1035 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741859
2015-03-13 10:05:22,342 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741857_1033 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741857
2015-03-13 10:05:22,341 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741849_1025 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741849 for deletion
2015-03-13 10:05:22,342 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741851_1027 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741851 for deletion
2015-03-13 10:05:22,342 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741860_1036 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741860
2015-03-13 10:05:22,342 INFO  datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-1172757413-10.1.1.144-60689-1426266259165, infoPort=60690, ipcPort=60692, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073741869_1045 to 127.0.0.1:60686 
2015-03-13 10:05:22,342 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741852_1028 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741852 for deletion
2015-03-13 10:05:22,343 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741849_1025 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741849
2015-03-13 10:05:22,342 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741851_1027 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741851
2015-03-13 10:05:22,343 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741852_1028 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741852
2015-03-13 10:05:22,344 INFO  datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073741869_1045 (numBytes=254067) to /127.0.0.1:60686
2015-03-13 10:05:22,345 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741869_1045 src: /127.0.0.1:61038 dest: /127.0.0.1:60686
2015-03-13 10:05:22,347 INFO  datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073741869_1045 src: /127.0.0.1:61038 dest: /127.0.0.1:60686 of size 254067
2015-03-13 10:05:22,352 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741869_1045 size 254067
2015-03-13 10:05:22,505 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741856_1032 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741856 for deletion
2015-03-13 10:05:22,505 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741857_1033 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741857 for deletion
2015-03-13 10:05:22,505 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741858_1034 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741858 for deletion
2015-03-13 10:05:22,505 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741859_1035 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741859 for deletion
2015-03-13 10:05:22,505 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741861_1037 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741861 for deletion
2015-03-13 10:05:22,505 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741857_1033 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741857
2015-03-13 10:05:22,505 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741847_1023 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741847 for deletion
2015-03-13 10:05:22,505 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741848_1024 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741848 for deletion
2015-03-13 10:05:22,506 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741859_1035 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741859
2015-03-13 10:05:22,506 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741849_1025 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741849 for deletion
2015-03-13 10:05:22,506 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741852_1028 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741852 for deletion
2015-03-13 10:05:22,506 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741861_1037 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741861
2015-03-13 10:05:22,505 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741856_1032 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741856
2015-03-13 10:05:22,506 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741849_1025 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741849
2015-03-13 10:05:22,506 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741858_1034 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741858
2015-03-13 10:05:22,507 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741847_1023 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741847
2015-03-13 10:05:22,507 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741848_1024 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741848
2015-03-13 10:05:22,507 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741852_1028 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741852
2015-03-13 10:05:22,516 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:05:22,537 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/COMMIT_STARTED	dst=null	perm=null
2015-03-13 10:05:22,538 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/COMMIT_SUCCESS	dst=null	perm=null
2015-03-13 10:05:22,539 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/COMMIT_FAIL	dst=null	perm=null
2015-03-13 10:05:22,574 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:22,591 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004	dst=null	perm=null
2015-03-13 10:05:22,592 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:05:22,593 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:05:22,872 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:05:22,879 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:05:22,936 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61040, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1084064864_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741871_1047, duration: 138000
2015-03-13 10:05:23,053 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:23,577 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:23,720 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0004_000001 (auth:SIMPLE)
2015-03-13 10:05:23,722 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0004_000001
2015-03-13 10:05:23,723 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi	IP=10.1.1.144	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1426266260362_0004	APPATTEMPTID=appattempt_1426266260362_0004_000001
2015-03-13 10:05:23,723 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0004_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:05:23,723 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0004 State change from ACCEPTED to RUNNING
2015-03-13 10:05:23,744 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job_1426266260362_0004_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:23,745 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:05:23,810 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job_1426266260362_0004_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:23,938 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job_1426266260362_0004_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073741873_1049{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:05:23,981 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741873_1049 src: /127.0.0.1:61046 dest: /127.0.0.1:60686
2015-03-13 10:05:23,983 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741873_1049 src: /127.0.0.1:61047 dest: /127.0.0.1:60689
2015-03-13 10:05:23,984 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741873_1049 src: /127.0.0.1:61048 dest: /127.0.0.1:60693
2015-03-13 10:05:23,992 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61048, dest: /127.0.0.1:60693, bytes: 90665, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1084064864_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741873_1049, duration: 6004000
2015-03-13 10:05:23,992 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741873_1049, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:23,993 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741873_1049{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:23,993 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61047, dest: /127.0.0.1:60689, bytes: 90665, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1084064864_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741873_1049, duration: 6920000
2015-03-13 10:05:23,993 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741873_1049, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:23,994 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741873_1049{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:23,994 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61046, dest: /127.0.0.1:60686, bytes: 90665, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1084064864_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741873_1049, duration: 7941000
2015-03-13 10:05:23,994 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741873_1049, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:23,994 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741873_1049{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:23,998 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job_1426266260362_0004_1_conf.xml is closed by DFSClient_NONMAPREDUCE_1084064864_1
2015-03-13 10:05:24,054 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:24,305 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741873_1049
2015-03-13 10:05:24,306 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741872_1048
2015-03-13 10:05:24,306 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741870_1046
2015-03-13 10:05:24,512 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741869_1045
2015-03-13 10:05:24,517 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741869_1045
2015-03-13 10:05:24,518 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741873_1049
2015-03-13 10:05:24,518 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741870_1046
2015-03-13 10:05:24,519 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741871_1047
2015-03-13 10:05:24,583 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:24,670 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073741856_1032, blk_1073741857_1033, blk_1073741858_1034, blk_1073741860_1036, blk_1073741861_1037, blk_1073741847_1023, blk_1073741848_1024, blk_1073741849_1025, blk_1073741851_1027]
2015-03-13 10:05:24,670 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073741856_1032, blk_1073741857_1033, blk_1073741858_1034, blk_1073741859_1035, blk_1073741860_1036, blk_1073741861_1037, blk_1073741847_1023, blk_1073741848_1024, blk_1073741851_1027, blk_1073741852_1028]
2015-03-13 10:05:24,723 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741872_1048
2015-03-13 10:05:24,729 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741869_1045
2015-03-13 10:05:24,730 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741870_1046
2015-03-13 10:05:24,730 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741871_1047
2015-03-13 10:05:24,731 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741873_1049
2015-03-13 10:05:24,762 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0004_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:05:24,763 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0004	CONTAINERID=container_1426266260362_0004_01_000002
2015-03-13 10:05:24,763 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0004_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:05:24,763 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0004 container=Container: [ContainerId: container_1426266260362_0004_01_000002, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0004_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:24,763 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:05:24,764 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:24,764 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0004_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:05:24,764 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0004	CONTAINERID=container_1426266260362_0004_01_000003
2015-03-13 10:05:24,765 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0004_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:05:24,765 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0004 container=Container: [ContainerId: container_1426266260362_0004_01_000003, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0004_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:24,765 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:05:24,766 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:24,766 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0004_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:05:24,766 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0004	CONTAINERID=container_1426266260362_0004_01_000004
2015-03-13 10:05:24,766 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0004_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:05:24,767 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0004 container=Container: [ContainerId: container_1426266260362_0004_01_000004, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0004_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:24,767 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:05:24,767 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:24,768 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0004_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:05:24,768 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0004	CONTAINERID=container_1426266260362_0004_01_000005
2015-03-13 10:05:24,768 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0004_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:05:24,768 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0004 container=Container: [ContainerId: container_1426266260362_0004_01_000005, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0004_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:24,768 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:05:24,768 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:24,808 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0004_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:05:24,808 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0004	CONTAINERID=container_1426266260362_0004_01_000006
2015-03-13 10:05:24,808 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0004_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:05:24,808 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0004 container=Container: [ContainerId: container_1426266260362_0004_01_000006, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0004_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:24,808 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7
2015-03-13 10:05:24,809 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:24,892 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741869_1045
2015-03-13 10:05:24,892 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741871_1047
2015-03-13 10:05:24,893 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741870_1046
2015-03-13 10:05:24,894 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0003_01_000001 succeeded 
2015-03-13 10:05:24,894 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:05:24,894 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0003_01_000001
2015-03-13 10:05:24,902 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000001
2015-03-13 10:05:24,902 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000001
2015-03-13 10:05:24,902 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0003	CONTAINERID=container_1426266260362_0003_01_000001
2015-03-13 10:05:24,902 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:05:24,902 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000001
2015-03-13 10:05:24,902 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000001
2015-03-13 10:05:24,902 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0003_01_000001 from application application_1426266260362_0003
2015-03-13 10:05:24,903 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:24,903 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0003
2015-03-13 10:05:24,931 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741872_1048
2015-03-13 10:05:25,056 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:05:25,056 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0003_01_000001
2015-03-13 10:05:25,057 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0003_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:05:25,057 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0003_000001
2015-03-13 10:05:25,057 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0003_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:05:25,057 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0003_000001 State change from FINISHING to FINISHED
2015-03-13 10:05:25,057 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0003	CONTAINERID=container_1426266260362_0003_01_000001
2015-03-13 10:05:25,058 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0003 State change from FINISHING to FINISHED
2015-03-13 10:05:25,058 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0003_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60711, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:05:25,058 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1426266260362_0003
2015-03-13 10:05:25,058 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:7168, vCores:6> numContainers=6 user=soberoi user-resources=<memory:7168, vCores:6>
2015-03-13 10:05:25,058 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0003,name=[B229A65FB52F476791CA626E2F4F95DF/98FC3601A29C48A6B4344FEFB9E0B80E] upper1*upper2*lower/(1/2) ...rm/joinaroundjoinleftmost,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0003/jobhistory/job/job_1426266260362_0003,appMasterHost=Edinburgh.local,startTime=1426266303375,finishTime=1426266318756,finalStatus=SUCCEEDED
2015-03-13 10:05:25,058 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0003_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:25,058 INFO  amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0003_000001
2015-03-13 10:05:25,059 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:25,059 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6
2015-03-13 10:05:25,059 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0003_000001 released container container_1426266260362_0003_01_000001 on node: host: 10.1.1.144:60711 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:05:25,059 INFO  capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0003_000001 is done. finalState=FINISHED
2015-03-13 10:05:25,059 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0003 requests cleared
2015-03-13 10:05:25,059 INFO  capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0003 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:05:25,060 INFO  capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0003 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:05:25,061 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0003_000001 (auth:SIMPLE)
2015-03-13 10:05:25,063 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0003_01_000001
2015-03-13 10:05:25,344 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741856_1032 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741856 for deletion
2015-03-13 10:05:25,345 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741857_1033 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741857 for deletion
2015-03-13 10:05:25,345 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741858_1034 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741858 for deletion
2015-03-13 10:05:25,345 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741859_1035 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741859 for deletion
2015-03-13 10:05:25,345 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741860_1036 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741860 for deletion
2015-03-13 10:05:25,345 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741856_1032 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741856
2015-03-13 10:05:25,346 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741861_1037 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741861 for deletion
2015-03-13 10:05:25,345 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741857_1033 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741857
2015-03-13 10:05:25,346 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741858_1034 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741858
2015-03-13 10:05:25,346 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741847_1023 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741847 for deletion
2015-03-13 10:05:25,346 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741859_1035 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741859
2015-03-13 10:05:25,346 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741860_1036 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741860
2015-03-13 10:05:25,346 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741848_1024 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741848 for deletion
2015-03-13 10:05:25,346 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741861_1037 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741861
2015-03-13 10:05:25,347 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741851_1027 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741851 for deletion
2015-03-13 10:05:25,347 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741848_1024 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741848
2015-03-13 10:05:25,347 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741847_1023 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741847
2015-03-13 10:05:25,347 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741852_1028 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741852 for deletion
2015-03-13 10:05:25,347 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741851_1027 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741851
2015-03-13 10:05:25,347 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741852_1028 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741852
2015-03-13 10:05:25,586 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:25,586 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0003 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:05:25,587 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0003
2015-03-13 10:05:25,587 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0003
2015-03-13 10:05:25,587 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0003
2015-03-13 10:05:25,587 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0003 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:05:25,588 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0003
2015-03-13 10:05:25,588 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0003
2015-03-13 10:05:25,588 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0003, with delay of 10800 seconds
2015-03-13 10:05:25,682 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741856_1032 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741856 for deletion
2015-03-13 10:05:25,682 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741857_1033 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741857 for deletion
2015-03-13 10:05:25,682 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741858_1034 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741858 for deletion
2015-03-13 10:05:25,682 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741856_1032 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741856
2015-03-13 10:05:25,683 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741857_1033 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741857
2015-03-13 10:05:25,683 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741860_1036 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741860 for deletion
2015-03-13 10:05:25,683 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741858_1034 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741858
2015-03-13 10:05:25,683 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741861_1037 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741861 for deletion
2015-03-13 10:05:25,683 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741860_1036 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741860
2015-03-13 10:05:25,684 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741847_1023 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741847 for deletion
2015-03-13 10:05:25,684 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741848_1024 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741848 for deletion
2015-03-13 10:05:25,684 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741861_1037 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741861
2015-03-13 10:05:25,684 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741849_1025 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741849 for deletion
2015-03-13 10:05:25,684 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741851_1027 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741851 for deletion
2015-03-13 10:05:25,684 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741847_1023 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741847
2015-03-13 10:05:25,685 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741849_1025 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741849
2015-03-13 10:05:25,685 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741848_1024 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741848
2015-03-13 10:05:25,685 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741851_1027 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741851
2015-03-13 10:05:25,762 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0004_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:05:25,762 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0004_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:05:25,762 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0004_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:05:25,762 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0004_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:05:25,763 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0004_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:05:25,791 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.jar	dst=null	perm=null
2015-03-13 10:05:25,792 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.jar	dst=null	perm=null
2015-03-13 10:05:25,800 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.xml	dst=null	perm=null
2015-03-13 10:05:25,801 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.xml	dst=null	perm=null
2015-03-13 10:05:25,803 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:05:25,804 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:05:25,810 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:05:25,811 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:05:25,812 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:05:25,814 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:05:25,887 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0004_000001 (auth:SIMPLE)
2015-03-13 10:05:25,887 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0004_000001 (auth:SIMPLE)
2015-03-13 10:05:25,891 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0004_01_000002 by user soberoi
2015-03-13 10:05:25,891 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0004
2015-03-13 10:05:25,891 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0004_01_000006 by user soberoi
2015-03-13 10:05:25,891 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0004_01_000004 by user soberoi
2015-03-13 10:05:25,892 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0004	CONTAINERID=container_1426266260362_0004_01_000002
2015-03-13 10:05:25,892 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0004	CONTAINERID=container_1426266260362_0004_01_000004
2015-03-13 10:05:25,891 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0004_01_000005 by user soberoi
2015-03-13 10:05:25,892 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0004_01_000003 by user soberoi
2015-03-13 10:05:25,891 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0004 transitioned from NEW to INITING
2015-03-13 10:05:25,892 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0004_01_000002 to application application_1426266260362_0004
2015-03-13 10:05:25,891 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0004
2015-03-13 10:05:25,893 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0004	CONTAINERID=container_1426266260362_0004_01_000006
2015-03-13 10:05:25,892 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0004_01_000004 to application application_1426266260362_0004
2015-03-13 10:05:25,893 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0004_01_000005 to application application_1426266260362_0004
2015-03-13 10:05:25,893 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0004_01_000003 to application application_1426266260362_0004
2015-03-13 10:05:25,894 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0004 transitioned from INITING to RUNNING
2015-03-13 10:05:25,892 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0004	CONTAINERID=container_1426266260362_0004_01_000003
2015-03-13 10:05:25,894 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:05:25,895 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:05:25,895 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:05:25,895 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:05:25,895 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0004
2015-03-13 10:05:25,895 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0004
2015-03-13 10:05:25,895 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:05:25,895 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0004
2015-03-13 10:05:25,896 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:05:25,896 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:05:25,896 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0004
2015-03-13 10:05:25,896 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0004
2015-03-13 10:05:25,896 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:05:25,896 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0004
2015-03-13 10:05:25,892 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0004	CONTAINERID=container_1426266260362_0004_01_000005
2015-03-13 10:05:25,897 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0004
2015-03-13 10:05:25,897 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0004
2015-03-13 10:05:25,897 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:05:25,897 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0004
2015-03-13 10:05:25,893 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0004 transitioned from NEW to INITING
2015-03-13 10:05:25,897 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0004_01_000006 to application application_1426266260362_0004
2015-03-13 10:05:25,897 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0004
2015-03-13 10:05:25,898 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0004
2015-03-13 10:05:25,898 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0004 transitioned from INITING to RUNNING
2015-03-13 10:05:25,898 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:05:25,898 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0004
2015-03-13 10:05:25,898 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:05:25,898 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0004
2015-03-13 10:05:25,898 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0004
2015-03-13 10:05:25,898 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:05:25,898 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0004
2015-03-13 10:05:25,899 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:05:25,899 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:05:25,899 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0004_01_000006
2015-03-13 10:05:25,898 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0004_01_000005
2015-03-13 10:05:25,900 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0004_01_000004
2015-03-13 10:05:25,901 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0004_01_000002
2015-03-13 10:05:25,902 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0004_01_000003
2015-03-13 10:05:25,921 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426266260362_0004_01_000004.tokens. Credentials list: 
2015-03-13 10:05:25,921 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0004_01_000006.tokens. Credentials list: 
2015-03-13 10:05:25,922 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0004_01_000005.tokens. Credentials list: 
2015-03-13 10:05:25,922 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426266260362_0004_01_000002.tokens. Credentials list: 
2015-03-13 10:05:25,923 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0004_01_000003.tokens. Credentials list: 
2015-03-13 10:05:25,939 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:05:25,939 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:05:26,017 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426266260362_0004_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000004.tokens
2015-03-13 10:05:26,017 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0004_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000006.tokens
2015-03-13 10:05:26,017 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0004 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0004
2015-03-13 10:05:26,017 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0004 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0004
2015-03-13 10:05:26,057 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0003 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:05:26,058 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0003
2015-03-13 10:05:26,058 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0003
2015-03-13 10:05:26,058 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0003 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:05:26,059 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0003, with delay of 10800 seconds
2015-03-13 10:05:26,059 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0003
2015-03-13 10:05:26,059 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0003
2015-03-13 10:05:26,059 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0003
2015-03-13 10:05:26,088 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.jar	dst=null	perm=null
2015-03-13 10:05:26,088 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.jar	dst=null	perm=null
2015-03-13 10:05:26,089 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.jar	dst=null	perm=null
2015-03-13 10:05:26,089 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.jar	dst=null	perm=null
2015-03-13 10:05:26,090 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.jar	dst=null	perm=null
2015-03-13 10:05:26,090 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.jar	dst=null	perm=null
2015-03-13 10:05:26,097 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61056, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_394532054_2693, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741869_1045, duration: 551000
2015-03-13 10:05:26,097 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61057, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1722350459_2692, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741869_1045, duration: 567000
2015-03-13 10:05:26,119 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:05:26,119 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:05:26,136 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.xml	dst=null	perm=null
2015-03-13 10:05:26,136 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.xml	dst=null	perm=null
2015-03-13 10:05:26,137 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.xml	dst=null	perm=null
2015-03-13 10:05:26,137 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.xml	dst=null	perm=null
2015-03-13 10:05:26,138 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.xml	dst=null	perm=null
2015-03-13 10:05:26,138 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.xml	dst=null	perm=null
2015-03-13 10:05:26,145 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61057, bytes: 98618, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1722350459_2692, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741872_1048, duration: 312000
2015-03-13 10:05:26,145 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61056, bytes: 98618, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_394532054_2693, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741872_1048, duration: 341000
2015-03-13 10:05:26,161 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:05:26,161 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:05:26,161 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:05:26,162 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:05:26,161 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:05:26,161 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:05:26,162 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:05:26,241 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:05:26,241 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:26,242 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:05:26,242 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:26,243 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:05:26,243 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:26,244 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:05:26,244 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:26,266 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:05:26,266 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:26,385 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000002/default_container_executor.sh]
2015-03-13 10:05:26,393 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000006/default_container_executor.sh]
2015-03-13 10:05:26,399 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000003/default_container_executor.sh]
2015-03-13 10:05:26,412 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000005/default_container_executor.sh]
2015-03-13 10:05:26,432 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000004/default_container_executor.sh]
2015-03-13 10:05:26,590 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:26,766 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:26,766 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:26,767 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:26,767 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:26,767 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0004_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:05:26,768 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0004_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:05:26,768 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0004_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:05:26,768 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0004_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:05:26,779 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:05:26,815 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:26,815 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0004_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:05:27,197 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:05:27,318 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0004_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000003.tokens
2015-03-13 10:05:27,318 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0004 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0004
2015-03-13 10:05:27,435 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:05:27,551 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426266260362_0004_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000002.tokens
2015-03-13 10:05:27,552 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0004 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0004
2015-03-13 10:05:27,596 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:27,659 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:05:27,768 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:27,769 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:27,769 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:27,769 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:27,773 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0004_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000005.tokens
2015-03-13 10:05:27,773 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0004 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0004
2015-03-13 10:05:27,816 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:28,600 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:28,773 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:28,773 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:28,774 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:28,774 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:28,819 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:29,603 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:29,776 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:29,777 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:29,777 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:29,777 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:29,820 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:30,604 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:30,782 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:30,782 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:30,782 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:30,783 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:30,822 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:31,610 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:31,786 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:31,786 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:31,786 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:31,786 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:31,822 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:32,615 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:32,790 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:32,791 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:32,791 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:32,791 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:32,824 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:33,619 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:33,793 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:33,793 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:33,794 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:33,794 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:33,830 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:34,282 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.split	dst=null	perm=null
2015-03-13 10:05:34,434 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.split	dst=null	perm=null
2015-03-13 10:05:34,552 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.split	dst=null	perm=null
2015-03-13 10:05:34,558 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61069, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0004_m_000003_0_1434448342_1, offset: 1024, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741870_1046, duration: 204000
2015-03-13 10:05:34,578 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.split	dst=null	perm=null
2015-03-13 10:05:34,604 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.split	dst=null	perm=null
2015-03-13 10:05:34,622 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:34,644 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61072, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0004_m_000004_0_407531658_1, offset: 1024, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741870_1046, duration: 160000
2015-03-13 10:05:34,717 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:05:34,719 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61074, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0004_m_000000_0_-1766763820_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741870_1046, duration: 185000
2015-03-13 10:05:34,721 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61076, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0004_m_000003_0_1434448342_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 185000
2015-03-13 10:05:34,727 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61075, bytes: 1282, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0004_m_000002_0_1723560839_1, offset: 512, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741870_1046, duration: 184000
2015-03-13 10:05:34,752 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1426266260362_0004_m_000003_0/part-00003	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:34,758 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61077, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0004_m_000001_0_363934765_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741870_1046, duration: 181000
2015-03-13 10:05:34,783 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:05:34,787 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61078, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0004_m_000004_0_407531658_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 185000
2015-03-13 10:05:34,797 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:34,798 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:34,798 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:34,798 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:34,812 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1426266260362_0004_m_000004_0/part-00004	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:34,834 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:34,843 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:05:34,847 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61075, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0004_m_000002_0_1723560839_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 238000
2015-03-13 10:05:34,861 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:05:34,876 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1426266260362_0004_m_000002_0/part-00002	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:34,883 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1426266260362_0004_m_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:34,903 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:05:34,909 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61079, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0004_m_000001_0_363934765_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 191000
2015-03-13 10:05:34,944 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1426266260362_0004_m_000001_0/part-00001	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:35,164 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:05:35,172 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:05:35,175 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:05:35,180 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61080, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0004_m_000003_0_1434448342_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 191000
2015-03-13 10:05:35,207 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1426266260362_0004_m_000003_0/part-00003. BP-1005356445-10.1.1.144-1426266257849 blk_1073741874_1050{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:05:35,236 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:05:35,252 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741874_1050 src: /127.0.0.1:61081 dest: /127.0.0.1:60689
2015-03-13 10:05:35,253 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741874_1050 src: /127.0.0.1:61082 dest: /127.0.0.1:60693
2015-03-13 10:05:35,255 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741874_1050 src: /127.0.0.1:61083 dest: /127.0.0.1:60686
2015-03-13 10:05:35,264 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61083, dest: /127.0.0.1:60686, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0004_m_000003_0_1434448342_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741874_1050, duration: 8321000
2015-03-13 10:05:35,265 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741874_1050, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:35,265 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741874_1050{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:35,265 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61082, dest: /127.0.0.1:60693, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0004_m_000003_0_1434448342_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741874_1050, duration: 9227000
2015-03-13 10:05:35,266 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741874_1050, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:35,266 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741874_1050{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:35,267 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61081, dest: /127.0.0.1:60689, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0004_m_000003_0_1434448342_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741874_1050, duration: 10576000
2015-03-13 10:05:35,267 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741874_1050, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:35,268 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741874_1050{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:35,272 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1426266260362_0004_m_000003_0/part-00003 is closed by DFSClient_attempt_1426266260362_0004_m_000003_0_1434448342_1
2015-03-13 10:05:35,282 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1426266260362_0004_m_000003_0	dst=null	perm=null
2015-03-13 10:05:35,287 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:05:35,289 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1426266260362_0004_m_000003_0	dst=null	perm=null
2015-03-13 10:05:35,290 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/task_1426266260362_0004_m_000003	dst=null	perm=null
2015-03-13 10:05:35,291 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:05:35,295 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1426266260362_0004_m_000003_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/task_1426266260362_0004_m_000003	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:05:35,295 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61072, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0004_m_000004_0_407531658_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 186000
2015-03-13 10:05:35,310 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1426266260362_0004_m_000004_0/part-00004 is closed by DFSClient_attempt_1426266260362_0004_m_000004_0_407531658_1
2015-03-13 10:05:35,316 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0004_01_000005
2015-03-13 10:05:35,316 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0004	CONTAINERID=container_1426266260362_0004_01_000005
2015-03-13 10:05:35,316 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:05:35,316 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0004_01_000005
2015-03-13 10:05:35,317 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:35,317 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:35,317 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:35,317 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:05:35,320 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1426266260362_0004_m_000004_0	dst=null	perm=null
2015-03-13 10:05:35,330 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0004_01_000005 is : 143
2015-03-13 10:05:35,332 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job_1426266260362_0004_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073741875_1051{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:05:35,334 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741875_1051 src: /127.0.0.1:61084 dest: /127.0.0.1:60696
2015-03-13 10:05:35,335 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741875_1051 src: /127.0.0.1:61085 dest: /127.0.0.1:60689
2015-03-13 10:05:35,337 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741875_1051 src: /127.0.0.1:61086 dest: /127.0.0.1:60693
2015-03-13 10:05:35,341 INFO  hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job_1426266260362_0004_1.jhist for DFSClient_NONMAPREDUCE_1084064864_1
2015-03-13 10:05:35,343 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:05:35,343 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000005
2015-03-13 10:05:35,344 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000005
2015-03-13 10:05:35,344 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000005
2015-03-13 10:05:35,346 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0004	CONTAINERID=container_1426266260362_0004_01_000005
2015-03-13 10:05:35,346 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000005
2015-03-13 10:05:35,347 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:05:35,347 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0004_01_000005 from application application_1426266260362_0004
2015-03-13 10:05:35,347 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:35,347 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0004
2015-03-13 10:05:35,369 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:05:35,379 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:05:35,380 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:05:35,383 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:05:35,386 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61074, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0004_m_000000_0_-1766763820_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 189000
2015-03-13 10:05:35,388 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:05:35,391 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61087, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0004_m_000000_0_-1766763820_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 198000
2015-03-13 10:05:35,391 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:05:35,395 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:05:35,397 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61088, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0004_m_000002_0_1723560839_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 203000
2015-03-13 10:05:35,404 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:05:35,408 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:05:35,414 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61089, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0004_m_000001_0_363934765_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 198000
2015-03-13 10:05:35,415 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1426266260362_0004_m_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073741876_1052{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:05:35,425 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1426266260362_0004_m_000002_0/part-00002. BP-1005356445-10.1.1.144-1426266257849 blk_1073741877_1053{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:05:35,440 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1426266260362_0004_m_000001_0/part-00001. BP-1005356445-10.1.1.144-1426266257849 blk_1073741878_1054{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:05:35,503 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741878_1054 src: /127.0.0.1:61092 dest: /127.0.0.1:60686
2015-03-13 10:05:35,505 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741878_1054 src: /127.0.0.1:61093 dest: /127.0.0.1:60689
2015-03-13 10:05:35,506 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741878_1054 src: /127.0.0.1:61094 dest: /127.0.0.1:60693
2015-03-13 10:05:35,509 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741877_1053 src: /127.0.0.1:61091 dest: /127.0.0.1:60696
2015-03-13 10:05:35,511 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741877_1053 src: /127.0.0.1:61095 dest: /127.0.0.1:60686
2015-03-13 10:05:35,512 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741877_1053 src: /127.0.0.1:61096 dest: /127.0.0.1:60689
2015-03-13 10:05:35,523 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61096, dest: /127.0.0.1:60689, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0004_m_000002_0_1723560839_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741877_1053, duration: 8980000
2015-03-13 10:05:35,523 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741877_1053, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:35,523 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741877_1053{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:35,524 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61095, dest: /127.0.0.1:60686, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0004_m_000002_0_1723560839_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741877_1053, duration: 9698000
2015-03-13 10:05:35,524 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741877_1053, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:35,524 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741877_1053{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:35,524 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61091, dest: /127.0.0.1:60696, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0004_m_000002_0_1723560839_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741877_1053, duration: 10616000
2015-03-13 10:05:35,525 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741877_1053, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:35,525 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741877_1053{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:35,525 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741876_1052 src: /127.0.0.1:61090 dest: /127.0.0.1:60696
2015-03-13 10:05:35,527 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741876_1052 src: /127.0.0.1:61097 dest: /127.0.0.1:60689
2015-03-13 10:05:35,528 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741876_1052 src: /127.0.0.1:61098 dest: /127.0.0.1:60686
2015-03-13 10:05:35,540 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61098, dest: /127.0.0.1:60686, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0004_m_000000_0_-1766763820_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741876_1052, duration: 9550000
2015-03-13 10:05:35,540 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741876_1052, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:35,540 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741876_1052{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:35,540 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61097, dest: /127.0.0.1:60689, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0004_m_000000_0_-1766763820_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741876_1052, duration: 10154000
2015-03-13 10:05:35,541 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741876_1052, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:35,541 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741876_1052{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:35,541 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61090, dest: /127.0.0.1:60696, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0004_m_000000_0_-1766763820_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741876_1052, duration: 10953000
2015-03-13 10:05:35,541 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741876_1052, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:35,542 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741876_1052{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:35,567 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1426266260362_0004_m_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0004_m_000000_0_-1766763820_1
2015-03-13 10:05:35,573 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1426266260362_0004_m_000002_0/part-00002 is closed by DFSClient_attempt_1426266260362_0004_m_000002_0_1723560839_1
2015-03-13 10:05:35,578 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1426266260362_0004_m_000000_0	dst=null	perm=null
2015-03-13 10:05:35,591 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1426266260362_0004_m_000000_0	dst=null	perm=null
2015-03-13 10:05:35,592 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/task_1426266260362_0004_m_000000	dst=null	perm=null
2015-03-13 10:05:35,596 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1426266260362_0004_m_000000_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/task_1426266260362_0004_m_000000	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:05:35,596 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1426266260362_0004_m_000002_0	dst=null	perm=null
2015-03-13 10:05:35,600 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61094, dest: /127.0.0.1:60693, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0004_m_000001_0_363934765_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741878_1054, duration: 92305000
2015-03-13 10:05:35,600 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741878_1054, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:35,601 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741878_1054{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:35,601 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61093, dest: /127.0.0.1:60689, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0004_m_000001_0_363934765_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741878_1054, duration: 92872000
2015-03-13 10:05:35,601 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741878_1054, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:35,601 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741878_1054{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:35,602 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61092, dest: /127.0.0.1:60686, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0004_m_000001_0_363934765_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741878_1054, duration: 93725000
2015-03-13 10:05:35,602 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741878_1054, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:35,602 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741878_1054{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:35,603 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1426266260362_0004_m_000002_0	dst=null	perm=null
2015-03-13 10:05:35,604 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/task_1426266260362_0004_m_000002	dst=null	perm=null
2015-03-13 10:05:35,608 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1426266260362_0004_m_000002_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/task_1426266260362_0004_m_000002	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:05:35,613 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0004_01_000002
2015-03-13 10:05:35,613 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0004	CONTAINERID=container_1426266260362_0004_01_000002
2015-03-13 10:05:35,613 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:05:35,613 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1426266260362_0004_m_000001_0/part-00001 is closed by DFSClient_attempt_1426266260362_0004_m_000001_0_363934765_1
2015-03-13 10:05:35,613 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0004_01_000002
2015-03-13 10:05:35,614 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:05:35,614 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:35,614 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:35,614 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:05:35,615 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0004_01_000005
2015-03-13 10:05:35,615 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0004_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:05:35,615 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0004_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:05:35,615 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0004	CONTAINERID=container_1426266260362_0004_01_000005
2015-03-13 10:05:35,615 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0004_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:05:35,616 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:05:35,616 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0004_01_000005, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:35,616 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:35,617 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:05:35,617 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0004_000001 released container container_1426266260362_0004_01_000005 on node: host: 10.1.1.144:60715 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:05:35,623 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:35,627 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1426266260362_0004_m_000001_0	dst=null	perm=null
2015-03-13 10:05:35,628 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0004_01_000002 is : 143
2015-03-13 10:05:35,633 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1426266260362_0004_m_000001_0	dst=null	perm=null
2015-03-13 10:05:35,634 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/task_1426266260362_0004_m_000001	dst=null	perm=null
2015-03-13 10:05:35,638 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1426266260362_0004_m_000001_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/task_1426266260362_0004_m_000001	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:05:35,638 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0004_01_000004
2015-03-13 10:05:35,639 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0004	CONTAINERID=container_1426266260362_0004_01_000004
2015-03-13 10:05:35,639 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: -1000
2015-03-13 10:05:35,639 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:35,639 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:35,644 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:05:35,645 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:05:35,645 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000002
2015-03-13 10:05:35,646 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000002
2015-03-13 10:05:35,646 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000002
2015-03-13 10:05:35,646 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000002
2015-03-13 10:05:35,646 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0004_01_000004
2015-03-13 10:05:35,656 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0004_01_000003
2015-03-13 10:05:35,656 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0004	CONTAINERID=container_1426266260362_0004_01_000003
2015-03-13 10:05:35,656 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:05:35,657 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:35,657 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:05:35,659 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0004_01_000004 is : 143
2015-03-13 10:05:35,673 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0004	CONTAINERID=container_1426266260362_0004_01_000002
2015-03-13 10:05:35,674 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:05:35,674 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:05:35,674 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:05:35,674 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0004_01_000002 from application application_1426266260362_0004
2015-03-13 10:05:35,674 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:35,674 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0004
2015-03-13 10:05:35,674 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0004_01_000003
2015-03-13 10:05:35,686 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0004_01_000003 is : 143
2015-03-13 10:05:35,699 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000004
2015-03-13 10:05:35,699 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000004
2015-03-13 10:05:35,699 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000004
2015-03-13 10:05:35,700 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000004
2015-03-13 10:05:35,700 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:05:35,700 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0004	CONTAINERID=container_1426266260362_0004_01_000004
2015-03-13 10:05:35,700 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:05:35,701 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000003
2015-03-13 10:05:35,701 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000003
2015-03-13 10:05:35,701 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000003
2015-03-13 10:05:35,702 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000003
2015-03-13 10:05:35,702 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0004_01_000004 from application application_1426266260362_0004
2015-03-13 10:05:35,702 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:35,702 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0004
2015-03-13 10:05:35,703 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0004	CONTAINERID=container_1426266260362_0004_01_000003
2015-03-13 10:05:35,703 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:05:35,703 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0004_01_000003 from application application_1426266260362_0004
2015-03-13 10:05:35,703 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:35,703 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0004
2015-03-13 10:05:35,836 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:36,331 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1426266260362_0004_m_000004_0	dst=null	perm=null
2015-03-13 10:05:36,332 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/task_1426266260362_0004_m_000004	dst=null	perm=null
2015-03-13 10:05:36,335 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1426266260362_0004_m_000004_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/task_1426266260362_0004_m_000004	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:05:36,347 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0004_000001 (auth:SIMPLE)
2015-03-13 10:05:36,349 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0004_01_000006
2015-03-13 10:05:36,349 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0004	CONTAINERID=container_1426266260362_0004_01_000006
2015-03-13 10:05:36,349 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:05:36,349 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0004_01_000006
2015-03-13 10:05:36,350 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:05:36,355 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:36,357 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_1084064864_1
2015-03-13 10:05:36,361 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1	dst=null	perm=null
2015-03-13 10:05:36,362 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0004_01_000006 is : 143
2015-03-13 10:05:36,369 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes	dst=null	perm=null
2015-03-13 10:05:36,370 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes	dst=null	perm=null
2015-03-13 10:05:36,371 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/task_1426266260362_0004_m_000000	dst=null	perm=null
2015-03-13 10:05:36,373 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/part-00000	dst=null	perm=null
2015-03-13 10:05:36,375 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:05:36,376 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0004	CONTAINERID=container_1426266260362_0004_01_000006
2015-03-13 10:05:36,376 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/task_1426266260362_0004_m_000000/part-00000	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/part-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:36,376 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:05:36,376 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0004_01_000006 from application application_1426266260362_0004
2015-03-13 10:05:36,376 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000006
2015-03-13 10:05:36,376 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000006
2015-03-13 10:05:36,377 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000006
2015-03-13 10:05:36,376 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000006
2015-03-13 10:05:36,376 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:36,377 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0004
2015-03-13 10:05:36,380 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes	dst=null	perm=null
2015-03-13 10:05:36,381 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes	dst=null	perm=null
2015-03-13 10:05:36,381 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/task_1426266260362_0004_m_000001	dst=null	perm=null
2015-03-13 10:05:36,383 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/part-00001	dst=null	perm=null
2015-03-13 10:05:36,384 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/task_1426266260362_0004_m_000001/part-00001	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/part-00001	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:36,385 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes	dst=null	perm=null
2015-03-13 10:05:36,385 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes	dst=null	perm=null
2015-03-13 10:05:36,386 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/task_1426266260362_0004_m_000002	dst=null	perm=null
2015-03-13 10:05:36,388 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/part-00002	dst=null	perm=null
2015-03-13 10:05:36,390 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/task_1426266260362_0004_m_000002/part-00002	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/part-00002	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:36,391 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes	dst=null	perm=null
2015-03-13 10:05:36,392 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes	dst=null	perm=null
2015-03-13 10:05:36,393 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/task_1426266260362_0004_m_000003	dst=null	perm=null
2015-03-13 10:05:36,395 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/part-00003	dst=null	perm=null
2015-03-13 10:05:36,396 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/task_1426266260362_0004_m_000003/part-00003	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/part-00003	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:36,397 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes	dst=null	perm=null
2015-03-13 10:05:36,398 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes	dst=null	perm=null
2015-03-13 10:05:36,399 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/task_1426266260362_0004_m_000004	dst=null	perm=null
2015-03-13 10:05:36,400 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/part-00004	dst=null	perm=null
2015-03-13 10:05:36,401 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/task_1426266260362_0004_m_000004/part-00004	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/part-00004	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:36,404 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary	dst=null	perm=null
2015-03-13 10:05:36,408 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:36,409 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_SUCCESS is closed by DFSClient_NONMAPREDUCE_1084064864_1
2015-03-13 10:05:36,411 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:36,413 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_1084064864_1
2015-03-13 10:05:36,423 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61086, dest: /127.0.0.1:60693, bytes: 53317, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1084064864_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741875_1051, duration: 1084932000
2015-03-13 10:05:36,423 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741875_1051, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:36,424 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741875_1051{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:36,424 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61085, dest: /127.0.0.1:60689, bytes: 53317, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1084064864_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741875_1051, duration: 1085715000
2015-03-13 10:05:36,424 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741875_1051, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:36,425 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741875_1051{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:36,425 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61084, dest: /127.0.0.1:60696, bytes: 53317, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1084064864_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741875_1051, duration: 1086984000
2015-03-13 10:05:36,426 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741875_1051, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:36,426 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741875_1051{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:36,427 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job_1426266260362_0004_1.jhist is closed by DFSClient_NONMAPREDUCE_1084064864_1
2015-03-13 10:05:36,429 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0004.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:36,431 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0004.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741879_1055{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:05:36,432 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741879_1055 src: /127.0.0.1:61100 dest: /127.0.0.1:60693
2015-03-13 10:05:36,434 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741879_1055 src: /127.0.0.1:61101 dest: /127.0.0.1:60696
2015-03-13 10:05:36,435 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741879_1055 src: /127.0.0.1:61102 dest: /127.0.0.1:60689
2015-03-13 10:05:36,438 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61102, dest: /127.0.0.1:60689, bytes: 433, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1084064864_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741879_1055, duration: 1564000
2015-03-13 10:05:36,438 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741879_1055, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:36,439 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741879_1055{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:36,439 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61101, dest: /127.0.0.1:60696, bytes: 433, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1084064864_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741879_1055, duration: 1942000
2015-03-13 10:05:36,439 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741879_1055, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:36,439 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741879_1055{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:36,440 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61100, dest: /127.0.0.1:60693, bytes: 433, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1084064864_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741879_1055, duration: 2946000
2015-03-13 10:05:36,440 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741879_1055, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:36,441 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741879_1055{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:36,442 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0004.summary_tmp is closed by DFSClient_NONMAPREDUCE_1084064864_1
2015-03-13 10:05:36,445 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0004.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:05:36,451 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job_1426266260362_0004_1.jhist	dst=null	perm=null
2015-03-13 10:05:36,452 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0004-1426266320047-soberoi-%5BDF98BEF6B79549DA8449852A7CBDC6EB%2F5EF25D47FD214193-1426266336413-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:05:36,456 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job_1426266260362_0004_1.jhist	dst=null	perm=null
2015-03-13 10:05:36,458 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0004-1426266320047-soberoi-%5BDF98BEF6B79549DA8449852A7CBDC6EB%2F5EF25D47FD214193-1426266336413-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:05:36,459 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job_1426266260362_0004_1.jhist	dst=null	perm=null
2015-03-13 10:05:36,461 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0004-1426266320047-soberoi-%5BDF98BEF6B79549DA8449852A7CBDC6EB%2F5EF25D47FD214193-1426266336413-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:36,463 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61103, bytes: 53737, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1084064864_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741875_1051, duration: 219000
2015-03-13 10:05:36,465 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0004-1426266320047-soberoi-%5BDF98BEF6B79549DA8449852A7CBDC6EB%2F5EF25D47FD214193-1426266336413-5-0-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741880_1056{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:05:36,466 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741880_1056 src: /127.0.0.1:61104 dest: /127.0.0.1:60696
2015-03-13 10:05:36,468 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741880_1056 src: /127.0.0.1:61105 dest: /127.0.0.1:60686
2015-03-13 10:05:36,469 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741880_1056 src: /127.0.0.1:61106 dest: /127.0.0.1:60689
2015-03-13 10:05:36,471 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61106, dest: /127.0.0.1:60689, bytes: 53317, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1084064864_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741880_1056, duration: 1633000
2015-03-13 10:05:36,471 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741880_1056, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:36,472 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741880_1056{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:36,472 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61105, dest: /127.0.0.1:60686, bytes: 53317, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1084064864_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741880_1056, duration: 2135000
2015-03-13 10:05:36,472 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741880_1056, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:36,472 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741880_1056{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:36,473 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61104, dest: /127.0.0.1:60696, bytes: 53317, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1084064864_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741880_1056, duration: 2939000
2015-03-13 10:05:36,473 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741880_1056, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:36,473 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741880_1056{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:36,475 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0004-1426266320047-soberoi-%5BDF98BEF6B79549DA8449852A7CBDC6EB%2F5EF25D47FD214193-1426266336413-5-0-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_1084064864_1
2015-03-13 10:05:36,476 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0004-1426266320047-soberoi-%5BDF98BEF6B79549DA8449852A7CBDC6EB%2F5EF25D47FD214193-1426266336413-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:05:36,477 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job_1426266260362_0004_1_conf.xml	dst=null	perm=null
2015-03-13 10:05:36,478 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0004_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:05:36,478 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job_1426266260362_0004_1_conf.xml	dst=null	perm=null
2015-03-13 10:05:36,479 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0004_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:05:36,480 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job_1426266260362_0004_1_conf.xml	dst=null	perm=null
2015-03-13 10:05:36,482 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0004_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:36,484 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61107, bytes: 91377, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1084064864_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741873_1049, duration: 317000
2015-03-13 10:05:36,485 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0004_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741881_1057{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:05:36,487 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741881_1057 src: /127.0.0.1:61108 dest: /127.0.0.1:60696
2015-03-13 10:05:36,488 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741881_1057 src: /127.0.0.1:61109 dest: /127.0.0.1:60689
2015-03-13 10:05:36,489 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741881_1057 src: /127.0.0.1:61110 dest: /127.0.0.1:60686
2015-03-13 10:05:36,492 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61110, dest: /127.0.0.1:60686, bytes: 90665, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1084064864_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741881_1057, duration: 1856000
2015-03-13 10:05:36,493 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741881_1057, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:36,493 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741881_1057{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:36,493 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61109, dest: /127.0.0.1:60689, bytes: 90665, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1084064864_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741881_1057, duration: 2332000
2015-03-13 10:05:36,493 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741881_1057, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:36,494 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741881_1057{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:36,494 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61108, dest: /127.0.0.1:60696, bytes: 90665, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1084064864_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741881_1057, duration: 3330000
2015-03-13 10:05:36,494 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741881_1057, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:36,495 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741881_1057{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:36,496 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0004_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_1084064864_1
2015-03-13 10:05:36,498 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0004_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:05:36,500 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0004.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0004.summary	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:05:36,502 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0004_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0004_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:05:36,504 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0004-1426266320047-soberoi-%5BDF98BEF6B79549DA8449852A7CBDC6EB%2F5EF25D47FD214193-1426266336413-5-0-SUCCEEDED-default.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0004-1426266320047-soberoi-%5BDF98BEF6B79549DA8449852A7CBDC6EB%2F5EF25D47FD214193-1426266336413-5-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:05:36,512 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0004_000001 State change from RUNNING to FINISHING
2015-03-13 10:05:36,512 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0004
2015-03-13 10:05:36,512 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0004 State change from RUNNING to REMOVING
2015-03-13 10:05:36,512 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0004
2015-03-13 10:05:36,512 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0004 State change from REMOVING to FINISHING
2015-03-13 10:05:36,629 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:36,658 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:05:36,658 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0004_01_000002
2015-03-13 10:05:36,658 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:05:36,659 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0004_01_000003
2015-03-13 10:05:36,659 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:05:36,659 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0004_01_000004
2015-03-13 10:05:36,660 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0004_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:05:36,660 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0004_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:05:36,660 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0004	CONTAINERID=container_1426266260362_0004_01_000002
2015-03-13 10:05:36,660 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0004_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:05:36,660 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:05:36,661 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0004_01_000002, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:36,661 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:36,661 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:05:36,661 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0004_000001 released container container_1426266260362_0004_01_000002 on node: host: 10.1.1.144:60715 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:05:36,661 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0004_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:05:36,662 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0004_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:05:36,662 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0004	CONTAINERID=container_1426266260362_0004_01_000003
2015-03-13 10:05:36,662 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0004_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:05:36,662 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:05:36,662 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0004_01_000003, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:36,663 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:36,663 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:05:36,663 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0004_000001 released container container_1426266260362_0004_01_000003 on node: host: 10.1.1.144:60715 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:05:36,663 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0004_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:05:36,663 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0004_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:05:36,663 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0004	CONTAINERID=container_1426266260362_0004_01_000004
2015-03-13 10:05:36,663 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0004_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:05:36,663 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:05:36,664 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0004_01_000004, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:36,664 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:36,664 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:05:36,664 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0004_000001 released container container_1426266260362_0004_01_000004 on node: host: 10.1.1.144:60715 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:05:37,354 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:05:37,354 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0004_01_000006
2015-03-13 10:05:37,355 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0004_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:05:37,355 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0004_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:05:37,355 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0004	CONTAINERID=container_1426266260362_0004_01_000006
2015-03-13 10:05:37,355 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0004_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:05:37,356 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:05:37,356 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0004_01_000006, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:37,357 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:37,357 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:05:37,357 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0004_000001 released container container_1426266260362_0004_01_000006 on node: host: 10.1.1.144:60719 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:05:37,520 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741869_1045 127.0.0.1:60689 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60686 
2015-03-13 10:05:37,520 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741870_1046 127.0.0.1:60689 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60686 
2015-03-13 10:05:37,520 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741871_1047 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60689 
2015-03-13 10:05:37,520 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741872_1048 127.0.0.1:60689 127.0.0.1:60686 127.0.0.1:60693 
2015-03-13 10:05:37,520 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741875_1051 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60693 
2015-03-13 10:05:37,520 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741873_1049 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60693 
2015-03-13 10:05:37,521 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004	dst=null	perm=null
2015-03-13 10:05:37,558 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes	dst=null	perm=null
2015-03-13 10:05:37,558 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary
2015-03-13 10:05:37,559 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary	dst=null	perm=null
2015-03-13 10:05:37,566 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:05:37,567 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:05:37,568 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:05:37,569 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes	dst=null	perm=null
2015-03-13 10:05:37,570 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes	dst=null	perm=null
2015-03-13 10:05:37,571 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes	dst=null	perm=null
2015-03-13 10:05:37,572 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:05:37,573 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/part-00000	dst=null	perm=null
2015-03-13 10:05:37,575 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61112, bytes: 20, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741876_1052, duration: 157000
2015-03-13 10:05:37,576 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/part-00001	dst=null	perm=null
2015-03-13 10:05:37,579 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61113, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741878_1054, duration: 140000
2015-03-13 10:05:37,580 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/part-00002	dst=null	perm=null
2015-03-13 10:05:37,582 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61114, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741877_1053, duration: 154000
2015-03-13 10:05:37,583 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/part-00003	dst=null	perm=null
2015-03-13 10:05:37,584 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61112, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741874_1050, duration: 120000
2015-03-13 10:05:37,584 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/part-00004	dst=null	perm=null
2015-03-13 10:05:37,594 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:05:37,595 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:05:37,596 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:05:37,598 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes	dst=null	perm=null
2015-03-13 10:05:37,599 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes	dst=null	perm=null
2015-03-13 10:05:37,599 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes	dst=null	perm=null
2015-03-13 10:05:37,601 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:05:37,603 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/part-00000	dst=null	perm=null
2015-03-13 10:05:37,605 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61114, bytes: 20, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741876_1052, duration: 200000
2015-03-13 10:05:37,606 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/part-00001	dst=null	perm=null
2015-03-13 10:05:37,608 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61113, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741878_1054, duration: 180000
2015-03-13 10:05:37,609 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/part-00002	dst=null	perm=null
2015-03-13 10:05:37,611 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61112, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741877_1053, duration: 185000
2015-03-13 10:05:37,611 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/part-00003	dst=null	perm=null
2015-03-13 10:05:37,613 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61112, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741874_1050, duration: 181000
2015-03-13 10:05:37,614 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/part-00004	dst=null	perm=null
2015-03-13 10:05:37,614 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/renamedpipes
2015-03-13 10:05:37,615 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes	dst=null	perm=null
2015-03-13 10:05:37,616 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes	dst=null	perm=null
2015-03-13 10:05:37,617 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes	dst=null	perm=null
2015-03-13 10:05:37,618 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes	dst=null	perm=null
2015-03-13 10:05:37,619 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/part-00000	dst=null	perm=null
2015-03-13 10:05:37,620 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/part-00000	dst=null	perm=null
2015-03-13 10:05:37,622 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61114, bytes: 20, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741876_1052, duration: 202000
2015-03-13 10:05:37,622 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/part-00001	dst=null	perm=null
2015-03-13 10:05:37,623 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/part-00001	dst=null	perm=null
2015-03-13 10:05:37,625 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61112, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741878_1054, duration: 164000
2015-03-13 10:05:37,625 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/part-00002	dst=null	perm=null
2015-03-13 10:05:37,626 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/part-00002	dst=null	perm=null
2015-03-13 10:05:37,628 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61114, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741877_1053, duration: 225000
2015-03-13 10:05:37,629 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/part-00003	dst=null	perm=null
2015-03-13 10:05:37,630 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:37,630 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/part-00003	dst=null	perm=null
2015-03-13 10:05:37,631 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61112, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741874_1050, duration: 160000
2015-03-13 10:05:37,632 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/part-00004	dst=null	perm=null
2015-03-13 10:05:37,633 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/part-00004	dst=null	perm=null
2015-03-13 10:05:37,634 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:05:37,635 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:05:37,654 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:05:37,664 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:05:37,664 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:05:37,708 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery	dst=null	perm=null
2015-03-13 10:05:37,711 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting
2015-03-13 10:05:37,711 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt"]
2015-03-13 10:05:37,711 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-03-13 10:05:37,711 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery"]
2015-03-13 10:05:37,711 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  parallel execution is enabled: true
2015-03-13 10:05:37,712 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  starting jobs: 3
2015-03-13 10:05:37,712 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  allocating threads: 3
2015-03-13 10:05:37,713 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (1/3)
2015-03-13 10:05:37,713 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (2/3)
2015-03-13 10:05:37,721 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:05:37,729 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:05:37,737 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:05:37,739 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/3391551687_upper_6F2967859C074FB3A05AC9B5C5BE893F	dst=null	perm=null
2015-03-13 10:05:37,739 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:05:37,740 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:05:37,743 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 5
2015-03-13 10:05:37,744 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005	dst=null	perm=null
2015-03-13 10:05:37,745 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005	dst=null	perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:05:37,747 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005	dst=null	perm=soberoi:supergroup:rwx------
2015-03-13 10:05:37,747 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.jar	dst=null	perm=null
2015-03-13 10:05:37,749 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:37,749 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:05:37,751 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5116607014_lower_9AD2589890154BF394AB0F3C492A089C	dst=null	perm=null
2015-03-13 10:05:37,751 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073741882_1058{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:05:37,751 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:05:37,752 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:05:37,752 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741882_1058 src: /127.0.0.1:61116 dest: /127.0.0.1:60689
2015-03-13 10:05:37,753 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 6
2015-03-13 10:05:37,754 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741882_1058 src: /127.0.0.1:61117 dest: /127.0.0.1:60693
2015-03-13 10:05:37,754 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006	dst=null	perm=null
2015-03-13 10:05:37,755 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741882_1058 src: /127.0.0.1:61118 dest: /127.0.0.1:60686
2015-03-13 10:05:37,755 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006	dst=null	perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:05:37,757 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006	dst=null	perm=soberoi:supergroup:rwx------
2015-03-13 10:05:37,758 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.jar	dst=null	perm=null
2015-03-13 10:05:37,759 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61118, dest: /127.0.0.1:60686, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741882_1058, duration: 2301000
2015-03-13 10:05:37,759 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741882_1058, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:37,760 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741882_1058{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:37,760 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61117, dest: /127.0.0.1:60693, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741882_1058, duration: 2712000
2015-03-13 10:05:37,760 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741882_1058, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:37,760 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:37,761 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741882_1058{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:37,761 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61116, dest: /127.0.0.1:60689, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741882_1058, duration: 3995000
2015-03-13 10:05:37,761 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741882_1058, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:37,762 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741882_1058{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:37,764 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:05:37,764 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073741883_1059{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:05:37,765 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.jar
2015-03-13 10:05:37,765 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.jar	dst=null	perm=null
2015-03-13 10:05:37,765 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741883_1059 src: /127.0.0.1:61119 dest: /127.0.0.1:60689
2015-03-13 10:05:37,766 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:37,767 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741883_1059 src: /127.0.0.1:61120 dest: /127.0.0.1:60696
2015-03-13 10:05:37,767 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:05:37,768 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:05:37,768 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741883_1059 src: /127.0.0.1:61121 dest: /127.0.0.1:60693
2015-03-13 10:05:37,768 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:05:37,770 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:05:37,771 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:05:37,772 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61121, dest: /127.0.0.1:60693, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741883_1059, duration: 2067000
2015-03-13 10:05:37,772 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741883_1059, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:37,772 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:05:37,773 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741883_1059{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:37,773 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61120, dest: /127.0.0.1:60696, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741883_1059, duration: 3099000
2015-03-13 10:05:37,773 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741883_1059, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:37,774 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741883_1059{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:37,774 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:05:37,774 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61119, dest: /127.0.0.1:60689, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741883_1059, duration: 3977000
2015-03-13 10:05:37,774 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741883_1059, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:37,775 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741883_1059{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:37,775 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:05:37,776 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:05:37,777 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:05:37,777 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.jar
2015-03-13 10:05:37,778 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.jar	dst=null	perm=null
2015-03-13 10:05:37,778 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:05:37,778 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:37,779 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:05:37,779 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:05:37,779 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:05:37,780 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:05:37,780 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:05:37,781 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:37,781 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:05:37,782 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:05:37,782 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:37,782 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:05:37,783 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.split
2015-03-13 10:05:37,783 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:05:37,783 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.split	dst=null	perm=null
2015-03-13 10:05:37,783 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:05:37,784 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073741884_1060{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:05:37,784 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:05:37,785 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741884_1060 src: /127.0.0.1:61122 dest: /127.0.0.1:60686
2015-03-13 10:05:37,786 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:05:37,786 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:05:37,786 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741884_1060 src: /127.0.0.1:61123 dest: /127.0.0.1:60689
2015-03-13 10:05:37,787 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:05:37,788 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741884_1060 src: /127.0.0.1:61124 dest: /127.0.0.1:60696
2015-03-13 10:05:37,789 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:37,789 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741884_1060 src: /127.0.0.1:61125 dest: /127.0.0.1:60693
2015-03-13 10:05:37,791 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:37,792 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.split
2015-03-13 10:05:37,792 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.split	dst=null	perm=null
2015-03-13 10:05:37,793 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61125, dest: /127.0.0.1:60693, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741884_1060, duration: 1576000
2015-03-13 10:05:37,793 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741884_1060, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:37,794 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61124, dest: /127.0.0.1:60696, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741884_1060, duration: 2694000
2015-03-13 10:05:37,794 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741884_1060{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:37,794 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741884_1060, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:37,794 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073741885_1061{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:05:37,794 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61123, dest: /127.0.0.1:60689, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741884_1060, duration: 3345000
2015-03-13 10:05:37,795 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741884_1060, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:37,795 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741884_1060{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:37,795 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741884_1060{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:37,796 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61122, dest: /127.0.0.1:60686, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741884_1060, duration: 3945000
2015-03-13 10:05:37,796 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741884_1060, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:37,796 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741884_1060{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:37,797 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741885_1061 src: /127.0.0.1:61126 dest: /127.0.0.1:60689
2015-03-13 10:05:37,799 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741885_1061 src: /127.0.0.1:61127 dest: /127.0.0.1:60696
2015-03-13 10:05:37,799 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:05:37,800 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741885_1061 src: /127.0.0.1:61128 dest: /127.0.0.1:60693
2015-03-13 10:05:37,801 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:37,801 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741885_1061 src: /127.0.0.1:61129 dest: /127.0.0.1:60686
2015-03-13 10:05:37,803 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:37,804 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61129, dest: /127.0.0.1:60686, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741885_1061, duration: 1839000
2015-03-13 10:05:37,805 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073741886_1062{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:05:37,805 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741885_1061, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:37,805 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741885_1061{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:37,805 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61128, dest: /127.0.0.1:60693, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741885_1061, duration: 2291000
2015-03-13 10:05:37,805 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741885_1061, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:37,806 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61127, dest: /127.0.0.1:60696, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741885_1061, duration: 3213000
2015-03-13 10:05:37,806 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741885_1061, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:37,806 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741885_1061{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:37,807 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741886_1062 src: /127.0.0.1:61130 dest: /127.0.0.1:60696
2015-03-13 10:05:37,807 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741885_1061{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:37,807 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61126, dest: /127.0.0.1:60689, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741885_1061, duration: 3938000
2015-03-13 10:05:37,808 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741885_1061{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:37,808 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741885_1061, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:37,809 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741886_1062 src: /127.0.0.1:61131 dest: /127.0.0.1:60693
2015-03-13 10:05:37,811 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:05:37,811 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741886_1062 src: /127.0.0.1:61132 dest: /127.0.0.1:60686
2015-03-13 10:05:37,812 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:37,814 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61132, dest: /127.0.0.1:60686, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741886_1062, duration: 1541000
2015-03-13 10:05:37,814 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741886_1062, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:37,814 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:37,814 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741886_1062{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:37,815 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61131, dest: /127.0.0.1:60693, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741886_1062, duration: 1901000
2015-03-13 10:05:37,815 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741886_1062, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:37,815 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741886_1062{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:37,815 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61130, dest: /127.0.0.1:60696, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741886_1062, duration: 2863000
2015-03-13 10:05:37,816 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741886_1062, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:37,817 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741886_1062{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:37,817 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073741887_1063{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:05:37,818 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:05:37,818 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:05:37,818 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741887_1063 src: /127.0.0.1:61133 dest: /127.0.0.1:60689
2015-03-13 10:05:37,819 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:37,820 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741887_1063 src: /127.0.0.1:61134 dest: /127.0.0.1:60693
2015-03-13 10:05:37,821 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741887_1063 src: /127.0.0.1:61135 dest: /127.0.0.1:60696
2015-03-13 10:05:37,822 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:37,823 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:05:37,823 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61135, dest: /127.0.0.1:60696, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741887_1063, duration: 1050000
2015-03-13 10:05:37,824 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741887_1063, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:37,824 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741887_1063{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:05:37,824 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:05:37,824 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61134, dest: /127.0.0.1:60693, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741887_1063, duration: 1646000
2015-03-13 10:05:37,825 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741887_1063, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:37,825 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2015-03-13 10:05:37,825 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61133, dest: /127.0.0.1:60689, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741887_1063, duration: 2384000
2015-03-13 10:05:37,825 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741887_1063{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:05:37,825 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741887_1063, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:37,826 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741887_1063{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:05:37,827 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:05:37,827 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2015-03-13 10:05:37,827 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:05:37,828 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:05:37,833 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:37,835 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:37,865 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073741888_1064{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:05:37,866 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741888_1064 src: /127.0.0.1:61136 dest: /127.0.0.1:60686
2015-03-13 10:05:37,868 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741888_1064 src: /127.0.0.1:61137 dest: /127.0.0.1:60689
2015-03-13 10:05:37,869 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741888_1064 src: /127.0.0.1:61138 dest: /127.0.0.1:60693
2015-03-13 10:05:37,876 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073741889_1065{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:05:37,876 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61138, dest: /127.0.0.1:60693, bytes: 97970, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741888_1064, duration: 5358000
2015-03-13 10:05:37,876 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741888_1064, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:37,877 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741888_1064{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:37,877 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61137, dest: /127.0.0.1:60689, bytes: 97970, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741888_1064, duration: 5900000
2015-03-13 10:05:37,877 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741888_1064, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:37,878 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741889_1065 src: /127.0.0.1:61139 dest: /127.0.0.1:60686
2015-03-13 10:05:37,878 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61136, dest: /127.0.0.1:60686, bytes: 97970, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741888_1064, duration: 7100000
2015-03-13 10:05:37,878 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741888_1064, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:37,878 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741888_1064{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:37,879 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741888_1064{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:37,880 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741889_1065 src: /127.0.0.1:61140 dest: /127.0.0.1:60689
2015-03-13 10:05:37,881 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:05:37,881 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0005
2015-03-13 10:05:37,882 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741889_1065 src: /127.0.0.1:61141 dest: /127.0.0.1:60693
2015-03-13 10:05:37,883 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005	dst=null	perm=null
2015-03-13 10:05:37,884 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.xml	dst=null	perm=null
2015-03-13 10:05:37,885 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.xml	dst=null	perm=null
2015-03-13 10:05:37,885 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.jar	dst=null	perm=null
2015-03-13 10:05:37,886 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.jar	dst=null	perm=null
2015-03-13 10:05:37,887 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.split	dst=null	perm=null
2015-03-13 10:05:37,887 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.split	dst=null	perm=null
2015-03-13 10:05:37,888 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:05:37,889 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:05:37,891 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:05:37,892 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:05:37,892 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:05:37,893 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:05:37,894 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:05:37,895 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:05:37,896 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 5 submitted by user soberoi
2015-03-13 10:05:37,896 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0005
2015-03-13 10:05:37,896 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	IP=10.1.1.144	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1426266260362_0005
2015-03-13 10:05:37,897 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0005
2015-03-13 10:05:37,897 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0005 State change from NEW to NEW_SAVING
2015-03-13 10:05:37,897 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0005 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:05:37,897 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0005_000001
2015-03-13 10:05:37,897 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0005_000001 State change from NEW to SUBMITTED
2015-03-13 10:05:37,898 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0005 from user: soberoi activated in queue: default
2015-03-13 10:05:37,898 INFO  capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0005 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:05:37,898 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0005 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:05:37,898 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0005 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:05:37,898 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0005_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:05:37,898 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0005_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:05:37,900 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0005 State change from SUBMITTED to ACCEPTED
2015-03-13 10:05:37,902 INFO  mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0005/
2015-03-13 10:05:37,902 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1426266260362_0005
2015-03-13 10:05:37,902 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0005/
2015-03-13 10:05:37,902 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61141, dest: /127.0.0.1:60693, bytes: 97970, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741889_1065, duration: 19339000
2015-03-13 10:05:37,903 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741889_1065, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:37,903 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741889_1065{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:37,903 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61140, dest: /127.0.0.1:60689, bytes: 97970, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741889_1065, duration: 19328000
2015-03-13 10:05:37,903 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741889_1065, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:37,904 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741889_1065{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:37,904 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61139, dest: /127.0.0.1:60686, bytes: 97970, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741889_1065, duration: 20068000
2015-03-13 10:05:37,904 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741889_1065, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:37,905 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741889_1065{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:37,907 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:05:37,907 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0006
2015-03-13 10:05:37,909 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006	dst=null	perm=null
2015-03-13 10:05:37,910 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.xml	dst=null	perm=null
2015-03-13 10:05:37,911 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.xml	dst=null	perm=null
2015-03-13 10:05:37,912 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.jar	dst=null	perm=null
2015-03-13 10:05:37,913 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.jar	dst=null	perm=null
2015-03-13 10:05:37,914 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.split	dst=null	perm=null
2015-03-13 10:05:37,915 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.split	dst=null	perm=null
2015-03-13 10:05:37,916 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:05:37,917 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:05:37,919 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:05:37,920 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:05:37,920 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:05:37,921 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:05:37,922 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:05:37,923 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:05:37,924 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 6 submitted by user soberoi
2015-03-13 10:05:37,924 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0006
2015-03-13 10:05:37,925 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	IP=10.1.1.144	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1426266260362_0006
2015-03-13 10:05:37,925 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0006
2015-03-13 10:05:37,925 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0006 State change from NEW to NEW_SAVING
2015-03-13 10:05:37,925 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0006 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:05:37,925 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0006_000001
2015-03-13 10:05:37,925 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0006_000001 State change from NEW to SUBMITTED
2015-03-13 10:05:37,926 INFO  capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0006 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 1 #user-active-applications: 2 #queue-pending-applications: 1 #queue-active-applications: 2
2015-03-13 10:05:37,926 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0006 user: soberoi leaf-queue of parent: root #applications: 3
2015-03-13 10:05:37,926 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0006_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=3, numContainers=1, currently active: 3
2015-03-13 10:05:37,926 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0006 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:05:37,926 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0006_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:05:37,926 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0006 State change from SUBMITTED to ACCEPTED
2015-03-13 10:05:37,928 INFO  mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0006/
2015-03-13 10:05:37,929 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1426266260362_0006
2015-03-13 10:05:37,929 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0006/
2015-03-13 10:05:38,099 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0005_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:05:38,099 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0005	CONTAINERID=container_1426266260362_0005_01_000001
2015-03-13 10:05:38,099 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0005_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:05:38,100 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0005 container=Container: [ContainerId: container_1426266260362_0005_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0005_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=3, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:38,100 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=3, numContainers=2
2015-03-13 10:05:38,100 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0005_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:05:38,100 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:38,101 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0005 AttemptId: appattempt_1426266260362_0005_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0005_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ]
2015-03-13 10:05:38,101 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0005_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:05:38,101 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0005_000001
2015-03-13 10:05:38,102 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0005_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:05:38,102 INFO  amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0005_000001
2015-03-13 10:05:38,103 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0005_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] for AM appattempt_1426266260362_0005_000001
2015-03-13 10:05:38,103 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0005_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-03-13 10:05:38,106 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0005_000001 (auth:SIMPLE)
2015-03-13 10:05:38,108 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0005_01_000001 by user soberoi
2015-03-13 10:05:38,108 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0005
2015-03-13 10:05:38,108 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0005	CONTAINERID=container_1426266260362_0005_01_000001
2015-03-13 10:05:38,108 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0005 transitioned from NEW to INITING
2015-03-13 10:05:38,109 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0005_01_000001 to application application_1426266260362_0005
2015-03-13 10:05:38,109 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0005 transitioned from INITING to RUNNING
2015-03-13 10:05:38,109 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0005_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] for AM appattempt_1426266260362_0005_000001
2015-03-13 10:05:38,109 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0005_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:05:38,109 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:05:38,109 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0005
2015-03-13 10:05:38,109 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:05:38,110 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:05:38,110 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:05:38,110 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:05:38,110 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0005_01_000001
2015-03-13 10:05:38,120 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0005_01_000001.tokens. Credentials list: 
2015-03-13 10:05:38,135 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:05:38,209 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0005_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000001.tokens
2015-03-13 10:05:38,209 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0005 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0005
2015-03-13 10:05:38,269 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.jar	dst=null	perm=null
2015-03-13 10:05:38,270 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.jar	dst=null	perm=null
2015-03-13 10:05:38,271 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.jar	dst=null	perm=null
2015-03-13 10:05:38,279 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61112, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-44404711_3130, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741882_1058, duration: 544000
2015-03-13 10:05:38,299 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:05:38,315 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:05:38,316 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:05:38,317 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:05:38,323 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61113, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-44404711_3130, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741886_1062, duration: 180000
2015-03-13 10:05:38,335 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:05:38,352 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.split	dst=null	perm=null
2015-03-13 10:05:38,353 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.split	dst=null	perm=null
2015-03-13 10:05:38,353 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.split	dst=null	perm=null
2015-03-13 10:05:38,359 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61114, bytes: 1798, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-44404711_3130, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741884_1060, duration: 174000
2015-03-13 10:05:38,371 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:05:38,388 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.xml	dst=null	perm=null
2015-03-13 10:05:38,389 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.xml	dst=null	perm=null
2015-03-13 10:05:38,389 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.xml	dst=null	perm=null
2015-03-13 10:05:38,395 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61113, bytes: 98738, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-44404711_3130, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741888_1064, duration: 304000
2015-03-13 10:05:38,409 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:05:38,409 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:05:38,434 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:05:38,434 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:38,503 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000001/default_container_executor.sh]
2015-03-13 10:05:38,631 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:39,103 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:39,104 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0005_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:05:39,518 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741878_1054
2015-03-13 10:05:39,518 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741886_1062
2015-03-13 10:05:39,519 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741884_1060
2015-03-13 10:05:39,519 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741880_1056
2015-03-13 10:05:39,519 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741877_1053
2015-03-13 10:05:39,636 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:39,678 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60693 to replicate blk_1073741882_1058 to datanode(s) 127.0.0.1:60696
2015-03-13 10:05:39,679 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60689 to replicate blk_1073741883_1059 to datanode(s) 127.0.0.1:60686
2015-03-13 10:05:39,679 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073741872_1048, blk_1073741873_1049, blk_1073741869_1045, blk_1073741870_1046]
2015-03-13 10:05:39,679 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073741872_1048, blk_1073741873_1049, blk_1073741875_1051, blk_1073741869_1045, blk_1073741870_1046, blk_1073741871_1047]
2015-03-13 10:05:39,724 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741882_1058
2015-03-13 10:05:39,725 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741876_1052
2015-03-13 10:05:39,725 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741874_1050
2015-03-13 10:05:39,726 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741881_1057
2015-03-13 10:05:39,737 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741874_1050
2015-03-13 10:05:39,738 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741889_1065
2015-03-13 10:05:39,739 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741875_1051
2015-03-13 10:05:39,903 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741881_1057
2015-03-13 10:05:39,903 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741885_1061
2015-03-13 10:05:39,904 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741887_1063
2015-03-13 10:05:39,904 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741879_1055
2015-03-13 10:05:39,904 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741876_1052
2015-03-13 10:05:39,905 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741877_1053
2015-03-13 10:05:39,905 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741875_1051
2015-03-13 10:05:39,905 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741884_1060
2015-03-13 10:05:39,906 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741880_1056
2015-03-13 10:05:39,923 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741889_1065
2015-03-13 10:05:39,924 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741885_1061
2015-03-13 10:05:39,925 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741888_1064
2015-03-13 10:05:39,942 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741882_1058
2015-03-13 10:05:39,942 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741878_1054
2015-03-13 10:05:39,943 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741886_1062
2015-03-13 10:05:39,943 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741885_1061
2015-03-13 10:05:39,946 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741885_1061
2015-03-13 10:05:39,947 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741881_1057
2015-03-13 10:05:39,947 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741877_1053
2015-03-13 10:05:39,948 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741884_1060
2015-03-13 10:05:39,948 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741878_1054
2015-03-13 10:05:39,948 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741874_1050
2015-03-13 10:05:39,950 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741882_1058
2015-03-13 10:05:40,108 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:40,109 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741883_1059
2015-03-13 10:05:40,109 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741886_1062
2015-03-13 10:05:40,142 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741883_1059
2015-03-13 10:05:40,143 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741884_1060
2015-03-13 10:05:40,143 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741887_1063
2015-03-13 10:05:40,143 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741879_1055
2015-03-13 10:05:40,150 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741883_1059
2015-03-13 10:05:40,151 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741887_1063
2015-03-13 10:05:40,151 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741876_1052
2015-03-13 10:05:40,158 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:05:40,179 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/COMMIT_STARTED	dst=null	perm=null
2015-03-13 10:05:40,180 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/COMMIT_SUCCESS	dst=null	perm=null
2015-03-13 10:05:40,181 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/COMMIT_FAIL	dst=null	perm=null
2015-03-13 10:05:40,234 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005	dst=null	perm=null
2015-03-13 10:05:40,236 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:05:40,238 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:05:40,341 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741888_1064
2015-03-13 10:05:40,353 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741888_1064
2015-03-13 10:05:40,354 INFO  datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-1172757413-10.1.1.144-60689-1426266259165, infoPort=60690, ipcPort=60692, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073741883_1059 to 127.0.0.1:60686 
2015-03-13 10:05:40,354 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741875_1051
2015-03-13 10:05:40,355 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741872_1048 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741872 for deletion
2015-03-13 10:05:40,355 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741880_1056
2015-03-13 10:05:40,355 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741873_1049 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741873 for deletion
2015-03-13 10:05:40,355 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741869_1045 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741869 for deletion
2015-03-13 10:05:40,355 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741870_1046 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741870 for deletion
2015-03-13 10:05:40,355 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741879_1055
2015-03-13 10:05:40,356 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741872_1048 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741872
2015-03-13 10:05:40,356 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741869_1045 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741869
2015-03-13 10:05:40,356 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741873_1049 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741873
2015-03-13 10:05:40,356 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741870_1046 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741870
2015-03-13 10:05:40,356 INFO  datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073741883_1059 (numBytes=254067) to /127.0.0.1:60686
2015-03-13 10:05:40,356 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741883_1059 src: /127.0.0.1:61146 dest: /127.0.0.1:60686
2015-03-13 10:05:40,358 INFO  datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073741883_1059 src: /127.0.0.1:61146 dest: /127.0.0.1:60686 of size 254067
2015-03-13 10:05:40,359 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741883_1059 size 254067
2015-03-13 10:05:40,518 INFO  datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-1589780806-10.1.1.144-60693-1426266259390, infoPort=60694, ipcPort=60695, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073741882_1058 to 127.0.0.1:60696 
2015-03-13 10:05:40,519 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741872_1048 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741872 for deletion
2015-03-13 10:05:40,519 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741873_1049 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741873 for deletion
2015-03-13 10:05:40,519 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741875_1051 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741875 for deletion
2015-03-13 10:05:40,519 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741872_1048 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741872
2015-03-13 10:05:40,519 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741869_1045 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741869 for deletion
2015-03-13 10:05:40,520 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741870_1046 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741870 for deletion
2015-03-13 10:05:40,520 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741871_1047 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741871 for deletion
2015-03-13 10:05:40,520 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741873_1049 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741873
2015-03-13 10:05:40,520 INFO  datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073741882_1058 (numBytes=254067) to /127.0.0.1:60696
2015-03-13 10:05:40,520 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741870_1046 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741870
2015-03-13 10:05:40,520 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741882_1058 src: /127.0.0.1:61147 dest: /127.0.0.1:60696
2015-03-13 10:05:40,520 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741875_1051 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741875
2015-03-13 10:05:40,521 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741869_1045 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741869
2015-03-13 10:05:40,521 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741871_1047 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741871
2015-03-13 10:05:40,522 INFO  datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073741882_1058 src: /127.0.0.1:61147 dest: /127.0.0.1:60696 of size 254067
2015-03-13 10:05:40,523 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741882_1058 size 254067
2015-03-13 10:05:40,540 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:05:40,548 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:05:40,550 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741889_1065
2015-03-13 10:05:40,605 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61148, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_24858168_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741886_1062, duration: 151000
2015-03-13 10:05:40,642 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:41,110 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:41,420 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0005_000001 (auth:SIMPLE)
2015-03-13 10:05:41,423 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0005_000001
2015-03-13 10:05:41,423 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi	IP=10.1.1.144	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1426266260362_0005	APPATTEMPTID=appattempt_1426266260362_0005_000001
2015-03-13 10:05:41,423 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0005_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:05:41,423 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0005 State change from ACCEPTED to RUNNING
2015-03-13 10:05:41,443 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job_1426266260362_0005_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:41,445 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-soberoi/3391551687_upper_6F2967859C074FB3A05AC9B5C5BE893F/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:05:41,503 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job_1426266260362_0005_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:41,637 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job_1426266260362_0005_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073741890_1066{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:05:41,644 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:41,680 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741890_1066 src: /127.0.0.1:61154 dest: /127.0.0.1:60689
2015-03-13 10:05:41,681 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741890_1066 src: /127.0.0.1:61155 dest: /127.0.0.1:60693
2015-03-13 10:05:41,683 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741890_1066 src: /127.0.0.1:61156 dest: /127.0.0.1:60686
2015-03-13 10:05:41,690 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61156, dest: /127.0.0.1:60686, bytes: 90682, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_24858168_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741890_1066, duration: 5507000
2015-03-13 10:05:41,690 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741890_1066, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:41,690 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741890_1066{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:41,691 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61155, dest: /127.0.0.1:60693, bytes: 90682, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_24858168_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741890_1066, duration: 6230000
2015-03-13 10:05:41,691 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741890_1066, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:41,691 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741890_1066{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:41,691 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61154, dest: /127.0.0.1:60689, bytes: 90682, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_24858168_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741890_1066, duration: 7284000
2015-03-13 10:05:41,692 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741890_1066, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:41,692 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741890_1066{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:41,696 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job_1426266260362_0005_1_conf.xml is closed by DFSClient_NONMAPREDUCE_24858168_1
2015-03-13 10:05:42,116 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:42,648 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:42,649 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0005_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:05:42,649 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0005	CONTAINERID=container_1426266260362_0005_01_000002
2015-03-13 10:05:42,649 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0005_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:05:42,650 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0005 container=Container: [ContainerId: container_1426266260362_0005_01_000002, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0005_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=3, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:42,650 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=3, numContainers=3
2015-03-13 10:05:42,650 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:42,650 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0005_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:05:42,650 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0005	CONTAINERID=container_1426266260362_0005_01_000003
2015-03-13 10:05:42,651 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0005_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available
2015-03-13 10:05:42,651 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0005 container=Container: [ContainerId: container_1426266260362_0005_01_000003, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0005_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=3, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:42,651 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=3, numContainers=4
2015-03-13 10:05:42,651 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:42,661 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0004_01_000001 succeeded 
2015-03-13 10:05:42,661 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:05:42,661 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0004_01_000001
2015-03-13 10:05:42,669 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000001
2015-03-13 10:05:42,669 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000001
2015-03-13 10:05:42,669 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0004	CONTAINERID=container_1426266260362_0004_01_000001
2015-03-13 10:05:42,669 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:05:42,669 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000001
2015-03-13 10:05:42,669 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000001
2015-03-13 10:05:42,669 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0004_01_000001 from application application_1426266260362_0004
2015-03-13 10:05:42,670 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:42,670 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0004
2015-03-13 10:05:42,674 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0005_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:05:42,675 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0005	CONTAINERID=container_1426266260362_0005_01_000004
2015-03-13 10:05:42,675 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0005_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:05:42,675 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0005 container=Container: [ContainerId: container_1426266260362_0005_01_000004, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0005_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=3, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:42,675 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=3, numContainers=5
2015-03-13 10:05:42,675 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:42,675 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0005_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:05:42,676 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0005	CONTAINERID=container_1426266260362_0005_01_000005
2015-03-13 10:05:42,676 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0005_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:05:42,676 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0005 container=Container: [ContainerId: container_1426266260362_0005_01_000005, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0005_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=3, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:42,676 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=3, numContainers=6
2015-03-13 10:05:42,676 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:42,676 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0005_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:05:42,677 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0005	CONTAINERID=container_1426266260362_0005_01_000006
2015-03-13 10:05:42,677 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0005_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:05:42,677 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0005 container=Container: [ContainerId: container_1426266260362_0005_01_000006, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0005_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=3, numContainers=6 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:42,677 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=3, numContainers=7
2015-03-13 10:05:42,677 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:42,685 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073741872_1048, blk_1073741873_1049, blk_1073741875_1051, blk_1073741869_1045, blk_1073741870_1046, blk_1073741871_1047]
2015-03-13 10:05:42,685 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073741875_1051, blk_1073741869_1045, blk_1073741870_1046, blk_1073741871_1047]
2015-03-13 10:05:43,120 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:43,360 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741872_1048 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741872 for deletion
2015-03-13 10:05:43,360 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741873_1049 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741873 for deletion
2015-03-13 10:05:43,361 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741875_1051 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741875 for deletion
2015-03-13 10:05:43,361 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741872_1048 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741872
2015-03-13 10:05:43,361 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741869_1045 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741869 for deletion
2015-03-13 10:05:43,361 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741870_1046 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741870 for deletion
2015-03-13 10:05:43,361 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741873_1049 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741873
2015-03-13 10:05:43,362 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741871_1047 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741871 for deletion
2015-03-13 10:05:43,362 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741870_1046 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741870
2015-03-13 10:05:43,362 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741875_1051 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741875
2015-03-13 10:05:43,363 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741869_1045 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741869
2015-03-13 10:05:43,363 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741871_1047 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741871
2015-03-13 10:05:43,459 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0005_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:05:43,460 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0005_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:05:43,460 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0005_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:05:43,460 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0005_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:05:43,460 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0005_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:05:43,486 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.jar	dst=null	perm=null
2015-03-13 10:05:43,487 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.jar	dst=null	perm=null
2015-03-13 10:05:43,495 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.xml	dst=null	perm=null
2015-03-13 10:05:43,496 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.xml	dst=null	perm=null
2015-03-13 10:05:43,499 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:05:43,500 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:05:43,505 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:05:43,507 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:05:43,508 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:05:43,509 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:05:43,584 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0005_000001 (auth:SIMPLE)
2015-03-13 10:05:43,584 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0005_000001 (auth:SIMPLE)
2015-03-13 10:05:43,587 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0005_01_000002 by user soberoi
2015-03-13 10:05:43,587 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0005_01_000005 by user soberoi
2015-03-13 10:05:43,588 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0005
2015-03-13 10:05:43,588 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0005	CONTAINERID=container_1426266260362_0005_01_000005
2015-03-13 10:05:43,588 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0005_01_000006 by user soberoi
2015-03-13 10:05:43,587 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0005
2015-03-13 10:05:43,588 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0005	CONTAINERID=container_1426266260362_0005_01_000006
2015-03-13 10:05:43,588 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0005	CONTAINERID=container_1426266260362_0005_01_000002
2015-03-13 10:05:43,587 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0005_01_000003 by user soberoi
2015-03-13 10:05:43,589 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0005 transitioned from NEW to INITING
2015-03-13 10:05:43,589 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0005	CONTAINERID=container_1426266260362_0005_01_000003
2015-03-13 10:05:43,588 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0005 transitioned from NEW to INITING
2015-03-13 10:05:43,589 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0005_01_000005 to application application_1426266260362_0005
2015-03-13 10:05:43,589 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0005_01_000006 to application application_1426266260362_0005
2015-03-13 10:05:43,589 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0005 transitioned from INITING to RUNNING
2015-03-13 10:05:43,590 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:05:43,590 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:05:43,590 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0005
2015-03-13 10:05:43,590 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0005
2015-03-13 10:05:43,590 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:05:43,590 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0005
2015-03-13 10:05:43,588 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0005_01_000004 by user soberoi
2015-03-13 10:05:43,591 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0005	CONTAINERID=container_1426266260362_0005_01_000004
2015-03-13 10:05:43,590 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:05:43,591 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:05:43,591 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0005
2015-03-13 10:05:43,592 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0005
2015-03-13 10:05:43,592 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:05:43,592 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0005
2015-03-13 10:05:43,589 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0005_01_000002 to application application_1426266260362_0005
2015-03-13 10:05:43,592 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0005_01_000003 to application application_1426266260362_0005
2015-03-13 10:05:43,592 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0005 transitioned from INITING to RUNNING
2015-03-13 10:05:43,592 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0005_01_000006
2015-03-13 10:05:43,593 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:05:43,593 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:05:43,593 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0005
2015-03-13 10:05:43,593 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0005
2015-03-13 10:05:43,594 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:05:43,594 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0005
2015-03-13 10:05:43,594 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:05:43,594 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0005_01_000004 to application application_1426266260362_0005
2015-03-13 10:05:43,594 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0005_01_000005
2015-03-13 10:05:43,594 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:05:43,595 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0005
2015-03-13 10:05:43,595 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0005
2015-03-13 10:05:43,595 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:05:43,595 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0005
2015-03-13 10:05:43,595 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0005_01_000002
2015-03-13 10:05:43,596 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:05:43,596 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0005
2015-03-13 10:05:43,596 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0005
2015-03-13 10:05:43,596 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:05:43,596 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0005
2015-03-13 10:05:43,597 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0005_01_000004
2015-03-13 10:05:43,598 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0005_01_000003
2015-03-13 10:05:43,620 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1426266260362_0005_01_000006.tokens. Credentials list: 
2015-03-13 10:05:43,624 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0005_01_000005.tokens. Credentials list: 
2015-03-13 10:05:43,626 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0005_01_000004.tokens. Credentials list: 
2015-03-13 10:05:43,627 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1426266260362_0005_01_000003.tokens. Credentials list: 
2015-03-13 10:05:43,628 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1426266260362_0005_01_000002.tokens. Credentials list: 
2015-03-13 10:05:43,642 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:05:43,647 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:05:43,651 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:05:43,651 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0004_01_000001
2015-03-13 10:05:43,651 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:43,651 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:43,652 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0005_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:05:43,652 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0005_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:05:43,652 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0004_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:05:43,652 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0004_000001
2015-03-13 10:05:43,652 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0004_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:05:43,653 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0004_000001 State change from FINISHING to FINISHED
2015-03-13 10:05:43,653 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0004 State change from FINISHING to FINISHED
2015-03-13 10:05:43,653 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0004	CONTAINERID=container_1426266260362_0004_01_000001
2015-03-13 10:05:43,653 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0004_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60723, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:05:43,653 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:7168, vCores:6> numContainers=6 user=soberoi user-resources=<memory:7168, vCores:6>
2015-03-13 10:05:43,653 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1426266260362_0004
2015-03-13 10:05:43,653 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0004_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=3, numContainers=6 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:43,653 INFO  amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0004_000001
2015-03-13 10:05:43,653 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:43,654 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=3, numContainers=6
2015-03-13 10:05:43,654 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0004_000001 released container container_1426266260362_0004_01_000001 on node: host: 10.1.1.144:60723 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:05:43,654 INFO  capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0004_000001 is done. finalState=FINISHED
2015-03-13 10:05:43,653 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0004,name=[DF98BEF6B79549DA8449852A7CBDC6EB/5EF25D47FD21419386DBBAEE8B2D20AA] tail/(1/1) ...ipesplatform/renamedpipes,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0004/jobhistory/job/job_1426266260362_0004,appMasterHost=Edinburgh.local,startTime=1426266320047,finishTime=1426266336512,finalStatus=SUCCEEDED
2015-03-13 10:05:43,654 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0004 requests cleared
2015-03-13 10:05:43,654 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0006 from user: soberoi activated in queue: default
2015-03-13 10:05:43,655 INFO  capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0004 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:05:43,655 INFO  capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0004 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:05:43,657 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0004_000001 (auth:SIMPLE)
2015-03-13 10:05:43,659 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0004_01_000001
2015-03-13 10:05:43,675 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:43,675 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:43,675 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:43,676 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0004 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:05:43,676 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0005_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:05:43,676 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0005_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:05:43,676 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0005_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:05:43,676 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0004
2015-03-13 10:05:43,676 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0004
2015-03-13 10:05:43,676 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0004 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:05:43,677 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0004
2015-03-13 10:05:43,677 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0004
2015-03-13 10:05:43,677 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0004
2015-03-13 10:05:43,677 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0004, with delay of 10800 seconds
2015-03-13 10:05:43,677 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0006_01_000001 Container Transitioned from NEW to RESERVED
2015-03-13 10:05:43,678 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:reserve(432)) - Application application_1426266260362_0006 reserved container container_1426266260362_0006_01_000001 on node host: 10.1.1.144:60715 #containers=3 available=1024 used=3072, currently has 1 at priority 0; currentReservation 2048
2015-03-13 10:05:43,678 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:reserveResource(237)) - Reserved container container_1426266260362_0006_01_000001 on node host: 10.1.1.144:60715 #containers=3 available=1024 used=3072 for application org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.fica.FiCaSchedulerApp@3b48284e
2015-03-13 10:05:43,678 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1381)) - Reserved container  application=application_1426266260362_0006 resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:43,678 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7
2015-03-13 10:05:43,678 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:43,697 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741875_1051 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741875 for deletion
2015-03-13 10:05:43,697 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741869_1045 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741869 for deletion
2015-03-13 10:05:43,697 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741870_1046 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741870 for deletion
2015-03-13 10:05:43,698 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741871_1047 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741871 for deletion
2015-03-13 10:05:43,698 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741875_1051 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741875
2015-03-13 10:05:43,698 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741869_1045 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741869
2015-03-13 10:05:43,698 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741871_1047 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741871
2015-03-13 10:05:43,699 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741870_1046 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741870
2015-03-13 10:05:43,726 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1426266260362_0005_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000006.tokens
2015-03-13 10:05:43,726 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0005 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0005
2015-03-13 10:05:43,730 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1426266260362_0005_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000003.tokens
2015-03-13 10:05:43,730 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0005 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0005
2015-03-13 10:05:43,794 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.jar	dst=null	perm=null
2015-03-13 10:05:43,795 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.jar	dst=null	perm=null
2015-03-13 10:05:43,796 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.jar	dst=null	perm=null
2015-03-13 10:05:43,799 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.jar	dst=null	perm=null
2015-03-13 10:05:43,800 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.jar	dst=null	perm=null
2015-03-13 10:05:43,801 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.jar	dst=null	perm=null
2015-03-13 10:05:43,806 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61164, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-922574451_3278, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741882_1058, duration: 606000
2015-03-13 10:05:43,812 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61165, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-853821759_3281, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741882_1058, duration: 588000
2015-03-13 10:05:43,829 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:05:43,832 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:05:43,848 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.xml	dst=null	perm=null
2015-03-13 10:05:43,849 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.xml	dst=null	perm=null
2015-03-13 10:05:43,849 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.xml	dst=null	perm=null
2015-03-13 10:05:43,852 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.xml	dst=null	perm=null
2015-03-13 10:05:43,853 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.xml	dst=null	perm=null
2015-03-13 10:05:43,854 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.xml	dst=null	perm=null
2015-03-13 10:05:43,857 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61166, bytes: 98738, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-922574451_3278, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741888_1064, duration: 244000
2015-03-13 10:05:43,862 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61165, bytes: 98738, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-853821759_3281, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741888_1064, duration: 379000
2015-03-13 10:05:43,872 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:05:43,872 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:05:43,872 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:05:43,872 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:05:43,878 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:05:43,878 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:05:43,878 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:05:43,922 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:05:43,922 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:43,929 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:05:43,930 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:43,931 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:05:43,931 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:43,931 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:05:43,931 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:43,931 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:05:43,931 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:44,078 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000005/default_container_executor.sh]
2015-03-13 10:05:44,078 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000003/default_container_executor.sh]
2015-03-13 10:05:44,085 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000004/default_container_executor.sh]
2015-03-13 10:05:44,086 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000002/default_container_executor.sh]
2015-03-13 10:05:44,088 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000006/default_container_executor.sh]
2015-03-13 10:05:44,121 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:44,375 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0004 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:05:44,375 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0004
2015-03-13 10:05:44,375 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0004
2015-03-13 10:05:44,376 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0004 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:05:44,376 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0004, with delay of 10800 seconds
2015-03-13 10:05:44,376 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0004
2015-03-13 10:05:44,377 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0004
2015-03-13 10:05:44,377 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0004
2015-03-13 10:05:44,478 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:05:44,655 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:44,656 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:44,656 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0004 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:05:44,656 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0004
2015-03-13 10:05:44,656 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0004
2015-03-13 10:05:44,657 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0004
2015-03-13 10:05:44,657 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0004
2015-03-13 10:05:44,657 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0004
2015-03-13 10:05:44,658 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0004 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:05:44,658 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0004, with delay of 10800 seconds
2015-03-13 10:05:44,679 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:44,679 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:44,680 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:44,680 INFO  capacity.CapacityScheduler (CapacityScheduler.java:nodeUpdate(668)) - Trying to fulfill reservation for application application_1426266260362_0006 on node: 10.1.1.144:60715
2015-03-13 10:05:44,680 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:reserve(432)) - Application application_1426266260362_0006 reserved container container_1426266260362_0006_01_000001 on node host: 10.1.1.144:60715 #containers=3 available=1024 used=3072, currently has 1 at priority 0; currentReservation 2048
2015-03-13 10:05:44,680 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:reserveResource(233)) - Updated reserved container container_1426266260362_0006_01_000001 on node host: 10.1.1.144:60715 #containers=3 available=1024 used=3072 for application org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.fica.FiCaSchedulerApp@3b48284e
2015-03-13 10:05:44,681 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1381)) - Reserved container  application=application_1426266260362_0006 resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7 usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:44,681 INFO  capacity.CapacityScheduler (CapacityScheduler.java:nodeUpdate(692)) - Skipping scheduling since node 10.1.1.144:60715 is reserved by application appattempt_1426266260362_0006_000001
2015-03-13 10:05:44,901 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:05:44,907 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:05:44,928 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741890_1066
2015-03-13 10:05:45,022 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0005_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000004.tokens
2015-03-13 10:05:45,022 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0005 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0005
2015-03-13 10:05:45,032 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1426266260362_0005_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000002.tokens
2015-03-13 10:05:45,032 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0005 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0005
2015-03-13 10:05:45,123 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:45,134 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741883_1059
2015-03-13 10:05:45,179 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:05:45,314 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741882_1058
2015-03-13 10:05:45,319 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0005_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000005.tokens
2015-03-13 10:05:45,320 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0005 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0005
2015-03-13 10:05:45,345 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741890_1066
2015-03-13 10:05:45,553 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741890_1066
2015-03-13 10:05:45,661 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:45,662 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:45,681 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:45,681 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:45,681 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:45,681 INFO  capacity.CapacityScheduler (CapacityScheduler.java:nodeUpdate(668)) - Trying to fulfill reservation for application application_1426266260362_0006 on node: 10.1.1.144:60715
2015-03-13 10:05:45,682 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:reserve(432)) - Application application_1426266260362_0006 reserved container container_1426266260362_0006_01_000001 on node host: 10.1.1.144:60715 #containers=3 available=1024 used=3072, currently has 1 at priority 0; currentReservation 2048
2015-03-13 10:05:45,682 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:reserveResource(233)) - Updated reserved container container_1426266260362_0006_01_000001 on node host: 10.1.1.144:60715 #containers=3 available=1024 used=3072 for application org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.fica.FiCaSchedulerApp@3b48284e
2015-03-13 10:05:45,682 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1381)) - Reserved container  application=application_1426266260362_0006 resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7 usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:45,682 INFO  capacity.CapacityScheduler (CapacityScheduler.java:nodeUpdate(692)) - Skipping scheduling since node 10.1.1.144:60715 is reserved by application appattempt_1426266260362_0006_000001
2015-03-13 10:05:46,124 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:46,125 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0006_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:05:46,125 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0006	CONTAINERID=container_1426266260362_0006_01_000002
2015-03-13 10:05:46,125 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0006_01_000002 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:4096, vCores:2> used and <memory:0, vCores:6> available
2015-03-13 10:05:46,126 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0006 container=Container: [ContainerId: container_1426266260362_0006_01_000002, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0006_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7 usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:46,126 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:11264, vCores:8>usedCapacity=0.6875, absoluteUsedCapacity=0.6875, numApps=2, numContainers=8
2015-03-13 10:05:46,126 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0006_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:05:46,126 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.6875 absoluteUsedCapacity=0.6875 used=<memory:11264, vCores:8> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:46,127 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0006 AttemptId: appattempt_1426266260362_0006_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0006_01_000002, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ]
2015-03-13 10:05:46,127 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0006_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:05:46,127 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0006_000001
2015-03-13 10:05:46,127 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0006_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:05:46,128 INFO  amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0006_000001
2015-03-13 10:05:46,129 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0006_01_000002, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] for AM appattempt_1426266260362_0006_000001
2015-03-13 10:05:46,129 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0006_01_000002 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-03-13 10:05:46,132 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0006_000001 (auth:SIMPLE)
2015-03-13 10:05:46,134 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0006_01_000002 by user soberoi
2015-03-13 10:05:46,134 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0006
2015-03-13 10:05:46,135 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0006	CONTAINERID=container_1426266260362_0006_01_000002
2015-03-13 10:05:46,135 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0006 transitioned from NEW to INITING
2015-03-13 10:05:46,135 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0006_01_000002 to application application_1426266260362_0006
2015-03-13 10:05:46,135 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0006_01_000002, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] for AM appattempt_1426266260362_0006_000001
2015-03-13 10:05:46,135 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0006 transitioned from INITING to RUNNING
2015-03-13 10:05:46,135 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0006_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:05:46,136 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:05:46,136 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0006
2015-03-13 10:05:46,136 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:05:46,136 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:05:46,136 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:05:46,136 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:05:46,136 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0006_01_000002
2015-03-13 10:05:46,152 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1426266260362_0006_01_000002.tokens. Credentials list: 
2015-03-13 10:05:46,178 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:05:46,303 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1426266260362_0006_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000002.tokens
2015-03-13 10:05:46,304 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0006 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0006
2015-03-13 10:05:46,414 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.jar	dst=null	perm=null
2015-03-13 10:05:46,415 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.jar	dst=null	perm=null
2015-03-13 10:05:46,416 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.jar	dst=null	perm=null
2015-03-13 10:05:46,426 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61173, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1084292462_3561, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741883_1059, duration: 491000
2015-03-13 10:05:46,456 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:05:46,487 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:05:46,488 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:05:46,489 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:05:46,499 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61174, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1084292462_3561, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741887_1063, duration: 176000
2015-03-13 10:05:46,521 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:05:46,555 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.split	dst=null	perm=null
2015-03-13 10:05:46,556 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.split	dst=null	perm=null
2015-03-13 10:05:46,557 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.split	dst=null	perm=null
2015-03-13 10:05:46,566 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61173, bytes: 1798, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1084292462_3561, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741885_1061, duration: 165000
2015-03-13 10:05:46,589 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:05:46,622 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.xml	dst=null	perm=null
2015-03-13 10:05:46,623 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.xml	dst=null	perm=null
2015-03-13 10:05:46,624 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.xml	dst=null	perm=null
2015-03-13 10:05:46,635 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61173, bytes: 98738, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1084292462_3561, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741889_1065, duration: 296000
2015-03-13 10:05:46,662 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:05:46,662 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:05:46,666 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:46,666 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:46,684 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:46,685 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:46,685 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:46,685 INFO  capacity.CapacityScheduler (CapacityScheduler.java:nodeUpdate(668)) - Trying to fulfill reservation for application application_1426266260362_0006 on node: 10.1.1.144:60715
2015-03-13 10:05:46,685 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:unreserve(463)) - Application application_1426266260362_0006 unreserved  on node host: 10.1.1.144:60715 #containers=3 available=1024 used=3072, currently has 0 at priority 0; currentReservation <memory:0, vCores:0>
2015-03-13 10:05:46,686 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:9216, vCores:7> numContainers=7 user=soberoi user-resources=<memory:9216, vCores:7>
2015-03-13 10:05:46,686 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0006_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: null, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7 usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:46,686 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:46,686 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7
2015-03-13 10:05:46,723 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:05:46,723 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:46,849 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000002/default_container_executor.sh]
2015-03-13 10:05:47,129 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:47,129 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:47,129 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0006_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:05:47,667 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:47,668 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:47,688 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:47,689 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:47,689 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:48,130 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:48,130 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:48,669 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:48,670 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:48,694 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:48,694 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:48,695 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:49,132 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:49,133 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:49,675 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:49,675 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:49,698 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:49,698 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:49,699 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:50,134 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:50,135 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:50,681 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:50,681 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:50,702 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:50,702 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:50,703 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:51,140 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:51,140 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:51,684 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:51,684 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:51,708 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:51,709 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:51,709 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:52,145 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:52,146 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:52,688 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:52,689 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:52,709 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:52,710 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:52,710 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:53,147 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:53,147 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:53,282 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.split	dst=null	perm=null
2015-03-13 10:05:53,359 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.split	dst=null	perm=null
2015-03-13 10:05:53,475 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.split	dst=null	perm=null
2015-03-13 10:05:53,541 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61183, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0005_m_000003_0_-845754463_1, offset: 1024, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741884_1060, duration: 174000
2015-03-13 10:05:53,578 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.split	dst=null	perm=null
2015-03-13 10:05:53,653 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61184, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0005_m_000000_0_1363540999_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741884_1060, duration: 167000
2015-03-13 10:05:53,657 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.split	dst=null	perm=null
2015-03-13 10:05:53,692 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:53,692 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:53,711 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:53,712 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:53,712 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:53,740 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61187, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0005_m_000001_0_2142799520_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741884_1060, duration: 170000
2015-03-13 10:05:53,818 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61188, bytes: 1282, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0005_m_000002_0_-1109876957_1, offset: 512, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741884_1060, duration: 175000
2015-03-13 10:05:53,832 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:05:53,841 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61190, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0005_m_000003_0_-845754463_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 169000
2015-03-13 10:05:53,858 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61189, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0005_m_000004_0_-225619000_1, offset: 1024, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741884_1060, duration: 173000
2015-03-13 10:05:53,865 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:05:53,933 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:05:53,938 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61191, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0005_m_000001_0_2142799520_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 180000
2015-03-13 10:05:53,964 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:05:53,968 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61192, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0005_m_000002_0_-1109876957_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 185000
2015-03-13 10:05:54,017 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:05:54,022 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61193, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0005_m_000004_0_-225619000_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 170000
2015-03-13 10:05:54,152 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:54,153 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:54,335 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:05:54,408 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/COMMIT_STARTED	dst=null	perm=null
2015-03-13 10:05:54,409 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/COMMIT_SUCCESS	dst=null	perm=null
2015-03-13 10:05:54,411 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/COMMIT_FAIL	dst=null	perm=null
2015-03-13 10:05:54,438 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61195, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0005_m_000000_0_1363540999_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 199000
2015-03-13 10:05:54,466 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/3391551687_upper_6F2967859C074FB3A05AC9B5C5BE893F/_temporary/1/_temporary/attempt_1426266260362_0005_m_000003_0	dst=null	perm=null
2015-03-13 10:05:54,495 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/3391551687_upper_6F2967859C074FB3A05AC9B5C5BE893F/_temporary/1/_temporary/attempt_1426266260362_0005_m_000000_0	dst=null	perm=null
2015-03-13 10:05:54,496 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0005_000001 (auth:SIMPLE)
2015-03-13 10:05:54,497 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0005_01_000005
2015-03-13 10:05:54,497 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0005	CONTAINERID=container_1426266260362_0005_01_000005
2015-03-13 10:05:54,497 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:05:54,498 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0005_01_000005
2015-03-13 10:05:54,498 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:54,498 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:05:54,498 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:54,510 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0005_01_000005 is : 143
2015-03-13 10:05:54,514 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job_1426266260362_0005_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073741891_1067{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:05:54,515 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741891_1067 src: /127.0.0.1:61198 dest: /127.0.0.1:60686
2015-03-13 10:05:54,517 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741891_1067 src: /127.0.0.1:61199 dest: /127.0.0.1:60696
2015-03-13 10:05:54,518 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741891_1067 src: /127.0.0.1:61200 dest: /127.0.0.1:60689
2015-03-13 10:05:54,522 INFO  hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job_1426266260362_0005_1.jhist for DFSClient_NONMAPREDUCE_24858168_1
2015-03-13 10:05:54,523 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:05:54,524 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000005
2015-03-13 10:05:54,524 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0005	CONTAINERID=container_1426266260362_0005_01_000005
2015-03-13 10:05:54,524 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:05:54,524 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0005_01_000005 from application application_1426266260362_0005
2015-03-13 10:05:54,524 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:54,524 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0005
2015-03-13 10:05:54,524 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000005
2015-03-13 10:05:54,524 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000005
2015-03-13 10:05:54,524 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000005
2015-03-13 10:05:54,539 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0005_000001 (auth:SIMPLE)
2015-03-13 10:05:54,541 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0005_01_000002
2015-03-13 10:05:54,541 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0005	CONTAINERID=container_1426266260362_0005_01_000002
2015-03-13 10:05:54,541 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:05:54,541 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0005_01_000002
2015-03-13 10:05:54,542 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:05:54,542 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:54,558 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0005_01_000002 is : 143
2015-03-13 10:05:54,571 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:05:54,571 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000002
2015-03-13 10:05:54,572 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000002
2015-03-13 10:05:54,572 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000002
2015-03-13 10:05:54,572 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000002
2015-03-13 10:05:54,572 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0005	CONTAINERID=container_1426266260362_0005_01_000002
2015-03-13 10:05:54,572 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:05:54,573 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0005_01_000002 from application application_1426266260362_0005
2015-03-13 10:05:54,573 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:54,573 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0005
2015-03-13 10:05:54,588 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006	dst=null	perm=null
2015-03-13 10:05:54,591 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:05:54,599 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:05:54,611 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/3391551687_upper_6F2967859C074FB3A05AC9B5C5BE893F/_temporary/1/_temporary/attempt_1426266260362_0005_m_000001_0	dst=null	perm=null
2015-03-13 10:05:54,629 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0005_01_000003
2015-03-13 10:05:54,629 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0005	CONTAINERID=container_1426266260362_0005_01_000003
2015-03-13 10:05:54,629 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:05:54,629 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0005_01_000003
2015-03-13 10:05:54,629 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:05:54,630 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0005_01_000002
2015-03-13 10:05:54,630 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:05:54,630 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0005_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:05:54,630 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0005_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:05:54,630 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0005	CONTAINERID=container_1426266260362_0005_01_000002
2015-03-13 10:05:54,631 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0005_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:05:54,631 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:8192, vCores:6> numContainers=6 user=soberoi user-resources=<memory:8192, vCores:6>
2015-03-13 10:05:54,631 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0005_01_000002, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:54,631 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:54,631 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:05:54,631 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0005_000001 released container container_1426266260362_0005_01_000002 on node: host: 10.1.1.144:60723 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:05:54,642 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0005_01_000003 is : 143
2015-03-13 10:05:54,655 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:05:54,656 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000003
2015-03-13 10:05:54,656 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000003
2015-03-13 10:05:54,656 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000003
2015-03-13 10:05:54,657 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000003
2015-03-13 10:05:54,657 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0005	CONTAINERID=container_1426266260362_0005_01_000003
2015-03-13 10:05:54,657 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:05:54,657 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0005_01_000003 from application application_1426266260362_0005
2015-03-13 10:05:54,657 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:54,658 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0005
2015-03-13 10:05:54,664 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/3391551687_upper_6F2967859C074FB3A05AC9B5C5BE893F/_temporary/1/_temporary/attempt_1426266260362_0005_m_000002_0	dst=null	perm=null
2015-03-13 10:05:54,680 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0005_01_000004
2015-03-13 10:05:54,680 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0005	CONTAINERID=container_1426266260362_0005_01_000004
2015-03-13 10:05:54,681 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:05:54,681 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0005_01_000004
2015-03-13 10:05:54,681 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:54,681 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:05:54,681 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0005_01_000005
2015-03-13 10:05:54,682 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:54,682 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0005_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:05:54,682 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0005_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:05:54,682 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0005	CONTAINERID=container_1426266260362_0005_01_000005
2015-03-13 10:05:54,682 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0005_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:05:54,682 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:7168, vCores:5> numContainers=5 user=soberoi user-resources=<memory:7168, vCores:5>
2015-03-13 10:05:54,683 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0005_01_000005, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:54,683 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:54,683 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:05:54,683 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0005_000001 released container container_1426266260362_0005_01_000005 on node: host: 10.1.1.144:60715 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:05:54,695 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0005_01_000004 is : 143
2015-03-13 10:05:54,709 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:05:54,710 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000004
2015-03-13 10:05:54,710 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000004
2015-03-13 10:05:54,710 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000004
2015-03-13 10:05:54,711 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000004
2015-03-13 10:05:54,711 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0005	CONTAINERID=container_1426266260362_0005_01_000004
2015-03-13 10:05:54,713 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:05:54,713 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0005_01_000004 from application application_1426266260362_0005
2015-03-13 10:05:54,713 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:54,713 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0005
2015-03-13 10:05:54,725 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/3391551687_upper_6F2967859C074FB3A05AC9B5C5BE893F/_temporary/1/_temporary/attempt_1426266260362_0005_m_000004_0	dst=null	perm=null
2015-03-13 10:05:54,747 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0005_01_000006
2015-03-13 10:05:54,747 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0005	CONTAINERID=container_1426266260362_0005_01_000006
2015-03-13 10:05:54,748 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:05:54,748 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0005_01_000006
2015-03-13 10:05:54,748 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:05:54,748 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0005_01_000004
2015-03-13 10:05:54,748 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:05:54,749 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0005_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:05:54,749 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0005_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:05:54,749 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0005	CONTAINERID=container_1426266260362_0005_01_000004
2015-03-13 10:05:54,749 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0005_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:05:54,749 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:4> numContainers=4 user=soberoi user-resources=<memory:6144, vCores:4>
2015-03-13 10:05:54,749 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0005_01_000004, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:54,749 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:54,750 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:05:54,750 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0005_000001 released container container_1426266260362_0005_01_000004 on node: host: 10.1.1.144:60715 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:05:54,761 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0005_01_000006 is : 143
2015-03-13 10:05:54,774 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:05:54,774 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000006
2015-03-13 10:05:54,775 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000006
2015-03-13 10:05:54,775 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000006
2015-03-13 10:05:54,775 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000006
2015-03-13 10:05:54,775 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0005	CONTAINERID=container_1426266260362_0005_01_000006
2015-03-13 10:05:54,775 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:05:54,776 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0005_01_000006 from application application_1426266260362_0005
2015-03-13 10:05:54,776 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:54,776 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0005
2015-03-13 10:05:55,072 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:05:55,080 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:05:55,140 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61202, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_239879959_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741887_1063, duration: 198000
2015-03-13 10:05:55,155 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:55,156 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:55,631 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:05:55,631 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0005_01_000003
2015-03-13 10:05:55,631 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0005_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:05:55,631 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0005_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:05:55,631 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0005	CONTAINERID=container_1426266260362_0005_01_000003
2015-03-13 10:05:55,632 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0005_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:05:55,632 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:3> numContainers=3 user=soberoi user-resources=<memory:5120, vCores:3>
2015-03-13 10:05:55,632 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0005_01_000003, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:55,632 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:55,632 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:05:55,632 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0005_000001 released container container_1426266260362_0005_01_000003 on node: host: 10.1.1.144:60723 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:05:55,633 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0005_01_000007 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:05:55,633 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0005	CONTAINERID=container_1426266260362_0005_01_000007
2015-03-13 10:05:55,633 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0005_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:05:55,633 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0005 container=Container: [ContainerId: container_1426266260362_0005_01_000007, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0005_01_000007 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:55,633 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:05:55,633 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:55,750 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:05:55,750 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0005_01_000006
2015-03-13 10:05:55,751 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0005_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:05:55,751 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0005_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:05:55,751 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0005	CONTAINERID=container_1426266260362_0005_01_000006
2015-03-13 10:05:55,751 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0005_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:05:55,751 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:3> numContainers=3 user=soberoi user-resources=<memory:5120, vCores:3>
2015-03-13 10:05:55,751 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0005_01_000006, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:55,751 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:55,751 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:05:55,751 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0005_000001 released container container_1426266260362_0005_01_000006 on node: host: 10.1.1.144:60715 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:05:55,963 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0006_000001 (auth:SIMPLE)
2015-03-13 10:05:55,965 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0006_000001
2015-03-13 10:05:55,966 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi	IP=10.1.1.144	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1426266260362_0006	APPATTEMPTID=appattempt_1426266260362_0006_000001
2015-03-13 10:05:55,966 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0006_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:05:55,966 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0006 State change from ACCEPTED to RUNNING
2015-03-13 10:05:55,991 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job_1426266260362_0006_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:55,992 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-soberoi/5116607014_lower_9AD2589890154BF394AB0F3C492A089C/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:05:56,058 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job_1426266260362_0006_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:56,157 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:56,157 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:56,192 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job_1426266260362_0006_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073741892_1068{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:05:56,243 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741892_1068 src: /127.0.0.1:61208 dest: /127.0.0.1:60696
2015-03-13 10:05:56,245 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741892_1068 src: /127.0.0.1:61209 dest: /127.0.0.1:60693
2015-03-13 10:05:56,247 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741892_1068 src: /127.0.0.1:61210 dest: /127.0.0.1:60689
2015-03-13 10:05:56,255 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61210, dest: /127.0.0.1:60689, bytes: 90682, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_239879959_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741892_1068, duration: 7203000
2015-03-13 10:05:56,256 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741892_1068, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:56,256 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741892_1068{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:56,256 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61209, dest: /127.0.0.1:60693, bytes: 90682, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_239879959_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741892_1068, duration: 7902000
2015-03-13 10:05:56,257 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741892_1068, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:56,257 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741892_1068{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:56,257 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61208, dest: /127.0.0.1:60696, bytes: 90682, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_239879959_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741892_1068, duration: 9225000
2015-03-13 10:05:56,258 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741892_1068, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:56,258 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741892_1068{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:56,262 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job_1426266260362_0006_1_conf.xml is closed by DFSClient_NONMAPREDUCE_239879959_1
2015-03-13 10:05:56,548 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0005_01_000007 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:05:56,556 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0005_01_000007 by user soberoi
2015-03-13 10:05:56,556 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0005	CONTAINERID=container_1426266260362_0005_01_000007
2015-03-13 10:05:56,556 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0005_01_000007 to application application_1426266260362_0005
2015-03-13 10:05:56,556 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000007 transitioned from NEW to LOCALIZING
2015-03-13 10:05:56,557 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0005
2015-03-13 10:05:56,557 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0005
2015-03-13 10:05:56,557 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:05:56,557 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0005
2015-03-13 10:05:56,557 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000007 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:05:56,586 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000007 transitioned from LOCALIZED to RUNNING
2015-03-13 10:05:56,586 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:56,632 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:56,632 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0005_01_000007 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:05:56,661 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000007/default_container_executor.sh]
2015-03-13 10:05:57,159 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:57,159 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:57,413 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0006_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:05:57,414 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0006	CONTAINERID=container_1426266260362_0006_01_000003
2015-03-13 10:05:57,414 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0006_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:05:57,414 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0006 container=Container: [ContainerId: container_1426266260362_0006_01_000003, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0006_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:57,414 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:05:57,414 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:57,415 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0006_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:05:57,415 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0006	CONTAINERID=container_1426266260362_0006_01_000004
2015-03-13 10:05:57,415 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0006_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:05:57,415 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0006 container=Container: [ContainerId: container_1426266260362_0006_01_000004, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0006_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:57,416 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:05:57,416 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:57,416 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0006_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:05:57,416 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0006	CONTAINERID=container_1426266260362_0006_01_000005
2015-03-13 10:05:57,416 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0006_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:05:57,417 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0006 container=Container: [ContainerId: container_1426266260362_0006_01_000005, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0006_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:57,417 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:05:57,417 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:57,417 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0006_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:05:57,417 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0006	CONTAINERID=container_1426266260362_0006_01_000006
2015-03-13 10:05:57,418 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0006_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:05:57,418 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0006 container=Container: [ContainerId: container_1426266260362_0006_01_000006, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0006_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:57,418 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7
2015-03-13 10:05:57,418 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:57,554 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:05:57,636 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:57,637 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0006_01_000007 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:05:57,637 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0006	CONTAINERID=container_1426266260362_0006_01_000007
2015-03-13 10:05:57,637 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0006_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:05:57,637 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0006 container=Container: [ContainerId: container_1426266260362_0006_01_000007, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0006_01_000007 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7 usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:57,637 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:10240, vCores:8>usedCapacity=0.625, absoluteUsedCapacity=0.625, numApps=2, numContainers=8
2015-03-13 10:05:57,638 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.625 absoluteUsedCapacity=0.625 used=<memory:10240, vCores:8> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:57,997 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0006_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:05:57,998 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0006_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:05:57,998 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0006_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:05:57,998 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0006_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:05:57,998 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0006_01_000007 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:05:58,037 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.jar	dst=null	perm=null
2015-03-13 10:05:58,038 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.jar	dst=null	perm=null
2015-03-13 10:05:58,052 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.xml	dst=null	perm=null
2015-03-13 10:05:58,053 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.xml	dst=null	perm=null
2015-03-13 10:05:58,056 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:05:58,057 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:05:58,065 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:05:58,066 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:05:58,068 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:05:58,069 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:05:58,160 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:58,160 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:58,169 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0006_000001 (auth:SIMPLE)
2015-03-13 10:05:58,169 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0006_000001 (auth:SIMPLE)
2015-03-13 10:05:58,173 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0006_01_000007 by user soberoi
2015-03-13 10:05:58,174 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0006
2015-03-13 10:05:58,174 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0006	CONTAINERID=container_1426266260362_0006_01_000007
2015-03-13 10:05:58,175 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0006_01_000006 by user soberoi
2015-03-13 10:05:58,175 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0006
2015-03-13 10:05:58,175 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0006	CONTAINERID=container_1426266260362_0006_01_000006
2015-03-13 10:05:58,176 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0006_01_000003 by user soberoi
2015-03-13 10:05:58,176 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0006	CONTAINERID=container_1426266260362_0006_01_000003
2015-03-13 10:05:58,178 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0006 transitioned from NEW to INITING
2015-03-13 10:05:58,179 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0006_01_000007 to application application_1426266260362_0006
2015-03-13 10:05:58,179 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0006 transitioned from INITING to RUNNING
2015-03-13 10:05:58,179 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000007 transitioned from NEW to LOCALIZING
2015-03-13 10:05:58,179 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0006
2015-03-13 10:05:58,179 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0006
2015-03-13 10:05:58,179 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:05:58,179 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0006
2015-03-13 10:05:58,180 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:05:58,180 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:05:58,180 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0006 transitioned from NEW to INITING
2015-03-13 10:05:58,180 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0006_01_000007
2015-03-13 10:05:58,181 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0006_01_000005 by user soberoi
2015-03-13 10:05:58,182 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0006	CONTAINERID=container_1426266260362_0006_01_000005
2015-03-13 10:05:58,180 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0006_01_000006 to application application_1426266260362_0006
2015-03-13 10:05:58,182 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0006_01_000004 by user soberoi
2015-03-13 10:05:58,182 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0006_01_000003 to application application_1426266260362_0006
2015-03-13 10:05:58,182 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0006	CONTAINERID=container_1426266260362_0006_01_000004
2015-03-13 10:05:58,182 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0006_01_000005 to application application_1426266260362_0006
2015-03-13 10:05:58,183 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0006_01_000004 to application application_1426266260362_0006
2015-03-13 10:05:58,183 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0006 transitioned from INITING to RUNNING
2015-03-13 10:05:58,183 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:05:58,183 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:05:58,184 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:05:58,184 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:05:58,184 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0006
2015-03-13 10:05:58,184 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0006
2015-03-13 10:05:58,184 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:05:58,185 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0006
2015-03-13 10:05:58,185 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:05:58,185 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:05:58,185 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0006
2015-03-13 10:05:58,185 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0006
2015-03-13 10:05:58,185 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:05:58,185 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0006
2015-03-13 10:05:58,186 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0006
2015-03-13 10:05:58,186 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0006
2015-03-13 10:05:58,186 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:05:58,186 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0006
2015-03-13 10:05:58,186 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0006
2015-03-13 10:05:58,186 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0006
2015-03-13 10:05:58,186 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:05:58,186 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0006
2015-03-13 10:05:58,187 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0006_01_000006
2015-03-13 10:05:58,187 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0006_01_000005
2015-03-13 10:05:58,188 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0006_01_000004
2015-03-13 10:05:58,188 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0006_01_000003
2015-03-13 10:05:58,206 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1426266260362_0006_01_000006.tokens. Credentials list: 
2015-03-13 10:05:58,207 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1426266260362_0006_01_000005.tokens. Credentials list: 
2015-03-13 10:05:58,207 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1426266260362_0006_01_000003.tokens. Credentials list: 
2015-03-13 10:05:58,208 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1426266260362_0006_01_000007.tokens. Credentials list: 
2015-03-13 10:05:58,208 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1426266260362_0006_01_000004.tokens. Credentials list: 
2015-03-13 10:05:58,232 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:05:58,233 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:05:58,347 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1426266260362_0006_01_000007.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000007.tokens
2015-03-13 10:05:58,347 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0006 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0006
2015-03-13 10:05:58,348 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1426266260362_0006_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000006.tokens
2015-03-13 10:05:58,348 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0006 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0006
2015-03-13 10:05:58,416 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:58,417 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:58,418 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:58,418 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:58,419 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0006_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:05:58,419 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0006_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:05:58,419 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0006_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:05:58,419 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0006_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:05:58,446 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.jar	dst=null	perm=null
2015-03-13 10:05:58,447 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.jar	dst=null	perm=null
2015-03-13 10:05:58,448 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.jar	dst=null	perm=null
2015-03-13 10:05:58,448 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.jar	dst=null	perm=null
2015-03-13 10:05:58,448 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.jar	dst=null	perm=null
2015-03-13 10:05:58,449 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.jar	dst=null	perm=null
2015-03-13 10:05:58,458 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61219, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1715524015_3764, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741883_1059, duration: 558000
2015-03-13 10:05:58,458 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61218, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-987417491_3763, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741883_1059, duration: 615000
2015-03-13 10:05:58,489 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:05:58,490 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:05:58,517 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.xml	dst=null	perm=null
2015-03-13 10:05:58,518 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.xml	dst=null	perm=null
2015-03-13 10:05:58,518 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.xml	dst=null	perm=null
2015-03-13 10:05:58,519 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.xml	dst=null	perm=null
2015-03-13 10:05:58,519 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.xml	dst=null	perm=null
2015-03-13 10:05:58,520 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.xml	dst=null	perm=null
2015-03-13 10:05:58,530 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61219, bytes: 98738, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1715524015_3764, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741889_1065, duration: 277000
2015-03-13 10:05:58,530 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61220, bytes: 98738, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-987417491_3763, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741889_1065, duration: 257000
2015-03-13 10:05:58,554 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:05:58,555 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000007 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:05:58,555 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:05:58,555 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:05:58,555 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:05:58,555 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:05:58,555 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:05:58,613 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000007 transitioned from LOCALIZED to RUNNING
2015-03-13 10:05:58,613 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:58,613 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:05:58,613 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:58,621 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:05:58,621 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:58,622 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:05:58,622 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:58,622 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:05:58,622 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:58,639 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:58,639 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:58,640 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0006_01_000007 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:05:58,771 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000007/default_container_executor.sh]
2015-03-13 10:05:58,771 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000005/default_container_executor.sh]
2015-03-13 10:05:58,781 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000006/default_container_executor.sh]
2015-03-13 10:05:58,783 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000003/default_container_executor.sh]
2015-03-13 10:05:58,804 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000004/default_container_executor.sh]
2015-03-13 10:05:59,018 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:05:59,164 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:59,164 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:59,423 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:59,423 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:59,423 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:59,424 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:59,609 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:05:59,643 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:59,643 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:59,749 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1426266260362_0006_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000004.tokens
2015-03-13 10:05:59,749 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0006 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0006
2015-03-13 10:05:59,875 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:05:59,992 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1426266260362_0006_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000003.tokens
2015-03-13 10:05:59,992 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0006 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0006
2015-03-13 10:06:00,094 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:06:00,166 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:00,167 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:00,243 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1426266260362_0006_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000005.tokens
2015-03-13 10:06:00,244 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0006 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0006
2015-03-13 10:06:00,328 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741892_1068
2015-03-13 10:06:00,353 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741892_1068
2015-03-13 10:06:00,429 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:00,429 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:00,429 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:00,430 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:00,561 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741892_1068
2015-03-13 10:06:00,647 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:00,647 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:01,172 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:01,172 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:01,435 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:01,436 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:01,436 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:01,436 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:01,648 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:01,649 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:02,175 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:02,175 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:02,439 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:02,439 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:02,439 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:02,440 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:02,654 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:02,655 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:03,083 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/3391551687_upper_6F2967859C074FB3A05AC9B5C5BE893F/_temporary/1/_temporary/attempt_1426266260362_0005_r_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:03,180 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:03,180 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:03,287 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/3391551687_upper_6F2967859C074FB3A05AC9B5C5BE893F/_temporary/1/_temporary/attempt_1426266260362_0005_r_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073741893_1069{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:06:03,444 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:03,444 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:03,444 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:03,445 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:03,497 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741893_1069 src: /127.0.0.1:61227 dest: /127.0.0.1:60693
2015-03-13 10:06:03,499 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741893_1069 src: /127.0.0.1:61228 dest: /127.0.0.1:60689
2015-03-13 10:06:03,500 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741893_1069 src: /127.0.0.1:61229 dest: /127.0.0.1:60696
2015-03-13 10:06:03,534 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61229, dest: /127.0.0.1:60696, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0005_r_000000_0_1588355521_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741893_1069, duration: 32488000
2015-03-13 10:06:03,535 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741893_1069, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:03,535 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741893_1069{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:06:03,535 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61228, dest: /127.0.0.1:60689, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0005_r_000000_0_1588355521_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741893_1069, duration: 33357000
2015-03-13 10:06:03,536 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741893_1069, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:03,536 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741893_1069{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:06:03,536 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61227, dest: /127.0.0.1:60693, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0005_r_000000_0_1588355521_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741893_1069, duration: 34355000
2015-03-13 10:06:03,536 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741893_1069, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:03,537 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741893_1069{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:06:03,543 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/3391551687_upper_6F2967859C074FB3A05AC9B5C5BE893F/_temporary/1/_temporary/attempt_1426266260362_0005_r_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0005_r_000000_0_1588355521_1
2015-03-13 10:06:03,555 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/3391551687_upper_6F2967859C074FB3A05AC9B5C5BE893F/_temporary/1/_temporary/attempt_1426266260362_0005_r_000000_0	dst=null	perm=null
2015-03-13 10:06:03,564 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/3391551687_upper_6F2967859C074FB3A05AC9B5C5BE893F/_temporary/1/_temporary/attempt_1426266260362_0005_r_000000_0	dst=null	perm=null
2015-03-13 10:06:03,565 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/3391551687_upper_6F2967859C074FB3A05AC9B5C5BE893F/_temporary/1/task_1426266260362_0005_r_000000	dst=null	perm=null
2015-03-13 10:06:03,568 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/3391551687_upper_6F2967859C074FB3A05AC9B5C5BE893F/_temporary/1/_temporary/attempt_1426266260362_0005_r_000000_0	dst=/tmp/hadoop-soberoi/3391551687_upper_6F2967859C074FB3A05AC9B5C5BE893F/_temporary/1/task_1426266260362_0005_r_000000	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:06:03,578 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0005_01_000007
2015-03-13 10:06:03,579 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0005	CONTAINERID=container_1426266260362_0005_01_000007
2015-03-13 10:06:03,579 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000007 transitioned from RUNNING to KILLING
2015-03-13 10:06:03,579 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0005_01_000007
2015-03-13 10:06:03,579 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:06:03,579 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:03,584 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:03,586 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_24858168_1
2015-03-13 10:06:03,590 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/3391551687_upper_6F2967859C074FB3A05AC9B5C5BE893F/_temporary/1	dst=null	perm=null
2015-03-13 10:06:03,592 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0005_01_000007 is : 143
2015-03-13 10:06:03,597 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/3391551687_upper_6F2967859C074FB3A05AC9B5C5BE893F	dst=null	perm=null
2015-03-13 10:06:03,598 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/3391551687_upper_6F2967859C074FB3A05AC9B5C5BE893F	dst=null	perm=null
2015-03-13 10:06:03,600 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/3391551687_upper_6F2967859C074FB3A05AC9B5C5BE893F/_temporary/1/task_1426266260362_0005_r_000000	dst=null	perm=null
2015-03-13 10:06:03,601 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/3391551687_upper_6F2967859C074FB3A05AC9B5C5BE893F/part-00000	dst=null	perm=null
2015-03-13 10:06:03,604 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/3391551687_upper_6F2967859C074FB3A05AC9B5C5BE893F/_temporary/1/task_1426266260362_0005_r_000000/part-00000	dst=/tmp/hadoop-soberoi/3391551687_upper_6F2967859C074FB3A05AC9B5C5BE893F/part-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:03,605 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000007 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:06:03,606 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000007
2015-03-13 10:06:03,606 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000007
2015-03-13 10:06:03,606 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0005	CONTAINERID=container_1426266260362_0005_01_000007
2015-03-13 10:06:03,606 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000007 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:06:03,607 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000007
2015-03-13 10:06:03,607 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000007
2015-03-13 10:06:03,607 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0005_01_000007 from application application_1426266260362_0005
2015-03-13 10:06:03,607 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:03,608 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0005
2015-03-13 10:06:03,609 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-soberoi/3391551687_upper_6F2967859C074FB3A05AC9B5C5BE893F/_temporary	dst=null	perm=null
2015-03-13 10:06:03,616 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/3391551687_upper_6F2967859C074FB3A05AC9B5C5BE893F/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:03,621 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/3391551687_upper_6F2967859C074FB3A05AC9B5C5BE893F/_SUCCESS is closed by DFSClient_NONMAPREDUCE_24858168_1
2015-03-13 10:06:03,628 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:03,635 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_24858168_1
2015-03-13 10:06:03,652 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61200, dest: /127.0.0.1:60689, bytes: 66919, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_24858168_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741891_1067, duration: 9131846000
2015-03-13 10:06:03,652 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741891_1067, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:03,653 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741891_1067{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:06:03,653 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61199, dest: /127.0.0.1:60696, bytes: 66919, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_24858168_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741891_1067, duration: 9132974000
2015-03-13 10:06:03,653 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741891_1067, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:03,654 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741891_1067{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:06:03,654 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61198, dest: /127.0.0.1:60686, bytes: 66919, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_24858168_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741891_1067, duration: 9134445000
2015-03-13 10:06:03,655 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741891_1067, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:03,655 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741891_1067{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:06:03,656 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job_1426266260362_0005_1.jhist is closed by DFSClient_NONMAPREDUCE_24858168_1
2015-03-13 10:06:03,662 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0005.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:03,665 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0005.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741894_1070{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:06:03,667 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741894_1070 src: /127.0.0.1:61230 dest: /127.0.0.1:60696
2015-03-13 10:06:03,668 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741894_1070 src: /127.0.0.1:61231 dest: /127.0.0.1:60686
2015-03-13 10:06:03,669 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741894_1070 src: /127.0.0.1:61232 dest: /127.0.0.1:60689
2015-03-13 10:06:03,672 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61232, dest: /127.0.0.1:60689, bytes: 426, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_24858168_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741894_1070, duration: 1269000
2015-03-13 10:06:03,672 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741894_1070, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:03,673 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741894_1070{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:06:03,673 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61231, dest: /127.0.0.1:60686, bytes: 426, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_24858168_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741894_1070, duration: 1951000
2015-03-13 10:06:03,673 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741894_1070, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:03,674 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741894_1070{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:06:03,674 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61230, dest: /127.0.0.1:60696, bytes: 426, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_24858168_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741894_1070, duration: 2796000
2015-03-13 10:06:03,674 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741894_1070, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:03,674 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741894_1070{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:06:03,676 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0005.summary_tmp is closed by DFSClient_NONMAPREDUCE_24858168_1
2015-03-13 10:06:03,681 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0005.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:06:03,687 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job_1426266260362_0005_1.jhist	dst=null	perm=null
2015-03-13 10:06:03,688 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0005-1426266337896-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F1C978E7C0B2B4201-1426266363636-5-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:06:03,691 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job_1426266260362_0005_1.jhist	dst=null	perm=null
2015-03-13 10:06:03,692 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0005-1426266337896-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F1C978E7C0B2B4201-1426266363636-5-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:06:03,694 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job_1426266260362_0005_1.jhist	dst=null	perm=null
2015-03-13 10:06:03,696 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0005-1426266337896-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F1C978E7C0B2B4201-1426266363636-5-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:03,699 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61233, bytes: 67443, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_24858168_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741891_1067, duration: 291000
2015-03-13 10:06:03,701 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0005-1426266337896-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F1C978E7C0B2B4201-1426266363636-5-1-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741895_1071{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:06:03,702 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741895_1071 src: /127.0.0.1:61234 dest: /127.0.0.1:60696
2015-03-13 10:06:03,704 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741895_1071 src: /127.0.0.1:61235 dest: /127.0.0.1:60693
2015-03-13 10:06:03,705 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741895_1071 src: /127.0.0.1:61236 dest: /127.0.0.1:60689
2015-03-13 10:06:03,709 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61236, dest: /127.0.0.1:60689, bytes: 66919, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_24858168_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741895_1071, duration: 1811000
2015-03-13 10:06:03,709 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741895_1071, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:03,710 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61235, dest: /127.0.0.1:60693, bytes: 66919, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_24858168_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741895_1071, duration: 2766000
2015-03-13 10:06:03,710 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741895_1071{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:06:03,710 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741895_1071, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:03,711 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61234, dest: /127.0.0.1:60696, bytes: 66919, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_24858168_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741895_1071, duration: 3717000
2015-03-13 10:06:03,711 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741895_1071, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:03,711 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741895_1071{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:06:03,712 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741895_1071{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:06:03,714 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0005-1426266337896-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F1C978E7C0B2B4201-1426266363636-5-1-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_24858168_1
2015-03-13 10:06:03,719 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0005-1426266337896-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F1C978E7C0B2B4201-1426266363636-5-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:06:03,720 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job_1426266260362_0005_1_conf.xml	dst=null	perm=null
2015-03-13 10:06:03,721 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0005_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:06:03,722 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job_1426266260362_0005_1_conf.xml	dst=null	perm=null
2015-03-13 10:06:03,723 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0005_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:06:03,725 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job_1426266260362_0005_1_conf.xml	dst=null	perm=null
2015-03-13 10:06:03,727 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0005_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:03,729 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61237, bytes: 91394, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_24858168_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741890_1066, duration: 292000
2015-03-13 10:06:03,731 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0005_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741896_1072{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:06:03,733 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741896_1072 src: /127.0.0.1:61238 dest: /127.0.0.1:60686
2015-03-13 10:06:03,735 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741896_1072 src: /127.0.0.1:61239 dest: /127.0.0.1:60693
2015-03-13 10:06:03,736 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741896_1072 src: /127.0.0.1:61240 dest: /127.0.0.1:60696
2015-03-13 10:06:03,739 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61240, dest: /127.0.0.1:60696, bytes: 90682, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_24858168_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741896_1072, duration: 1752000
2015-03-13 10:06:03,740 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741896_1072, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:03,740 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741896_1072{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:06:03,740 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61239, dest: /127.0.0.1:60693, bytes: 90682, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_24858168_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741896_1072, duration: 2278000
2015-03-13 10:06:03,740 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741896_1072, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:03,741 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741896_1072{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:06:03,741 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61238, dest: /127.0.0.1:60686, bytes: 90682, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_24858168_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741896_1072, duration: 3071000
2015-03-13 10:06:03,741 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741896_1072, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:03,742 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741896_1072{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:06:03,743 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0005_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_24858168_1
2015-03-13 10:06:03,747 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0005_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:06:03,749 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0005.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0005.summary	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:06:03,751 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0005_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0005_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:06:03,755 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0005-1426266337896-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F1C978E7C0B2B4201-1426266363636-5-1-SUCCEEDED-default.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0005-1426266337896-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F1C978E7C0B2B4201-1426266363636-5-1-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:06:03,763 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0005_000001 State change from RUNNING to FINISHING
2015-03-13 10:06:03,764 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0005
2015-03-13 10:06:03,764 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0005 State change from RUNNING to REMOVING
2015-03-13 10:06:03,764 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0005
2015-03-13 10:06:03,764 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0005 State change from REMOVING to FINISHING
2015-03-13 10:06:04,185 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:04,185 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:04,447 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:04,447 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:04,448 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:04,448 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:04,584 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:06:04,584 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0005_01_000007
2015-03-13 10:06:04,584 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:04,585 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0005_01_000007 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:06:04,585 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0005_01_000007 in state: COMPLETED event:FINISHED
2015-03-13 10:06:04,585 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0005	CONTAINERID=container_1426266260362_0005_01_000007
2015-03-13 10:06:04,585 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0005_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:06:04,585 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:9216, vCores:7> numContainers=7 user=soberoi user-resources=<memory:9216, vCores:7>
2015-03-13 10:06:04,586 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0005_01_000007, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7 usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:04,586 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:04,586 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7
2015-03-13 10:06:04,586 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0005_000001 released container container_1426266260362_0005_01_000007 on node: host: 10.1.1.144:60723 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:06:04,770 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741882_1058 127.0.0.1:60689 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60696 
2015-03-13 10:06:04,770 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741884_1060 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60696 127.0.0.1:60693 
2015-03-13 10:06:04,770 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741886_1062 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60686 
2015-03-13 10:06:04,770 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741888_1064 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60693 
2015-03-13 10:06:04,770 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741891_1067 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60689 
2015-03-13 10:06:04,771 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741890_1066 127.0.0.1:60689 127.0.0.1:60693 127.0.0.1:60686 
2015-03-13 10:06:04,771 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005	dst=null	perm=null
2015-03-13 10:06:05,147 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741894_1070
2015-03-13 10:06:05,148 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741896_1072
2015-03-13 10:06:05,148 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741891_1067
2015-03-13 10:06:05,191 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:05,191 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:05,334 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741891_1067
2015-03-13 10:06:05,335 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741893_1069
2015-03-13 10:06:05,336 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741895_1071
2015-03-13 10:06:05,336 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741896_1072
2015-03-13 10:06:05,337 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741894_1070
2015-03-13 10:06:05,360 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741896_1072
2015-03-13 10:06:05,361 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741893_1069
2015-03-13 10:06:05,361 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741895_1071
2015-03-13 10:06:05,449 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:05,450 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:05,450 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:05,450 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:05,569 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741895_1071
2015-03-13 10:06:05,570 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741894_1070
2015-03-13 10:06:05,570 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741891_1067
2015-03-13 10:06:05,571 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741893_1069
2015-03-13 10:06:05,585 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:06,194 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:06,194 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:06,454 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:06,454 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:06,455 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:06,455 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:06,589 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:06,709 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073741888_1064, blk_1073741890_1066, blk_1073741891_1067, blk_1073741882_1058, blk_1073741884_1060, blk_1073741886_1062]
2015-03-13 10:06:06,709 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073741888_1064, blk_1073741890_1066, blk_1073741891_1067, blk_1073741882_1058, blk_1073741884_1060]
2015-03-13 10:06:07,195 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:07,196 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:07,378 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741888_1064 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741888 for deletion
2015-03-13 10:06:07,378 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741888_1064 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741888 for deletion
2015-03-13 10:06:07,379 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741890_1066 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741890 for deletion
2015-03-13 10:06:07,379 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741891_1067 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741891 for deletion
2015-03-13 10:06:07,379 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741888_1064 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741888
2015-03-13 10:06:07,379 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741890_1066 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741890 for deletion
2015-03-13 10:06:07,379 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741890_1066 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741890
2015-03-13 10:06:07,379 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741882_1058 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741882 for deletion
2015-03-13 10:06:07,379 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741888_1064 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741888
2015-03-13 10:06:07,379 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741884_1060 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741884 for deletion
2015-03-13 10:06:07,380 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741886_1062 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741886 for deletion
2015-03-13 10:06:07,379 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741890_1066 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741890
2015-03-13 10:06:07,379 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741891_1067 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741891 for deletion
2015-03-13 10:06:07,380 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741884_1060 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741884
2015-03-13 10:06:07,380 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741891_1067 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741891
2015-03-13 10:06:07,380 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741886_1062 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741886
2015-03-13 10:06:07,380 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741882_1058 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741882
2015-03-13 10:06:07,380 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741882_1058 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741882 for deletion
2015-03-13 10:06:07,380 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741891_1067 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741891
2015-03-13 10:06:07,381 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741884_1060 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741884 for deletion
2015-03-13 10:06:07,381 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741882_1058 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741882
2015-03-13 10:06:07,381 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741884_1060 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741884
2015-03-13 10:06:07,459 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:07,459 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:07,459 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:07,460 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:07,594 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:07,927 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.split	dst=null	perm=null
2015-03-13 10:06:07,942 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.split	dst=null	perm=null
2015-03-13 10:06:07,981 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.split	dst=null	perm=null
2015-03-13 10:06:08,069 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.split	dst=null	perm=null
2015-03-13 10:06:08,091 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.split	dst=null	perm=null
2015-03-13 10:06:08,156 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61250, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0006_m_000003_0_789174002_1, offset: 1024, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741885_1061, duration: 165000
2015-03-13 10:06:08,157 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61251, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0006_m_000004_0_2047450158_1, offset: 1024, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741885_1061, duration: 171000
2015-03-13 10:06:08,169 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61253, bytes: 1282, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0006_m_000002_0_488524115_1, offset: 512, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741885_1061, duration: 170000
2015-03-13 10:06:08,198 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:08,198 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:08,218 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61254, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0006_m_000000_0_-1854404813_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741885_1061, duration: 157000
2015-03-13 10:06:08,286 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61255, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0006_m_000001_0_-1470236438_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741885_1061, duration: 169000
2015-03-13 10:06:08,303 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:06:08,307 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:06:08,308 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61256, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0006_m_000003_0_789174002_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 177000
2015-03-13 10:06:08,312 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61257, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0006_m_000004_0_2047450158_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 165000
2015-03-13 10:06:08,315 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:06:08,319 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61258, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0006_m_000002_0_488524115_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 176000
2015-03-13 10:06:08,356 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:06:08,396 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:06:08,401 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61259, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0006_m_000001_0_-1470236438_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 180000
2015-03-13 10:06:08,461 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:08,461 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:08,461 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:08,461 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:08,596 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:08,820 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5116607014_lower_9AD2589890154BF394AB0F3C492A089C/_temporary/1/_temporary/attempt_1426266260362_0006_m_000004_0	dst=null	perm=null
2015-03-13 10:06:08,828 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5116607014_lower_9AD2589890154BF394AB0F3C492A089C/_temporary/1/_temporary/attempt_1426266260362_0006_m_000003_0	dst=null	perm=null
2015-03-13 10:06:08,849 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0006_000001 (auth:SIMPLE)
2015-03-13 10:06:08,851 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0006_01_000007
2015-03-13 10:06:08,851 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0006	CONTAINERID=container_1426266260362_0006_01_000007
2015-03-13 10:06:08,851 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000007 transitioned from RUNNING to KILLING
2015-03-13 10:06:08,852 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0006_01_000007
2015-03-13 10:06:08,852 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:06:08,858 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0006_000001 (auth:SIMPLE)
2015-03-13 10:06:08,861 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0006_01_000006
2015-03-13 10:06:08,861 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0006	CONTAINERID=container_1426266260362_0006_01_000006
2015-03-13 10:06:08,861 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:06:08,862 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0006_01_000006
2015-03-13 10:06:08,862 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:08,862 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:08,862 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:08,863 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:06:08,866 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0006_01_000007 is : 143
2015-03-13 10:06:08,871 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job_1426266260362_0006_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073741897_1073{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:06:08,873 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741897_1073 src: /127.0.0.1:61263 dest: /127.0.0.1:60696
2015-03-13 10:06:08,875 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741897_1073 src: /127.0.0.1:61264 dest: /127.0.0.1:60689
2015-03-13 10:06:08,875 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0006_01_000006 is : 143
2015-03-13 10:06:08,876 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741897_1073 src: /127.0.0.1:61265 dest: /127.0.0.1:60686
2015-03-13 10:06:08,881 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000007 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:06:08,882 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0006	CONTAINERID=container_1426266260362_0006_01_000007
2015-03-13 10:06:08,882 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000007 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:06:08,882 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0006_01_000007 from application application_1426266260362_0006
2015-03-13 10:06:08,882 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:08,882 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0006
2015-03-13 10:06:08,882 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000007
2015-03-13 10:06:08,882 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000007
2015-03-13 10:06:08,883 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000007
2015-03-13 10:06:08,883 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000007
2015-03-13 10:06:08,884 INFO  hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job_1426266260362_0006_1.jhist for DFSClient_NONMAPREDUCE_239879959_1
2015-03-13 10:06:08,890 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:06:08,892 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000006
2015-03-13 10:06:08,893 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000006
2015-03-13 10:06:08,893 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000006
2015-03-13 10:06:08,894 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000006
2015-03-13 10:06:08,895 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0006	CONTAINERID=container_1426266260362_0006_01_000006
2015-03-13 10:06:08,896 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:06:08,896 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0006_01_000006 from application application_1426266260362_0006
2015-03-13 10:06:08,896 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:08,896 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0006
2015-03-13 10:06:08,915 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5116607014_lower_9AD2589890154BF394AB0F3C492A089C/_temporary/1/_temporary/attempt_1426266260362_0006_m_000002_0	dst=null	perm=null
2015-03-13 10:06:08,930 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0006_01_000005
2015-03-13 10:06:08,930 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0006	CONTAINERID=container_1426266260362_0006_01_000005
2015-03-13 10:06:08,930 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:06:08,931 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0006_01_000005
2015-03-13 10:06:08,931 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:08,931 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:08,931 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:06:08,932 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:06:08,932 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0006_01_000006
2015-03-13 10:06:08,932 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0006_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:06:08,932 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0006_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:06:08,933 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0006	CONTAINERID=container_1426266260362_0006_01_000006
2015-03-13 10:06:08,933 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0006_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:06:08,933 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:8192, vCores:6> numContainers=6 user=soberoi user-resources=<memory:8192, vCores:6>
2015-03-13 10:06:08,933 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0006_01_000006, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:08,933 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:08,933 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:06:08,933 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0006_000001 released container container_1426266260362_0006_01_000006 on node: host: 10.1.1.144:60719 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:06:08,938 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61266, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0006_m_000000_0_-1854404813_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 171000
2015-03-13 10:06:08,942 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0006_01_000005 is : 143
2015-03-13 10:06:08,955 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:06:08,956 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000005
2015-03-13 10:06:08,956 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000005
2015-03-13 10:06:08,956 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000005
2015-03-13 10:06:08,956 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000005
2015-03-13 10:06:08,956 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0006	CONTAINERID=container_1426266260362_0006_01_000005
2015-03-13 10:06:08,957 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:06:08,957 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0006_01_000005 from application application_1426266260362_0006
2015-03-13 10:06:08,957 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:08,958 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0006
2015-03-13 10:06:08,979 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5116607014_lower_9AD2589890154BF394AB0F3C492A089C/_temporary/1/_temporary/attempt_1426266260362_0006_m_000000_0	dst=null	perm=null
2015-03-13 10:06:08,979 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5116607014_lower_9AD2589890154BF394AB0F3C492A089C/_temporary/1/_temporary/attempt_1426266260362_0006_m_000001_0	dst=null	perm=null
2015-03-13 10:06:08,995 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0006_01_000004
2015-03-13 10:06:08,995 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0006	CONTAINERID=container_1426266260362_0006_01_000004
2015-03-13 10:06:08,996 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0006_01_000003
2015-03-13 10:06:08,996 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:08,996 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:08,996 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0006	CONTAINERID=container_1426266260362_0006_01_000003
2015-03-13 10:06:08,996 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:06:08,996 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0006_01_000005
2015-03-13 10:06:08,996 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:06:08,997 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0006_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:06:08,997 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0006_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:06:08,997 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0006	CONTAINERID=container_1426266260362_0006_01_000005
2015-03-13 10:06:08,997 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0006_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:06:08,997 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:7168, vCores:5> numContainers=5 user=soberoi user-resources=<memory:7168, vCores:5>
2015-03-13 10:06:08,998 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0006_01_000005, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:08,998 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:08,998 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:06:08,998 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0006_000001 released container container_1426266260362_0006_01_000005 on node: host: 10.1.1.144:60719 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:06:08,997 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:06:08,999 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0006_01_000004
2015-03-13 10:06:09,014 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0006_01_000004 is : 143
2015-03-13 10:06:09,025 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0006_01_000003
2015-03-13 10:06:09,034 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0006_01_000003 is : 143
2015-03-13 10:06:09,041 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:06:09,042 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:06:09,042 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000004
2015-03-13 10:06:09,042 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000004
2015-03-13 10:06:09,042 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000004
2015-03-13 10:06:09,043 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000004
2015-03-13 10:06:09,044 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000003
2015-03-13 10:06:09,044 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000003
2015-03-13 10:06:09,044 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000003
2015-03-13 10:06:09,045 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000003
2015-03-13 10:06:09,045 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0006	CONTAINERID=container_1426266260362_0006_01_000004
2015-03-13 10:06:09,046 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:06:09,046 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0006	CONTAINERID=container_1426266260362_0006_01_000003
2015-03-13 10:06:09,046 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:06:09,046 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0006_01_000004 from application application_1426266260362_0006
2015-03-13 10:06:09,046 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:09,046 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0006
2015-03-13 10:06:09,046 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0006_01_000003 from application application_1426266260362_0006
2015-03-13 10:06:09,046 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:09,046 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0006
2015-03-13 10:06:09,201 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:09,201 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:09,712 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073741888_1064, blk_1073741890_1066, blk_1073741882_1058, blk_1073741884_1060, blk_1073741886_1062]
2015-03-13 10:06:09,712 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073741891_1067, blk_1073741882_1058, blk_1073741884_1060, blk_1073741886_1062]
2015-03-13 10:06:09,855 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:06:09,855 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0006_01_000007
2015-03-13 10:06:09,856 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0006_01_000007 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:06:09,856 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0006_01_000007 in state: COMPLETED event:FINISHED
2015-03-13 10:06:09,856 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0006	CONTAINERID=container_1426266260362_0006_01_000007
2015-03-13 10:06:09,856 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0006_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:06:09,857 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:4> numContainers=4 user=soberoi user-resources=<memory:6144, vCores:4>
2015-03-13 10:06:09,857 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0006_01_000007, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:09,857 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:09,857 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:06:09,858 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0006_000001 released container container_1426266260362_0006_01_000007 on node: host: 10.1.1.144:60723 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:06:09,915 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0005_01_000001 succeeded 
2015-03-13 10:06:09,915 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:06:09,915 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0005_01_000001
2015-03-13 10:06:09,923 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000001
2015-03-13 10:06:09,923 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000001
2015-03-13 10:06:09,923 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000001
2015-03-13 10:06:09,923 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000001
2015-03-13 10:06:09,923 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0005	CONTAINERID=container_1426266260362_0005_01_000001
2015-03-13 10:06:09,924 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:06:09,924 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0005_01_000001 from application application_1426266260362_0005
2015-03-13 10:06:09,924 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:09,924 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0005
2015-03-13 10:06:10,000 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:06:10,001 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0006_01_000003
2015-03-13 10:06:10,001 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:06:10,001 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0006_01_000004
2015-03-13 10:06:10,002 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0006_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:06:10,002 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0006_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:06:10,003 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0006	CONTAINERID=container_1426266260362_0006_01_000003
2015-03-13 10:06:10,003 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0006_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:06:10,003 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:3> numContainers=3 user=soberoi user-resources=<memory:5120, vCores:3>
2015-03-13 10:06:10,003 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0006_01_000003, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:10,004 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:10,004 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:06:10,004 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0006_000001 released container container_1426266260362_0006_01_000003 on node: host: 10.1.1.144:60719 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:06:10,004 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0006_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:06:10,004 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0006_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:06:10,004 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0006	CONTAINERID=container_1426266260362_0006_01_000004
2015-03-13 10:06:10,005 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0006_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:06:10,005 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:2> numContainers=2 user=soberoi user-resources=<memory:4096, vCores:2>
2015-03-13 10:06:10,005 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0006_01_000004, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:10,005 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:10,005 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:06:10,005 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0006_000001 released container container_1426266260362_0006_01_000004 on node: host: 10.1.1.144:60719 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:06:10,202 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:06:10,202 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0005_01_000001
2015-03-13 10:06:10,203 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:10,203 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0005_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:06:10,204 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0005_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:06:10,203 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0005_000001
2015-03-13 10:06:10,204 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0005	CONTAINERID=container_1426266260362_0005_01_000001
2015-03-13 10:06:10,204 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0005_000001 State change from FINISHING to FINISHED
2015-03-13 10:06:10,204 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0005_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:06:10,204 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0005 State change from FINISHING to FINISHED
2015-03-13 10:06:10,204 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:06:10,205 INFO  amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0005_000001
2015-03-13 10:06:10,205 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1426266260362_0005
2015-03-13 10:06:10,205 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0005_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:10,205 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:10,206 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1
2015-03-13 10:06:10,205 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0005,name=[FC83D3BF82BA4B999048416E4B0AF853/1C978E7C0B2B420185FC2705C6894108] lower*upper/(1/3),user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0005/jobhistory/job/job_1426266260362_0005,appMasterHost=Edinburgh.local,startTime=1426266337896,finishTime=1426266363764,finalStatus=SUCCEEDED
2015-03-13 10:06:10,206 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0005_000001 released container container_1426266260362_0005_01_000001 on node: host: 10.1.1.144:60711 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:06:10,206 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0006_01_000008 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:06:10,206 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0006	CONTAINERID=container_1426266260362_0006_01_000008
2015-03-13 10:06:10,207 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0006_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:06:10,207 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0006 container=Container: [ContainerId: container_1426266260362_0006_01_000008, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0006_01_000008 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:10,207 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=2, numContainers=2
2015-03-13 10:06:10,207 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:10,207 INFO  capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0005_000001 is done. finalState=FINISHED
2015-03-13 10:06:10,207 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0005 requests cleared
2015-03-13 10:06:10,208 INFO  capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0005 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:06:10,208 INFO  capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0005 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:06:10,208 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0005_000001 (auth:SIMPLE)
2015-03-13 10:06:10,210 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0005_01_000001
2015-03-13 10:06:10,542 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741888_1064 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741888 for deletion
2015-03-13 10:06:10,543 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741890_1066 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741890 for deletion
2015-03-13 10:06:10,543 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741882_1058 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741882 for deletion
2015-03-13 10:06:10,543 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741888_1064 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741888
2015-03-13 10:06:10,543 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741884_1060 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741884 for deletion
2015-03-13 10:06:10,544 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741886_1062 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741886 for deletion
2015-03-13 10:06:10,544 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741890_1066 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741890
2015-03-13 10:06:10,544 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741882_1058 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741882
2015-03-13 10:06:10,545 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741884_1060 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741884
2015-03-13 10:06:10,545 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741886_1062 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741886
2015-03-13 10:06:10,730 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741891_1067 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741891 for deletion
2015-03-13 10:06:10,730 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741882_1058 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741882 for deletion
2015-03-13 10:06:10,731 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741884_1060 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741884 for deletion
2015-03-13 10:06:10,731 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741891_1067 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741891
2015-03-13 10:06:10,731 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741886_1062 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741886 for deletion
2015-03-13 10:06:10,731 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741882_1058 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741882
2015-03-13 10:06:10,732 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741884_1060 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741884
2015-03-13 10:06:10,732 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741886_1062 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741886
2015-03-13 10:06:10,776 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0005 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:06:10,776 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0005
2015-03-13 10:06:10,776 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0005
2015-03-13 10:06:10,777 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0005
2015-03-13 10:06:10,777 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0005
2015-03-13 10:06:10,777 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0005
2015-03-13 10:06:10,777 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0005 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:06:10,778 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0005, with delay of 10800 seconds
2015-03-13 10:06:10,856 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0005 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:06:10,857 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0005
2015-03-13 10:06:10,857 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0005
2015-03-13 10:06:10,857 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0005
2015-03-13 10:06:10,857 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0005 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:06:10,857 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0005
2015-03-13 10:06:10,858 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0005, with delay of 10800 seconds
2015-03-13 10:06:10,857 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0005
2015-03-13 10:06:11,074 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0006_01_000008 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:06:11,085 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0006_000001 (auth:SIMPLE)
2015-03-13 10:06:11,087 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0006_01_000008 by user soberoi
2015-03-13 10:06:11,087 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0006	CONTAINERID=container_1426266260362_0006_01_000008
2015-03-13 10:06:11,087 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0006_01_000008 to application application_1426266260362_0006
2015-03-13 10:06:11,087 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000008 transitioned from NEW to LOCALIZING
2015-03-13 10:06:11,088 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0006
2015-03-13 10:06:11,088 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0006
2015-03-13 10:06:11,088 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:06:11,088 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0006
2015-03-13 10:06:11,088 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000008 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:06:11,114 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000008 transitioned from LOCALIZED to RUNNING
2015-03-13 10:06:11,114 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:11,180 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000008/default_container_executor.sh]
2015-03-13 10:06:11,207 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:11,208 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 8 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:11,208 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0006_01_000008 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:06:11,208 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0005 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:06:11,209 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0005
2015-03-13 10:06:11,209 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0005
2015-03-13 10:06:11,209 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0005
2015-03-13 10:06:11,210 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0005
2015-03-13 10:06:11,209 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0005
2015-03-13 10:06:11,210 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0005 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:06:11,211 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0005, with delay of 10800 seconds
2015-03-13 10:06:12,084 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:06:12,212 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:12,212 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 8 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:13,217 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:13,217 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 8 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:13,586 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/5116607014_lower_9AD2589890154BF394AB0F3C492A089C/_temporary/1/_temporary/attempt_1426266260362_0006_r_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:13,623 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/5116607014_lower_9AD2589890154BF394AB0F3C492A089C/_temporary/1/_temporary/attempt_1426266260362_0006_r_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073741898_1074{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:06:13,681 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741898_1074 src: /127.0.0.1:61273 dest: /127.0.0.1:60696
2015-03-13 10:06:13,682 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741898_1074 src: /127.0.0.1:61274 dest: /127.0.0.1:60693
2015-03-13 10:06:13,684 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741898_1074 src: /127.0.0.1:61275 dest: /127.0.0.1:60686
2015-03-13 10:06:13,695 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61275, dest: /127.0.0.1:60686, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0006_r_000000_0_-301781807_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741898_1074, duration: 10091000
2015-03-13 10:06:13,695 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741898_1074, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:13,696 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741898_1074{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:06:13,696 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61274, dest: /127.0.0.1:60693, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0006_r_000000_0_-301781807_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741898_1074, duration: 11044000
2015-03-13 10:06:13,697 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741898_1074, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:13,697 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741898_1074{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:06:13,698 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61273, dest: /127.0.0.1:60696, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0006_r_000000_0_-301781807_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741898_1074, duration: 12474000
2015-03-13 10:06:13,698 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741898_1074, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:13,698 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741898_1074{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:06:13,701 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/5116607014_lower_9AD2589890154BF394AB0F3C492A089C/_temporary/1/_temporary/attempt_1426266260362_0006_r_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0006_r_000000_0_-301781807_1
2015-03-13 10:06:13,709 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5116607014_lower_9AD2589890154BF394AB0F3C492A089C/_temporary/1/_temporary/attempt_1426266260362_0006_r_000000_0	dst=null	perm=null
2015-03-13 10:06:13,715 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5116607014_lower_9AD2589890154BF394AB0F3C492A089C/_temporary/1/_temporary/attempt_1426266260362_0006_r_000000_0	dst=null	perm=null
2015-03-13 10:06:13,716 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5116607014_lower_9AD2589890154BF394AB0F3C492A089C/_temporary/1/task_1426266260362_0006_r_000000	dst=null	perm=null
2015-03-13 10:06:13,718 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/5116607014_lower_9AD2589890154BF394AB0F3C492A089C/_temporary/1/_temporary/attempt_1426266260362_0006_r_000000_0	dst=/tmp/hadoop-soberoi/5116607014_lower_9AD2589890154BF394AB0F3C492A089C/_temporary/1/task_1426266260362_0006_r_000000	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:06:13,726 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0006_01_000008
2015-03-13 10:06:13,726 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0006	CONTAINERID=container_1426266260362_0006_01_000008
2015-03-13 10:06:13,726 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000008 transitioned from RUNNING to KILLING
2015-03-13 10:06:13,726 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0006_01_000008
2015-03-13 10:06:13,727 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:13,727 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 8 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:06:13,734 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:13,738 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_239879959_1
2015-03-13 10:06:13,738 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0006_01_000008 is : 143
2015-03-13 10:06:13,742 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/5116607014_lower_9AD2589890154BF394AB0F3C492A089C/_temporary/1	dst=null	perm=null
2015-03-13 10:06:13,748 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5116607014_lower_9AD2589890154BF394AB0F3C492A089C	dst=null	perm=null
2015-03-13 10:06:13,750 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5116607014_lower_9AD2589890154BF394AB0F3C492A089C	dst=null	perm=null
2015-03-13 10:06:13,751 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/5116607014_lower_9AD2589890154BF394AB0F3C492A089C/_temporary/1/task_1426266260362_0006_r_000000	dst=null	perm=null
2015-03-13 10:06:13,752 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000008 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:06:13,752 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5116607014_lower_9AD2589890154BF394AB0F3C492A089C/part-00000	dst=null	perm=null
2015-03-13 10:06:13,752 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000008
2015-03-13 10:06:13,753 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000008
2015-03-13 10:06:13,754 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000008
2015-03-13 10:06:13,754 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000008
2015-03-13 10:06:13,755 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0006	CONTAINERID=container_1426266260362_0006_01_000008
2015-03-13 10:06:13,755 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000008 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:06:13,755 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0006_01_000008 from application application_1426266260362_0006
2015-03-13 10:06:13,755 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/5116607014_lower_9AD2589890154BF394AB0F3C492A089C/_temporary/1/task_1426266260362_0006_r_000000/part-00000	dst=/tmp/hadoop-soberoi/5116607014_lower_9AD2589890154BF394AB0F3C492A089C/part-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:13,755 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:13,755 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0006
2015-03-13 10:06:13,760 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-soberoi/5116607014_lower_9AD2589890154BF394AB0F3C492A089C/_temporary	dst=null	perm=null
2015-03-13 10:06:13,763 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/5116607014_lower_9AD2589890154BF394AB0F3C492A089C/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:13,765 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/5116607014_lower_9AD2589890154BF394AB0F3C492A089C/_SUCCESS is closed by DFSClient_NONMAPREDUCE_239879959_1
2015-03-13 10:06:13,766 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:13,768 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_239879959_1
2015-03-13 10:06:13,782 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61265, dest: /127.0.0.1:60686, bytes: 66901, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_239879959_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741897_1073, duration: 4904054000
2015-03-13 10:06:13,782 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741897_1073, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:13,783 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741897_1073{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:06:13,784 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61264, dest: /127.0.0.1:60689, bytes: 66901, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_239879959_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741897_1073, duration: 4904762000
2015-03-13 10:06:13,784 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741897_1073, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:13,785 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741897_1073{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:06:13,785 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61263, dest: /127.0.0.1:60696, bytes: 66901, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_239879959_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741897_1073, duration: 4906954000
2015-03-13 10:06:13,786 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741897_1073, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:13,786 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741897_1073{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:06:13,787 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job_1426266260362_0006_1.jhist is closed by DFSClient_NONMAPREDUCE_239879959_1
2015-03-13 10:06:13,789 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0006.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:13,791 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0006.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741899_1075{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:06:13,793 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741899_1075 src: /127.0.0.1:61276 dest: /127.0.0.1:60696
2015-03-13 10:06:13,794 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741899_1075 src: /127.0.0.1:61277 dest: /127.0.0.1:60686
2015-03-13 10:06:13,796 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741899_1075 src: /127.0.0.1:61278 dest: /127.0.0.1:60689
2015-03-13 10:06:13,799 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61278, dest: /127.0.0.1:60689, bytes: 426, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_239879959_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741899_1075, duration: 1364000
2015-03-13 10:06:13,799 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741899_1075, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:13,799 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741899_1075{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:06:13,799 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61277, dest: /127.0.0.1:60686, bytes: 426, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_239879959_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741899_1075, duration: 2027000
2015-03-13 10:06:13,800 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741899_1075, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:13,800 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741899_1075{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:06:13,800 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61276, dest: /127.0.0.1:60696, bytes: 426, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_239879959_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741899_1075, duration: 2776000
2015-03-13 10:06:13,800 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741899_1075, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:13,801 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741899_1075{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:06:13,802 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0006.summary_tmp is closed by DFSClient_NONMAPREDUCE_239879959_1
2015-03-13 10:06:13,805 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0006.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:06:13,811 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job_1426266260362_0006_1.jhist	dst=null	perm=null
2015-03-13 10:06:13,812 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0006-1426266337924-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F1744C2BC8C154281-1426266373769-5-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:06:13,815 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job_1426266260362_0006_1.jhist	dst=null	perm=null
2015-03-13 10:06:13,816 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0006-1426266337924-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F1744C2BC8C154281-1426266373769-5-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:06:13,817 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job_1426266260362_0006_1.jhist	dst=null	perm=null
2015-03-13 10:06:13,819 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0006-1426266337924-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F1744C2BC8C154281-1426266373769-5-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:13,821 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61279, bytes: 67425, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_239879959_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741897_1073, duration: 274000
2015-03-13 10:06:13,823 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0006-1426266337924-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F1744C2BC8C154281-1426266373769-5-1-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741900_1076{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:06:13,825 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741900_1076 src: /127.0.0.1:61280 dest: /127.0.0.1:60689
2015-03-13 10:06:13,826 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741900_1076 src: /127.0.0.1:61281 dest: /127.0.0.1:60686
2015-03-13 10:06:13,827 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741900_1076 src: /127.0.0.1:61282 dest: /127.0.0.1:60696
2015-03-13 10:06:13,830 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61282, dest: /127.0.0.1:60696, bytes: 66901, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_239879959_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741900_1076, duration: 1851000
2015-03-13 10:06:13,831 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741900_1076, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:13,831 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741900_1076{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:06:13,831 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61281, dest: /127.0.0.1:60686, bytes: 66901, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_239879959_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741900_1076, duration: 2315000
2015-03-13 10:06:13,831 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741900_1076, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:13,832 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741900_1076{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:06:13,832 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61280, dest: /127.0.0.1:60689, bytes: 66901, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_239879959_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741900_1076, duration: 3104000
2015-03-13 10:06:13,832 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741900_1076, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:13,833 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741900_1076{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:06:13,834 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0006-1426266337924-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F1744C2BC8C154281-1426266373769-5-1-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_239879959_1
2015-03-13 10:06:13,836 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0006-1426266337924-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F1744C2BC8C154281-1426266373769-5-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:06:13,837 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job_1426266260362_0006_1_conf.xml	dst=null	perm=null
2015-03-13 10:06:13,837 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0006_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:06:13,838 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job_1426266260362_0006_1_conf.xml	dst=null	perm=null
2015-03-13 10:06:13,839 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0006_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:06:13,839 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job_1426266260362_0006_1_conf.xml	dst=null	perm=null
2015-03-13 10:06:13,841 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0006_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:13,847 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61283, bytes: 91394, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_239879959_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741892_1068, duration: 281000
2015-03-13 10:06:13,849 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0006_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741901_1077{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:06:13,851 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741901_1077 src: /127.0.0.1:61284 dest: /127.0.0.1:60696
2015-03-13 10:06:13,852 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741901_1077 src: /127.0.0.1:61285 dest: /127.0.0.1:60693
2015-03-13 10:06:13,854 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741901_1077 src: /127.0.0.1:61286 dest: /127.0.0.1:60689
2015-03-13 10:06:13,857 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61286, dest: /127.0.0.1:60689, bytes: 90682, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_239879959_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741901_1077, duration: 1835000
2015-03-13 10:06:13,858 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741901_1077, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:13,858 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741901_1077{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:06:13,858 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61285, dest: /127.0.0.1:60693, bytes: 90682, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_239879959_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741901_1077, duration: 2450000
2015-03-13 10:06:13,858 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741901_1077, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:13,859 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741901_1077{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:06:13,859 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61284, dest: /127.0.0.1:60696, bytes: 90682, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_239879959_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741901_1077, duration: 3308000
2015-03-13 10:06:13,859 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741901_1077, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:13,860 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741901_1077{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:06:13,861 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0006_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_239879959_1
2015-03-13 10:06:13,863 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0006_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:06:13,865 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0006.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0006.summary	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:06:13,867 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0006_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0006_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:06:13,869 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0006-1426266337924-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F1744C2BC8C154281-1426266373769-5-1-SUCCEEDED-default.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0006-1426266337924-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F1744C2BC8C154281-1426266373769-5-1-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:06:13,876 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0006_000001 State change from RUNNING to FINISHING
2015-03-13 10:06:13,876 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0006
2015-03-13 10:06:13,876 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0006 State change from RUNNING to REMOVING
2015-03-13 10:06:13,876 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0006
2015-03-13 10:06:13,876 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0006 State change from REMOVING to FINISHING
2015-03-13 10:06:14,731 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:14,732 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 8 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:06:14,732 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0006_01_000008
2015-03-13 10:06:14,733 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0006_01_000008 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:06:14,733 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0006_01_000008 in state: COMPLETED event:FINISHED
2015-03-13 10:06:14,733 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0006	CONTAINERID=container_1426266260362_0006_01_000008
2015-03-13 10:06:14,733 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0006_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:06:14,734 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:06:14,734 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0006_01_000008, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:14,734 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:14,734 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:06:14,734 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0006_000001 released container container_1426266260362_0006_01_000008 on node: host: 10.1.1.144:60711 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:06:14,886 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741883_1059 127.0.0.1:60689 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60686 
2015-03-13 10:06:14,886 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741885_1061 127.0.0.1:60689 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60686 
2015-03-13 10:06:14,887 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741887_1063 127.0.0.1:60689 127.0.0.1:60693 127.0.0.1:60696 
2015-03-13 10:06:14,887 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741889_1065 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60693 
2015-03-13 10:06:14,887 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741897_1073 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60686 
2015-03-13 10:06:14,887 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741892_1068 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60689 
2015-03-13 10:06:14,888 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006	dst=null	perm=null
2015-03-13 10:06:14,922 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (3/3) ...dpipesplatform/afterevery
2015-03-13 10:06:14,931 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:06:14,939 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:06:14,942 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery	dst=null	perm=null
2015-03-13 10:06:14,943 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:06:14,944 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:06:14,946 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 7
2015-03-13 10:06:14,946 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007	dst=null	perm=null
2015-03-13 10:06:14,948 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007	dst=null	perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:06:14,949 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007	dst=null	perm=soberoi:supergroup:rwx------
2015-03-13 10:06:14,949 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.jar	dst=null	perm=null
2015-03-13 10:06:14,951 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:06:14,953 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073741902_1078{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:06:14,955 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741902_1078 src: /127.0.0.1:61289 dest: /127.0.0.1:60696
2015-03-13 10:06:14,956 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741902_1078 src: /127.0.0.1:61290 dest: /127.0.0.1:60686
2015-03-13 10:06:14,957 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741902_1078 src: /127.0.0.1:61291 dest: /127.0.0.1:60689
2015-03-13 10:06:14,961 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61291, dest: /127.0.0.1:60689, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741902_1078, duration: 1777000
2015-03-13 10:06:14,961 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741902_1078, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:14,962 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741902_1078{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:06:14,962 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61290, dest: /127.0.0.1:60686, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741902_1078, duration: 2288000
2015-03-13 10:06:14,962 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741902_1078, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:14,962 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741902_1078{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:06:14,963 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61289, dest: /127.0.0.1:60696, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741902_1078, duration: 3375000
2015-03-13 10:06:14,963 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741902_1078, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:14,964 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741902_1078{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:06:14,965 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:06:14,966 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.jar
2015-03-13 10:06:14,966 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.jar	dst=null	perm=null
2015-03-13 10:06:14,967 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:06:14,968 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:06:14,969 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:06:14,969 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:06:14,970 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:06:14,970 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:06:14,971 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:06:14,972 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:06:14,973 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:06:14,974 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:06:14,975 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5116607014_lower_9AD2589890154BF394AB0F3C492A089C	dst=null	perm=null
2015-03-13 10:06:14,976 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5116607014_lower_9AD2589890154BF394AB0F3C492A089C	dst=null	perm=null
2015-03-13 10:06:14,977 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/5116607014_lower_9AD2589890154BF394AB0F3C492A089C	dst=null	perm=null
2015-03-13 10:06:14,978 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:06:14,980 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:06:14,984 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:06:14,985 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.split
2015-03-13 10:06:14,985 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.split	dst=null	perm=null
2015-03-13 10:06:14,987 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073741903_1079{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:06:14,988 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741903_1079 src: /127.0.0.1:61292 dest: /127.0.0.1:60689
2015-03-13 10:06:14,990 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741903_1079 src: /127.0.0.1:61293 dest: /127.0.0.1:60696
2015-03-13 10:06:14,992 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741903_1079 src: /127.0.0.1:61294 dest: /127.0.0.1:60693
2015-03-13 10:06:14,994 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741903_1079 src: /127.0.0.1:61295 dest: /127.0.0.1:60686
2015-03-13 10:06:14,998 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61295, dest: /127.0.0.1:60686, bytes: 352, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741903_1079, duration: 2010000
2015-03-13 10:06:14,998 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741903_1079, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:14,999 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741903_1079{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:06:14,999 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61294, dest: /127.0.0.1:60693, bytes: 352, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741903_1079, duration: 2500000
2015-03-13 10:06:14,999 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741903_1079, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:14,999 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741903_1079{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:06:15,000 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61293, dest: /127.0.0.1:60696, bytes: 352, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741903_1079, duration: 3610000
2015-03-13 10:06:15,000 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741903_1079, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:15,000 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741903_1079{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:06:15,001 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61292, dest: /127.0.0.1:60689, bytes: 352, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741903_1079, duration: 4211000
2015-03-13 10:06:15,001 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741903_1079, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:15,002 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741903_1079{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:06:15,003 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:06:15,004 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:06:15,006 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:06:15,007 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073741904_1080{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:06:15,009 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741904_1080 src: /127.0.0.1:61296 dest: /127.0.0.1:60689
2015-03-13 10:06:15,010 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741904_1080 src: /127.0.0.1:61297 dest: /127.0.0.1:60686
2015-03-13 10:06:15,012 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741904_1080 src: /127.0.0.1:61298 dest: /127.0.0.1:60693
2015-03-13 10:06:15,015 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61298, dest: /127.0.0.1:60693, bytes: 44, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741904_1080, duration: 1142000
2015-03-13 10:06:15,015 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741904_1080, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:15,015 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741904_1080{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:15,015 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61297, dest: /127.0.0.1:60686, bytes: 44, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741904_1080, duration: 1677000
2015-03-13 10:06:15,016 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741904_1080, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:15,016 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741904_1080{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:15,016 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61296, dest: /127.0.0.1:60689, bytes: 44, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741904_1080, duration: 2499000
2015-03-13 10:06:15,016 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741904_1080, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:15,019 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741904_1080{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:15,020 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:06:15,020 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-03-13 10:06:15,022 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:06:15,023 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:06:15,025 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:06:15,025 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:06:15,025 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:06:15,042 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073741905_1081{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:06:15,043 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741905_1081 src: /127.0.0.1:61299 dest: /127.0.0.1:60693
2015-03-13 10:06:15,045 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741905_1081 src: /127.0.0.1:61300 dest: /127.0.0.1:60686
2015-03-13 10:06:15,046 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741905_1081 src: /127.0.0.1:61301 dest: /127.0.0.1:60689
2015-03-13 10:06:15,052 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61301, dest: /127.0.0.1:60689, bytes: 98258, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741905_1081, duration: 4857000
2015-03-13 10:06:15,053 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741905_1081, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:15,053 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741905_1081{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:06:15,053 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61300, dest: /127.0.0.1:60686, bytes: 98258, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741905_1081, duration: 5276000
2015-03-13 10:06:15,053 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741905_1081, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:15,054 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741905_1081{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:06:15,054 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61299, dest: /127.0.0.1:60693, bytes: 98258, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741905_1081, duration: 6134000
2015-03-13 10:06:15,054 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741905_1081, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:15,055 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741905_1081{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:06:15,058 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:06:15,058 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0007
2015-03-13 10:06:15,059 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007	dst=null	perm=null
2015-03-13 10:06:15,060 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.xml	dst=null	perm=null
2015-03-13 10:06:15,061 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.xml	dst=null	perm=null
2015-03-13 10:06:15,062 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.jar	dst=null	perm=null
2015-03-13 10:06:15,063 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.jar	dst=null	perm=null
2015-03-13 10:06:15,064 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.split	dst=null	perm=null
2015-03-13 10:06:15,065 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.split	dst=null	perm=null
2015-03-13 10:06:15,066 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:06:15,067 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:06:15,068 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:06:15,069 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:06:15,070 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:06:15,070 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:06:15,071 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:06:15,072 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:06:15,073 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 7 submitted by user soberoi
2015-03-13 10:06:15,073 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0007
2015-03-13 10:06:15,073 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	IP=10.1.1.144	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1426266260362_0007
2015-03-13 10:06:15,073 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0007
2015-03-13 10:06:15,073 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0007 State change from NEW to NEW_SAVING
2015-03-13 10:06:15,073 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0007 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:06:15,073 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0007_000001
2015-03-13 10:06:15,074 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0007_000001 State change from NEW to SUBMITTED
2015-03-13 10:06:15,074 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0007 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:06:15,074 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0007 from user: soberoi activated in queue: default
2015-03-13 10:06:15,074 INFO  capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0007 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:06:15,074 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0007 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:06:15,074 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0007_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:06:15,074 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0007_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:06:15,074 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0007 State change from SUBMITTED to ACCEPTED
2015-03-13 10:06:15,076 INFO  mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0007/
2015-03-13 10:06:15,076 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1426266260362_0007
2015-03-13 10:06:15,076 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0007/
2015-03-13 10:06:15,152 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741897_1073
2015-03-13 10:06:15,154 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741905_1081
2015-03-13 10:06:15,154 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741904_1080
2015-03-13 10:06:15,155 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741903_1079
2015-03-13 10:06:15,155 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741899_1075
2015-03-13 10:06:15,349 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741897_1073
2015-03-13 10:06:15,350 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741900_1076
2015-03-13 10:06:15,356 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741900_1076
2015-03-13 10:06:15,356 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741898_1074
2015-03-13 10:06:15,369 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741898_1074
2015-03-13 10:06:15,371 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741905_1081
2015-03-13 10:06:15,371 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741903_1079
2015-03-13 10:06:15,371 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741904_1080
2015-03-13 10:06:15,372 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741901_1077
2015-03-13 10:06:15,551 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741902_1078
2015-03-13 10:06:15,552 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741902_1078
2015-03-13 10:06:15,723 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60689 to replicate blk_1073741902_1078 to datanode(s) 127.0.0.1:60693
2015-03-13 10:06:15,723 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073741889_1065, blk_1073741897_1073, blk_1073741883_1059, blk_1073741885_1061]
2015-03-13 10:06:15,723 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073741889_1065, blk_1073741892_1068, blk_1073741897_1073, blk_1073741883_1059, blk_1073741885_1061, blk_1073741887_1063]
2015-03-13 10:06:15,737 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:15,738 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0007_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:06:15,739 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0007	CONTAINERID=container_1426266260362_0007_01_000001
2015-03-13 10:06:15,739 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0007_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:4096, vCores:2> used and <memory:0, vCores:6> available
2015-03-13 10:06:15,739 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0007 container=Container: [ContainerId: container_1426266260362_0007_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0007_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:15,739 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:06:15,739 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0007_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:06:15,739 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:15,740 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0007 AttemptId: appattempt_1426266260362_0007_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0007_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ]
2015-03-13 10:06:15,741 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0007_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:06:15,741 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0007_000001
2015-03-13 10:06:15,741 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0007_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:06:15,741 INFO  amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0007_000001
2015-03-13 10:06:15,742 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0007_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] for AM appattempt_1426266260362_0007_000001
2015-03-13 10:06:15,742 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0007_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-03-13 10:06:15,744 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0007_000001 (auth:SIMPLE)
2015-03-13 10:06:15,746 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0007_01_000001 by user soberoi
2015-03-13 10:06:15,746 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0007
2015-03-13 10:06:15,746 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0007	CONTAINERID=container_1426266260362_0007_01_000001
2015-03-13 10:06:15,746 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0007 transitioned from NEW to INITING
2015-03-13 10:06:15,747 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0007_01_000001 to application application_1426266260362_0007
2015-03-13 10:06:15,747 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0007 transitioned from INITING to RUNNING
2015-03-13 10:06:15,747 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0007_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] for AM appattempt_1426266260362_0007_000001
2015-03-13 10:06:15,747 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0007_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:06:15,747 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0007_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:06:15,747 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0007
2015-03-13 10:06:15,747 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:06:15,748 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:06:15,748 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:06:15,748 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:06:15,748 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0007_01_000001
2015-03-13 10:06:15,750 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741901_1077
2015-03-13 10:06:15,750 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741898_1074
2015-03-13 10:06:15,751 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741899_1075
2015-03-13 10:06:15,751 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741903_1079
2015-03-13 10:06:15,757 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0007_01_000001.tokens. Credentials list: 
2015-03-13 10:06:15,772 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:06:15,777 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741902_1078
2015-03-13 10:06:15,778 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741903_1079
2015-03-13 10:06:15,778 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741897_1073
2015-03-13 10:06:15,779 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741899_1075
2015-03-13 10:06:15,779 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741900_1076
2015-03-13 10:06:15,839 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0007_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0007/container_1426266260362_0007_01_000001.tokens
2015-03-13 10:06:15,840 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0007 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0007
2015-03-13 10:06:15,897 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.jar	dst=null	perm=null
2015-03-13 10:06:15,898 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.jar	dst=null	perm=null
2015-03-13 10:06:15,898 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.jar	dst=null	perm=null
2015-03-13 10:06:15,907 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61305, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_440115166_4203, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741902_1078, duration: 386000
2015-03-13 10:06:15,925 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:06:15,941 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:06:15,941 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:06:15,942 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:06:15,948 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61306, bytes: 48, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_440115166_4203, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741904_1080, duration: 122000
2015-03-13 10:06:15,960 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:06:15,976 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.split	dst=null	perm=null
2015-03-13 10:06:15,977 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.split	dst=null	perm=null
2015-03-13 10:06:15,977 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741901_1077
2015-03-13 10:06:15,977 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741904_1080
2015-03-13 10:06:15,978 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.split	dst=null	perm=null
2015-03-13 10:06:15,978 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741905_1081
2015-03-13 10:06:15,984 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61307, bytes: 356, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_440115166_4203, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741903_1079, duration: 150000
2015-03-13 10:06:15,996 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:06:16,014 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.xml	dst=null	perm=null
2015-03-13 10:06:16,015 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.xml	dst=null	perm=null
2015-03-13 10:06:16,016 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.xml	dst=null	perm=null
2015-03-13 10:06:16,021 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61307, bytes: 99026, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_440115166_4203, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741905_1081, duration: 304000
2015-03-13 10:06:16,033 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:06:16,033 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0007_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:06:16,058 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0007_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:06:16,058 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:16,121 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0007/container_1426266260362_0007_01_000001/default_container_executor.sh]
2015-03-13 10:06:16,380 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741889_1065 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741889 for deletion
2015-03-13 10:06:16,380 INFO  datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-1172757413-10.1.1.144-60689-1426266259165, infoPort=60690, ipcPort=60692, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073741902_1078 to 127.0.0.1:60693 
2015-03-13 10:06:16,380 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741897_1073 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741897 for deletion
2015-03-13 10:06:16,381 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741883_1059 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741883 for deletion
2015-03-13 10:06:16,381 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741889_1065 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741889 for deletion
2015-03-13 10:06:16,381 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741892_1068 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741892 for deletion
2015-03-13 10:06:16,381 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741889_1065 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741889
2015-03-13 10:06:16,382 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741897_1073 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741897
2015-03-13 10:06:16,382 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741883_1059 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741883
2015-03-13 10:06:16,382 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741892_1068 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741892
2015-03-13 10:06:16,381 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741897_1073 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741897 for deletion
2015-03-13 10:06:16,382 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741883_1059 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741883 for deletion
2015-03-13 10:06:16,381 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741885_1061 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741885 for deletion
2015-03-13 10:06:16,383 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741897_1073 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741897
2015-03-13 10:06:16,383 INFO  datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073741902_1078 (numBytes=254067) to /127.0.0.1:60693
2015-03-13 10:06:16,383 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741885_1061 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741885
2015-03-13 10:06:16,382 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741885_1061 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741885 for deletion
2015-03-13 10:06:16,383 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741887_1063 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741887 for deletion
2015-03-13 10:06:16,382 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741889_1065 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741889
2015-03-13 10:06:16,383 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741902_1078 src: /127.0.0.1:61308 dest: /127.0.0.1:60693
2015-03-13 10:06:16,384 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741887_1063 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741887
2015-03-13 10:06:16,383 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741883_1059 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741883
2015-03-13 10:06:16,384 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741885_1061 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741885
2015-03-13 10:06:16,385 INFO  datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073741902_1078 src: /127.0.0.1:61308 dest: /127.0.0.1:60693 of size 254067
2015-03-13 10:06:16,386 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741902_1078 size 254067
2015-03-13 10:06:16,741 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:16,742 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:16,742 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0007_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:06:17,690 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:06:17,712 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/COMMIT_STARTED	dst=null	perm=null
2015-03-13 10:06:17,713 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/COMMIT_SUCCESS	dst=null	perm=null
2015-03-13 10:06:17,714 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/COMMIT_FAIL	dst=null	perm=null
2015-03-13 10:06:17,746 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:17,747 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:17,766 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007	dst=null	perm=null
2015-03-13 10:06:17,768 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:06:17,769 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:06:18,048 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:06:18,055 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:06:18,115 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61310, bytes: 48, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_771583040_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741904_1080, duration: 141000
2015-03-13 10:06:18,724 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073741892_1068, blk_1073741897_1073, blk_1073741883_1059, blk_1073741885_1061, blk_1073741887_1063]
2015-03-13 10:06:18,724 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073741889_1065, blk_1073741892_1068, blk_1073741883_1059, blk_1073741885_1061, blk_1073741887_1063]
2015-03-13 10:06:18,747 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:18,748 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:18,895 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0007_000001 (auth:SIMPLE)
2015-03-13 10:06:18,897 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0007_000001
2015-03-13 10:06:18,897 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi	IP=10.1.1.144	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1426266260362_0007	APPATTEMPTID=appattempt_1426266260362_0007_000001
2015-03-13 10:06:18,897 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0007_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:06:18,897 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0007 State change from ACCEPTED to RUNNING
2015-03-13 10:06:18,917 INFO  namenode.FSEditLog (FSEditLog.java:printStatistics(663)) - Number of transactions: 683 Total time for transactions(ms): 29 Number of transactions batched in Syncs: 0 Number of syncs: 377 SyncTimes(ms): 124 97 
2015-03-13 10:06:18,920 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job_1426266260362_0007_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:18,921 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:06:18,986 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job_1426266260362_0007_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:19,106 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job_1426266260362_0007_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073741906_1082{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:06:19,144 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741906_1082 src: /127.0.0.1:61316 dest: /127.0.0.1:60696
2015-03-13 10:06:19,145 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741906_1082 src: /127.0.0.1:61317 dest: /127.0.0.1:60686
2015-03-13 10:06:19,147 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741906_1082 src: /127.0.0.1:61318 dest: /127.0.0.1:60693
2015-03-13 10:06:19,157 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61318, dest: /127.0.0.1:60693, bytes: 91097, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_771583040_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741906_1082, duration: 7503000
2015-03-13 10:06:19,157 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741906_1082, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:19,158 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61317, dest: /127.0.0.1:60686, bytes: 91097, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_771583040_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741906_1082, duration: 8079000
2015-03-13 10:06:19,158 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741906_1082, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:19,159 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741906_1082{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:19,160 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61316, dest: /127.0.0.1:60696, bytes: 91097, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_771583040_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741906_1082, duration: 9606000
2015-03-13 10:06:19,160 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741906_1082, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:19,160 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741906_1082{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:19,161 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741906_1082{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:19,168 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job_1426266260362_0007_1_conf.xml is closed by DFSClient_NONMAPREDUCE_771583040_1
2015-03-13 10:06:19,547 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741889_1065 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741889 for deletion
2015-03-13 10:06:19,547 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741892_1068 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741892 for deletion
2015-03-13 10:06:19,547 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741883_1059 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741883 for deletion
2015-03-13 10:06:19,548 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741889_1065 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741889
2015-03-13 10:06:19,548 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741885_1061 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741885 for deletion
2015-03-13 10:06:19,548 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741887_1063 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741887 for deletion
2015-03-13 10:06:19,548 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741892_1068 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741892
2015-03-13 10:06:19,548 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741883_1059 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741883
2015-03-13 10:06:19,548 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741885_1061 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741885
2015-03-13 10:06:19,549 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741887_1063 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741887
2015-03-13 10:06:19,741 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741892_1068 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741892 for deletion
2015-03-13 10:06:19,741 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741897_1073 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741897 for deletion
2015-03-13 10:06:19,741 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741883_1059 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741883 for deletion
2015-03-13 10:06:19,741 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741892_1068 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741892
2015-03-13 10:06:19,741 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741885_1061 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741885 for deletion
2015-03-13 10:06:19,742 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741887_1063 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741887 for deletion
2015-03-13 10:06:19,742 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741897_1073 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741897
2015-03-13 10:06:19,742 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741883_1059 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741883
2015-03-13 10:06:19,743 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741885_1061 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741885
2015-03-13 10:06:19,743 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741887_1063 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741887
2015-03-13 10:06:19,751 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:19,752 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:20,019 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0007_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:06:20,019 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0007	CONTAINERID=container_1426266260362_0007_01_000002
2015-03-13 10:06:20,019 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0007_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:06:20,020 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0007 container=Container: [ContainerId: container_1426266260362_0007_01_000002, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0007_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:20,020 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:06:20,020 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:20,021 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0006_01_000002 succeeded 
2015-03-13 10:06:20,021 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000002 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:06:20,021 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0006_01_000002
2015-03-13 10:06:20,029 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000002
2015-03-13 10:06:20,029 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000002
2015-03-13 10:06:20,029 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000002
2015-03-13 10:06:20,030 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000002
2015-03-13 10:06:20,030 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0006	CONTAINERID=container_1426266260362_0006_01_000002
2015-03-13 10:06:20,030 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000002 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:06:20,030 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0006_01_000002 from application application_1426266260362_0006
2015-03-13 10:06:20,030 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:20,030 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0006
2015-03-13 10:06:20,379 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741902_1078
2015-03-13 10:06:20,556 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741906_1082
2015-03-13 10:06:20,580 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741906_1082
2015-03-13 10:06:20,754 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:06:20,754 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0006_01_000002
2015-03-13 10:06:20,754 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:20,755 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0006_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:06:20,755 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0006_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:06:20,755 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0006	CONTAINERID=container_1426266260362_0006_01_000002
2015-03-13 10:06:20,755 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0006_000001
2015-03-13 10:06:20,756 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0006_000001 State change from FINISHING to FINISHED
2015-03-13 10:06:20,756 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0006 State change from FINISHING to FINISHED
2015-03-13 10:06:20,756 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0006_01_000002 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:06:20,756 INFO  amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0006_000001
2015-03-13 10:06:20,756 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1426266260362_0006
2015-03-13 10:06:20,757 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0006,name=[FC83D3BF82BA4B999048416E4B0AF853/1744C2BC8C1542818B6974502505089D] lower*upper/(2/3),user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0006/jobhistory/job/job_1426266260362_0006,appMasterHost=Edinburgh.local,startTime=1426266337924,finishTime=1426266373876,finalStatus=SUCCEEDED
2015-03-13 10:06:20,756 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:06:20,757 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741906_1082
2015-03-13 10:06:20,757 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0006_01_000002, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=2, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:20,757 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:20,757 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=2, numContainers=2
2015-03-13 10:06:20,757 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0006_000001 released container container_1426266260362_0006_01_000002 on node: host: 10.1.1.144:60711 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:06:20,758 INFO  capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0006_000001 is done. finalState=FINISHED
2015-03-13 10:06:20,758 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0006 requests cleared
2015-03-13 10:06:20,758 INFO  capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0006 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:06:20,758 INFO  capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0006 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:06:20,759 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0006_000001 (auth:SIMPLE)
2015-03-13 10:06:20,760 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0006_01_000002
2015-03-13 10:06:20,892 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0006 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:06:20,892 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0006
2015-03-13 10:06:20,892 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0006
2015-03-13 10:06:20,892 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0006
2015-03-13 10:06:20,893 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0006
2015-03-13 10:06:20,893 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0006 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:06:20,893 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0006, with delay of 10800 seconds
2015-03-13 10:06:20,893 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0006
2015-03-13 10:06:20,933 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0007_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:06:20,958 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.jar	dst=null	perm=null
2015-03-13 10:06:20,959 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.jar	dst=null	perm=null
2015-03-13 10:06:20,968 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.xml	dst=null	perm=null
2015-03-13 10:06:20,969 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.xml	dst=null	perm=null
2015-03-13 10:06:20,971 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:06:20,972 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:06:20,978 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:06:20,980 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:06:20,981 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:06:20,982 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:06:21,022 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0006 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:06:21,022 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0006
2015-03-13 10:06:21,022 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0006
2015-03-13 10:06:21,022 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0006
2015-03-13 10:06:21,023 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0006 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:06:21,023 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0006, with delay of 10800 seconds
2015-03-13 10:06:21,023 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0006
2015-03-13 10:06:21,023 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0006
2015-03-13 10:06:21,046 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0007_000001 (auth:SIMPLE)
2015-03-13 10:06:21,049 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0007_01_000002 by user soberoi
2015-03-13 10:06:21,049 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0007
2015-03-13 10:06:21,049 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0007	CONTAINERID=container_1426266260362_0007_01_000002
2015-03-13 10:06:21,049 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0007 transitioned from NEW to INITING
2015-03-13 10:06:21,050 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0007_01_000002 to application application_1426266260362_0007
2015-03-13 10:06:21,050 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0007 transitioned from INITING to RUNNING
2015-03-13 10:06:21,050 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0007_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:06:21,050 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0007
2015-03-13 10:06:21,050 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0007
2015-03-13 10:06:21,050 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:06:21,050 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0007
2015-03-13 10:06:21,051 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:06:21,051 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:06:21,051 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0007_01_000002
2015-03-13 10:06:21,061 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1426266260362_0007_01_000002.tokens. Credentials list: 
2015-03-13 10:06:21,075 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:06:21,141 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1426266260362_0007_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0007/container_1426266260362_0007_01_000002.tokens
2015-03-13 10:06:21,141 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0007 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0007
2015-03-13 10:06:21,200 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.jar	dst=null	perm=null
2015-03-13 10:06:21,210 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.jar	dst=null	perm=null
2015-03-13 10:06:21,211 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.jar	dst=null	perm=null
2015-03-13 10:06:21,218 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61323, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1357910065_4309, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741902_1078, duration: 384000
2015-03-13 10:06:21,237 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:06:21,256 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.xml	dst=null	perm=null
2015-03-13 10:06:21,256 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.xml	dst=null	perm=null
2015-03-13 10:06:21,257 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.xml	dst=null	perm=null
2015-03-13 10:06:21,264 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61324, bytes: 99026, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1357910065_4309, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741905_1081, duration: 337000
2015-03-13 10:06:21,276 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:06:21,277 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0007_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:06:21,303 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0007_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:06:21,303 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:21,367 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0007/container_1426266260362_0007_01_000002/default_container_executor.sh]
2015-03-13 10:06:21,760 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:21,761 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0006 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:06:21,761 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0006
2015-03-13 10:06:21,761 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0006 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:06:21,762 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0006, with delay of 10800 seconds
2015-03-13 10:06:21,762 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0006
2015-03-13 10:06:21,763 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0006
2015-03-13 10:06:21,764 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0006
2015-03-13 10:06:21,765 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0006
2015-03-13 10:06:21,947 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:06:22,027 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:22,028 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0007_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:06:22,762 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:23,028 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:23,354 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.split	dst=null	perm=null
2015-03-13 10:06:23,425 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61327, bytes: 356, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0007_m_000000_0_-1764019373_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741903_1079, duration: 194000
2015-03-13 10:06:23,475 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5116607014_lower_9AD2589890154BF394AB0F3C492A089C/part-00000	dst=null	perm=null
2015-03-13 10:06:23,481 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/5116607014_lower_9AD2589890154BF394AB0F3C492A089C/part-00000	dst=null	perm=null
2015-03-13 10:06:23,483 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61328, bytes: 184, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0007_m_000000_0_-1764019373_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741898_1074, duration: 195000
2015-03-13 10:06:23,502 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery/_temporary/1/_temporary/attempt_1426266260362_0007_m_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:23,654 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/3391551687_upper_6F2967859C074FB3A05AC9B5C5BE893F	dst=null	perm=null
2015-03-13 10:06:23,655 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/3391551687_upper_6F2967859C074FB3A05AC9B5C5BE893F	dst=null	perm=null
2015-03-13 10:06:23,657 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/3391551687_upper_6F2967859C074FB3A05AC9B5C5BE893F	dst=null	perm=null
2015-03-13 10:06:23,665 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/3391551687_upper_6F2967859C074FB3A05AC9B5C5BE893F/part-00000	dst=null	perm=null
2015-03-13 10:06:23,666 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/3391551687_upper_6F2967859C074FB3A05AC9B5C5BE893F/part-00000	dst=null	perm=null
2015-03-13 10:06:23,669 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61329, bytes: 184, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0007_m_000000_0_-1764019373_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741893_1069, duration: 187000
2015-03-13 10:06:23,689 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery/_temporary/1/_temporary/attempt_1426266260362_0007_m_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073741907_1083{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:06:23,715 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741907_1083 src: /127.0.0.1:61330 dest: /127.0.0.1:60689
2015-03-13 10:06:23,717 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741907_1083 src: /127.0.0.1:61331 dest: /127.0.0.1:60686
2015-03-13 10:06:23,718 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741907_1083 src: /127.0.0.1:61332 dest: /127.0.0.1:60693
2015-03-13 10:06:23,723 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61332, dest: /127.0.0.1:60693, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0007_m_000000_0_-1764019373_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741907_1083, duration: 4066000
2015-03-13 10:06:23,724 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741907_1083, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:23,724 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741907_1083{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:23,724 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61331, dest: /127.0.0.1:60686, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0007_m_000000_0_-1764019373_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741907_1083, duration: 4646000
2015-03-13 10:06:23,724 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741907_1083, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:23,725 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741907_1083{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:23,725 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61330, dest: /127.0.0.1:60689, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0007_m_000000_0_-1764019373_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741907_1083, duration: 5448000
2015-03-13 10:06:23,725 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741907_1083, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:23,726 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741907_1083{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:23,729 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery/_temporary/1/_temporary/attempt_1426266260362_0007_m_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0007_m_000000_0_-1764019373_1
2015-03-13 10:06:23,735 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery/_temporary/1/_temporary/attempt_1426266260362_0007_m_000000_0	dst=null	perm=null
2015-03-13 10:06:23,739 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery/_temporary/1/_temporary/attempt_1426266260362_0007_m_000000_0	dst=null	perm=null
2015-03-13 10:06:23,740 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery/_temporary/1/task_1426266260362_0007_m_000000	dst=null	perm=null
2015-03-13 10:06:23,743 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery/_temporary/1/_temporary/attempt_1426266260362_0007_m_000000_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery/_temporary/1/task_1426266260362_0007_m_000000	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:06:23,764 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0007_01_000002
2015-03-13 10:06:23,764 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0007	CONTAINERID=container_1426266260362_0007_01_000002
2015-03-13 10:06:23,765 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0007_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:06:23,765 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0007_01_000002
2015-03-13 10:06:23,765 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:06:23,767 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:23,774 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0007_01_000002 is : 143
2015-03-13 10:06:23,780 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job_1426266260362_0007_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073741908_1084{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:06:23,780 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:23,782 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741908_1084 src: /127.0.0.1:61333 dest: /127.0.0.1:60693
2015-03-13 10:06:23,782 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_771583040_1
2015-03-13 10:06:23,783 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741908_1084 src: /127.0.0.1:61334 dest: /127.0.0.1:60686
2015-03-13 10:06:23,785 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741908_1084 src: /127.0.0.1:61335 dest: /127.0.0.1:60689
2015-03-13 10:06:23,787 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery/_temporary/1	dst=null	perm=null
2015-03-13 10:06:23,787 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0007_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:06:23,787 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0007/container_1426266260362_0007_01_000002
2015-03-13 10:06:23,787 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0007/container_1426266260362_0007_01_000002
2015-03-13 10:06:23,788 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0007/container_1426266260362_0007_01_000002
2015-03-13 10:06:23,788 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0007/container_1426266260362_0007_01_000002
2015-03-13 10:06:23,788 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0007	CONTAINERID=container_1426266260362_0007_01_000002
2015-03-13 10:06:23,788 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0007_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:06:23,788 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0007_01_000002 from application application_1426266260362_0007
2015-03-13 10:06:23,788 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:23,789 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0007
2015-03-13 10:06:23,791 INFO  hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job_1426266260362_0007_1.jhist for DFSClient_NONMAPREDUCE_771583040_1
2015-03-13 10:06:23,793 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery	dst=null	perm=null
2015-03-13 10:06:23,795 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery	dst=null	perm=null
2015-03-13 10:06:23,796 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery/_temporary/1/task_1426266260362_0007_m_000000	dst=null	perm=null
2015-03-13 10:06:23,797 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery/part-00000	dst=null	perm=null
2015-03-13 10:06:23,800 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery/_temporary/1/task_1426266260362_0007_m_000000/part-00000	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery/part-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:23,806 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery/_temporary	dst=null	perm=null
2015-03-13 10:06:23,810 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:23,813 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery/_SUCCESS is closed by DFSClient_NONMAPREDUCE_771583040_1
2015-03-13 10:06:23,815 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:23,817 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_771583040_1
2015-03-13 10:06:23,828 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61335, dest: /127.0.0.1:60689, bytes: 23084, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_771583040_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741908_1084, duration: 41819000
2015-03-13 10:06:23,828 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741908_1084, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:23,831 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741908_1084{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:06:23,831 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61334, dest: /127.0.0.1:60686, bytes: 23084, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_771583040_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741908_1084, duration: 44663000
2015-03-13 10:06:23,831 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741908_1084, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:23,832 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741908_1084{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:06:23,832 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61333, dest: /127.0.0.1:60693, bytes: 23084, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_771583040_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741908_1084, duration: 45453000
2015-03-13 10:06:23,832 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741908_1084, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:23,832 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741908_1084{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:06:23,834 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job_1426266260362_0007_1.jhist is closed by DFSClient_NONMAPREDUCE_771583040_1
2015-03-13 10:06:23,835 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0007.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:23,837 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0007.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741909_1085{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:06:23,839 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741909_1085 src: /127.0.0.1:61336 dest: /127.0.0.1:60686
2015-03-13 10:06:23,841 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741909_1085 src: /127.0.0.1:61337 dest: /127.0.0.1:60696
2015-03-13 10:06:23,842 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741909_1085 src: /127.0.0.1:61338 dest: /127.0.0.1:60693
2015-03-13 10:06:23,845 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61338, dest: /127.0.0.1:60693, bytes: 439, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_771583040_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741909_1085, duration: 1514000
2015-03-13 10:06:23,845 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741909_1085, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:23,845 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741909_1085{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:23,845 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61337, dest: /127.0.0.1:60696, bytes: 439, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_771583040_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741909_1085, duration: 2108000
2015-03-13 10:06:23,846 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741909_1085, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:23,846 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741909_1085{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:23,846 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61336, dest: /127.0.0.1:60686, bytes: 439, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_771583040_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741909_1085, duration: 3069000
2015-03-13 10:06:23,847 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741909_1085, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:23,847 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741909_1085{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:23,848 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0007.summary_tmp is closed by DFSClient_NONMAPREDUCE_771583040_1
2015-03-13 10:06:23,852 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0007.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:06:23,858 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job_1426266260362_0007_1.jhist	dst=null	perm=null
2015-03-13 10:06:23,859 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0007-1426266375072-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F28CD4D9B5CB64D6C-1426266383818-1-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:06:23,863 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job_1426266260362_0007_1.jhist	dst=null	perm=null
2015-03-13 10:06:23,864 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0007-1426266375072-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F28CD4D9B5CB64D6C-1426266383818-1-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:06:23,865 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job_1426266260362_0007_1.jhist	dst=null	perm=null
2015-03-13 10:06:23,868 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0007-1426266375072-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F28CD4D9B5CB64D6C-1426266383818-1-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:23,870 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61339, bytes: 23268, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_771583040_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741908_1084, duration: 145000
2015-03-13 10:06:23,871 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0007-1426266375072-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F28CD4D9B5CB64D6C-1426266383818-1-0-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741910_1086{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:06:23,873 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741910_1086 src: /127.0.0.1:61340 dest: /127.0.0.1:60689
2015-03-13 10:06:23,874 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741910_1086 src: /127.0.0.1:61341 dest: /127.0.0.1:60686
2015-03-13 10:06:23,876 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741910_1086 src: /127.0.0.1:61342 dest: /127.0.0.1:60696
2015-03-13 10:06:23,878 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61342, dest: /127.0.0.1:60696, bytes: 23084, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_771583040_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741910_1086, duration: 1442000
2015-03-13 10:06:23,878 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741910_1086, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:23,879 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741910_1086{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:06:23,879 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61341, dest: /127.0.0.1:60686, bytes: 23084, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_771583040_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741910_1086, duration: 2035000
2015-03-13 10:06:23,879 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741910_1086, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:23,879 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741910_1086{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:06:23,880 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61340, dest: /127.0.0.1:60689, bytes: 23084, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_771583040_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741910_1086, duration: 2790000
2015-03-13 10:06:23,880 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741910_1086, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:23,880 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741910_1086{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:06:23,882 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0007-1426266375072-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F28CD4D9B5CB64D6C-1426266383818-1-0-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_771583040_1
2015-03-13 10:06:23,883 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0007-1426266375072-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F28CD4D9B5CB64D6C-1426266383818-1-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:06:23,884 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job_1426266260362_0007_1_conf.xml	dst=null	perm=null
2015-03-13 10:06:23,885 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0007_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:06:23,886 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job_1426266260362_0007_1_conf.xml	dst=null	perm=null
2015-03-13 10:06:23,886 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0007_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:06:23,887 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job_1426266260362_0007_1_conf.xml	dst=null	perm=null
2015-03-13 10:06:23,889 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0007_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:23,894 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61343, bytes: 91809, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_771583040_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741906_1082, duration: 269000
2015-03-13 10:06:23,895 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0007_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741911_1087{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:06:23,897 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741911_1087 src: /127.0.0.1:61344 dest: /127.0.0.1:60693
2015-03-13 10:06:23,899 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741911_1087 src: /127.0.0.1:61345 dest: /127.0.0.1:60696
2015-03-13 10:06:23,900 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741911_1087 src: /127.0.0.1:61346 dest: /127.0.0.1:60686
2015-03-13 10:06:23,903 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61346, dest: /127.0.0.1:60686, bytes: 91097, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_771583040_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741911_1087, duration: 2027000
2015-03-13 10:06:23,904 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741911_1087, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:23,904 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741911_1087{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:06:23,904 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61345, dest: /127.0.0.1:60696, bytes: 91097, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_771583040_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741911_1087, duration: 2704000
2015-03-13 10:06:23,904 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741911_1087, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:23,905 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741911_1087{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:06:23,905 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61344, dest: /127.0.0.1:60693, bytes: 91097, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_771583040_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741911_1087, duration: 3491000
2015-03-13 10:06:23,905 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741911_1087, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:23,906 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741911_1087{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:06:23,907 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0007_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_771583040_1
2015-03-13 10:06:23,909 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0007_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:06:23,911 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0007.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0007.summary	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:06:23,913 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0007_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0007_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:06:23,915 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0007-1426266375072-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F28CD4D9B5CB64D6C-1426266383818-1-0-SUCCEEDED-default.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0007-1426266375072-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F28CD4D9B5CB64D6C-1426266383818-1-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:06:23,921 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0007_000001 State change from RUNNING to FINISHING
2015-03-13 10:06:23,921 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0007
2015-03-13 10:06:23,921 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0007 State change from RUNNING to REMOVING
2015-03-13 10:06:23,922 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0007
2015-03-13 10:06:23,922 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0007 State change from REMOVING to FINISHING
2015-03-13 10:06:24,768 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:06:24,768 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0007_01_000002
2015-03-13 10:06:24,768 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:24,768 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0007_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:06:24,769 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0007_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:06:24,769 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0007	CONTAINERID=container_1426266260362_0007_01_000002
2015-03-13 10:06:24,769 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0007_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:06:24,769 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:06:24,769 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0007_01_000002, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:24,770 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:24,770 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:06:24,770 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0007_000001 released container container_1426266260362_0007_01_000002 on node: host: 10.1.1.144:60719 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:06:24,928 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741902_1078 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60693 
2015-03-13 10:06:24,928 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741903_1079 127.0.0.1:60689 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60686 
2015-03-13 10:06:24,928 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741904_1080 127.0.0.1:60689 127.0.0.1:60686 127.0.0.1:60693 
2015-03-13 10:06:24,928 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741905_1081 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60689 
2015-03-13 10:06:24,929 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741908_1084 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60689 
2015-03-13 10:06:24,929 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741906_1082 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60693 
2015-03-13 10:06:24,929 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007	dst=null	perm=null
2015-03-13 10:06:24,960 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741893_1069 127.0.0.1:60693 127.0.0.1:60689 127.0.0.1:60696 
2015-03-13 10:06:24,960 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-soberoi/3391551687_upper_6F2967859C074FB3A05AC9B5C5BE893F	dst=null	perm=null
2015-03-13 10:06:24,961 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741898_1074 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60686 
2015-03-13 10:06:24,961 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-soberoi/5116607014_lower_9AD2589890154BF394AB0F3C492A089C	dst=null	perm=null
2015-03-13 10:06:24,962 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery	dst=null	perm=null
2015-03-13 10:06:24,962 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery/_temporary
2015-03-13 10:06:24,963 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery/_temporary	dst=null	perm=null
2015-03-13 10:06:24,970 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:06:24,971 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:06:24,971 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:06:24,973 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery	dst=null	perm=null
2015-03-13 10:06:24,973 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery	dst=null	perm=null
2015-03-13 10:06:24,974 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery	dst=null	perm=null
2015-03-13 10:06:24,974 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:06:24,975 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery/part-00000	dst=null	perm=null
2015-03-13 10:06:24,977 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61347, bytes: 44, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741907_1083, duration: 178000
2015-03-13 10:06:24,984 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:06:24,984 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:06:24,985 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:06:24,986 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery	dst=null	perm=null
2015-03-13 10:06:24,987 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery	dst=null	perm=null
2015-03-13 10:06:24,987 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery	dst=null	perm=null
2015-03-13 10:06:24,988 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:06:24,989 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery/part-00000	dst=null	perm=null
2015-03-13 10:06:24,991 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61348, bytes: 44, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741907_1083, duration: 186000
2015-03-13 10:06:24,991 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/afterevery
2015-03-13 10:06:24,991 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery	dst=null	perm=null
2015-03-13 10:06:24,992 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery	dst=null	perm=null
2015-03-13 10:06:24,992 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery	dst=null	perm=null
2015-03-13 10:06:24,993 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery	dst=null	perm=null
2015-03-13 10:06:24,994 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery/part-00000	dst=null	perm=null
2015-03-13 10:06:24,995 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery/part-00000	dst=null	perm=null
2015-03-13 10:06:24,997 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61347, bytes: 44, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741907_1083, duration: 227000
2015-03-13 10:06:24,999 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:06:25,000 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:06:25,001 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt	dst=null	perm=null
2015-03-13 10:06:25,002 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt	dst=null	perm=null
2015-03-13 10:06:25,003 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:06:25,005 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt. BP-1005356445-10.1.1.144-1426266257849 blk_1073741912_1088{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:06:25,006 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741912_1088 src: /127.0.0.1:61349 dest: /127.0.0.1:60689
2015-03-13 10:06:25,007 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741912_1088 src: /127.0.0.1:61350 dest: /127.0.0.1:60686
2015-03-13 10:06:25,009 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741912_1088 src: /127.0.0.1:61351 dest: /127.0.0.1:60696
2015-03-13 10:06:25,011 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61351, dest: /127.0.0.1:60696, bytes: 52, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741912_1088, duration: 1035000
2015-03-13 10:06:25,011 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741912_1088, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:25,012 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741912_1088{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:06:25,012 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61350, dest: /127.0.0.1:60686, bytes: 52, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741912_1088, duration: 1429000
2015-03-13 10:06:25,012 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741912_1088, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:25,012 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741912_1088{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:06:25,013 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61349, dest: /127.0.0.1:60689, bytes: 52, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741912_1088, duration: 2425000
2015-03-13 10:06:25,013 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741912_1088, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:25,014 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741912_1088{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:06:25,015 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:06:25,016 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt	dst=null	perm=null
2015-03-13 10:06:25,017 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt	dst=null	perm=null
2015-03-13 10:06:25,019 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:06:25,020 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt. BP-1005356445-10.1.1.144-1426266257849 blk_1073741913_1089{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:06:25,021 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741913_1089 src: /127.0.0.1:61352 dest: /127.0.0.1:60696
2015-03-13 10:06:25,022 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741913_1089 src: /127.0.0.1:61353 dest: /127.0.0.1:60686
2015-03-13 10:06:25,023 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741913_1089 src: /127.0.0.1:61354 dest: /127.0.0.1:60689
2015-03-13 10:06:25,026 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61354, dest: /127.0.0.1:60689, bytes: 51, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741913_1089, duration: 1273000
2015-03-13 10:06:25,026 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741913_1089, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:25,026 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741913_1089{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:06:25,026 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61353, dest: /127.0.0.1:60686, bytes: 51, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741913_1089, duration: 1715000
2015-03-13 10:06:25,027 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741913_1089, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:25,027 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741913_1089{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:06:25,027 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61352, dest: /127.0.0.1:60696, bytes: 51, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741913_1089, duration: 2515000
2015-03-13 10:06:25,027 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741913_1089, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:25,028 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741913_1089{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:06:25,029 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:06:25,040 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:06:25,041 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:06:25,042 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:06:25,074 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin	dst=null	perm=null
2015-03-13 10:06:25,075 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping] starting
2015-03-13 10:06:25,075 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt"]
2015-03-13 10:06:25,075 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-03-13 10:06:25,076 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt"]
2015-03-13 10:06:25,076 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-03-13 10:06:25,076 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping]  sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin"]
2015-03-13 10:06:25,076 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping]  parallel execution is enabled: true
2015-03-13 10:06:25,076 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping]  starting jobs: 1
2015-03-13 10:06:25,076 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping]  allocating threads: 1
2015-03-13 10:06:25,077 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [cogrouping] starting step: (1/1) ...intocogrouplhsswappedjoin
2015-03-13 10:06:25,084 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:06:25,092 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:06:25,093 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin	dst=null	perm=null
2015-03-13 10:06:25,094 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:06:25,094 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:06:25,096 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 8
2015-03-13 10:06:25,097 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008	dst=null	perm=null
2015-03-13 10:06:25,098 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008	dst=null	perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:06:25,099 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008	dst=null	perm=soberoi:supergroup:rwx------
2015-03-13 10:06:25,100 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.jar	dst=null	perm=null
2015-03-13 10:06:25,101 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:06:25,103 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073741914_1090{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:06:25,104 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741914_1090 src: /127.0.0.1:61355 dest: /127.0.0.1:60696
2015-03-13 10:06:25,106 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741914_1090 src: /127.0.0.1:61356 dest: /127.0.0.1:60686
2015-03-13 10:06:25,107 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741914_1090 src: /127.0.0.1:61357 dest: /127.0.0.1:60689
2015-03-13 10:06:25,110 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61357, dest: /127.0.0.1:60689, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741914_1090, duration: 1923000
2015-03-13 10:06:25,111 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741914_1090, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:25,111 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741914_1090{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:06:25,111 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61356, dest: /127.0.0.1:60686, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741914_1090, duration: 2399000
2015-03-13 10:06:25,112 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741914_1090, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:25,112 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741914_1090{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:06:25,112 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61355, dest: /127.0.0.1:60696, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741914_1090, duration: 3553000
2015-03-13 10:06:25,112 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741914_1090, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:25,114 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741914_1090{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:06:25,115 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:06:25,116 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.jar
2015-03-13 10:06:25,117 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.jar	dst=null	perm=null
2015-03-13 10:06:25,118 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:06:25,119 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:06:25,119 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:06:25,120 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:06:25,121 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:06:25,121 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:06:25,122 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:06:25,122 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:06:25,123 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:06:25,123 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:06:25,125 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:06:25,125 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:06:25,126 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:06:25,127 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt	dst=null	perm=null
2015-03-13 10:06:25,127 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:06:25,128 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt	dst=null	perm=null
2015-03-13 10:06:25,129 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:06:25,129 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:06:25,130 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:06:25,131 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt	dst=null	perm=null
2015-03-13 10:06:25,131 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:06:25,131 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt	dst=null	perm=null
2015-03-13 10:06:25,133 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:06:25,134 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:06:25,135 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.split
2015-03-13 10:06:25,136 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.split	dst=null	perm=null
2015-03-13 10:06:25,137 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073741915_1091{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:06:25,138 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741915_1091 src: /127.0.0.1:61358 dest: /127.0.0.1:60686
2015-03-13 10:06:25,139 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741915_1091 src: /127.0.0.1:61359 dest: /127.0.0.1:60693
2015-03-13 10:06:25,140 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741915_1091 src: /127.0.0.1:61360 dest: /127.0.0.1:60689
2015-03-13 10:06:25,141 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741915_1091 src: /127.0.0.1:61361 dest: /127.0.0.1:60696
2015-03-13 10:06:25,144 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61361, dest: /127.0.0.1:60696, bytes: 1778, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741915_1091, duration: 1571000
2015-03-13 10:06:25,144 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741915_1091, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:25,144 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741915_1091{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:06:25,145 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61360, dest: /127.0.0.1:60689, bytes: 1778, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741915_1091, duration: 2019000
2015-03-13 10:06:25,145 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741915_1091, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:25,145 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741915_1091{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:06:25,146 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61359, dest: /127.0.0.1:60693, bytes: 1778, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741915_1091, duration: 3062000
2015-03-13 10:06:25,146 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741915_1091, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:25,146 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741915_1091{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:06:25,146 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61358, dest: /127.0.0.1:60686, bytes: 1778, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741915_1091, duration: 3698000
2015-03-13 10:06:25,147 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741915_1091, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:25,148 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741915_1091{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:06:25,148 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:06:25,150 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:06:25,152 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:06:25,153 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073741916_1092{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:06:25,154 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741916_1092 src: /127.0.0.1:61362 dest: /127.0.0.1:60696
2015-03-13 10:06:25,156 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741916_1092 src: /127.0.0.1:61363 dest: /127.0.0.1:60686
2015-03-13 10:06:25,157 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741916_1092 src: /127.0.0.1:61364 dest: /127.0.0.1:60693
2015-03-13 10:06:25,160 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61364, dest: /127.0.0.1:60693, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741916_1092, duration: 1252000
2015-03-13 10:06:25,160 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741916_1092, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:25,161 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741916_1092{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:25,161 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61363, dest: /127.0.0.1:60686, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741916_1092, duration: 1903000
2015-03-13 10:06:25,161 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741916_1092, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:25,161 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741916_1092{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:25,162 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61362, dest: /127.0.0.1:60696, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741916_1092, duration: 2720000
2015-03-13 10:06:25,162 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741916_1092, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:25,163 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741916_1092{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:25,164 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:06:25,164 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:06:25,166 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:06:25,167 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:06:25,168 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:06:25,169 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:06:25,169 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.groupfn.class is deprecated. Instead, use mapreduce.job.output.group.comparator.class
2015-03-13 10:06:25,169 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:06:25,172 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073741917_1093{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:06:25,173 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741917_1093 src: /127.0.0.1:61365 dest: /127.0.0.1:60689
2015-03-13 10:06:25,175 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741917_1093 src: /127.0.0.1:61366 dest: /127.0.0.1:60693
2015-03-13 10:06:25,176 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741917_1093 src: /127.0.0.1:61367 dest: /127.0.0.1:60686
2015-03-13 10:06:25,178 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61367, dest: /127.0.0.1:60686, bytes: 100918, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741917_1093, duration: 1494000
2015-03-13 10:06:25,179 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741917_1093, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:25,179 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741917_1093{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:06:25,179 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61366, dest: /127.0.0.1:60693, bytes: 100918, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741917_1093, duration: 2070000
2015-03-13 10:06:25,179 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741917_1093, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:25,180 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741917_1093{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:06:25,180 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61365, dest: /127.0.0.1:60689, bytes: 100918, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741917_1093, duration: 2826000
2015-03-13 10:06:25,180 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741917_1093, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:25,180 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741917_1093{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:06:25,182 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:06:25,182 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0008
2015-03-13 10:06:25,183 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008	dst=null	perm=null
2015-03-13 10:06:25,184 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.xml	dst=null	perm=null
2015-03-13 10:06:25,184 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.xml	dst=null	perm=null
2015-03-13 10:06:25,185 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.jar	dst=null	perm=null
2015-03-13 10:06:25,185 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.jar	dst=null	perm=null
2015-03-13 10:06:25,186 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.split	dst=null	perm=null
2015-03-13 10:06:25,186 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.split	dst=null	perm=null
2015-03-13 10:06:25,187 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:06:25,187 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:06:25,188 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:06:25,189 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:06:25,189 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:06:25,190 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:06:25,191 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:06:25,191 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:06:25,193 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 8 submitted by user soberoi
2015-03-13 10:06:25,193 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0008
2015-03-13 10:06:25,193 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	IP=10.1.1.144	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1426266260362_0008
2015-03-13 10:06:25,193 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0008
2015-03-13 10:06:25,193 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0008 State change from NEW to NEW_SAVING
2015-03-13 10:06:25,193 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0008 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:06:25,194 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0008_000001
2015-03-13 10:06:25,194 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0008_000001 State change from NEW to SUBMITTED
2015-03-13 10:06:25,194 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0008 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:06:25,194 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0008 from user: soberoi activated in queue: default
2015-03-13 10:06:25,194 INFO  capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0008 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:06:25,194 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0008 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:06:25,194 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0008_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:06:25,194 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0008_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:06:25,195 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0008 State change from SUBMITTED to ACCEPTED
2015-03-13 10:06:25,196 INFO  mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0008/
2015-03-13 10:06:25,197 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [cogrouping] submitted hadoop job: job_1426266260362_0008
2015-03-13 10:06:25,197 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [cogrouping] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0008/
2015-03-13 10:06:25,559 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741911_1087
2015-03-13 10:06:25,560 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741917_1093
2015-03-13 10:06:25,561 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741912_1088
2015-03-13 10:06:25,561 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741908_1084
2015-03-13 10:06:25,561 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741916_1092
2015-03-13 10:06:25,562 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741907_1083
2015-03-13 10:06:25,562 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741910_1086
2015-03-13 10:06:25,562 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741913_1089
2015-03-13 10:06:25,562 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741909_1085
2015-03-13 10:06:25,586 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741916_1092
2015-03-13 10:06:25,587 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741911_1087
2015-03-13 10:06:25,588 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741908_1084
2015-03-13 10:06:25,588 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741907_1083
2015-03-13 10:06:25,589 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741909_1085
2015-03-13 10:06:25,589 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741915_1091
2015-03-13 10:06:25,589 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741917_1093
2015-03-13 10:06:25,761 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741911_1087
2015-03-13 10:06:25,761 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741912_1088
2015-03-13 10:06:25,761 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741915_1091
2015-03-13 10:06:25,771 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:25,772 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0008_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:06:25,772 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0008	CONTAINERID=container_1426266260362_0008_01_000001
2015-03-13 10:06:25,772 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0008_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:06:25,772 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0008 container=Container: [ContainerId: container_1426266260362_0008_01_000001, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0008_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:25,773 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:06:25,773 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0008_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:06:25,773 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:25,774 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0008 AttemptId: appattempt_1426266260362_0008_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0008_01_000001, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ]
2015-03-13 10:06:25,774 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0008_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:06:25,774 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0008_000001
2015-03-13 10:06:25,775 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0008_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:06:25,775 INFO  amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0008_000001
2015-03-13 10:06:25,775 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0008_01_000001, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] for AM appattempt_1426266260362_0008_000001
2015-03-13 10:06:25,776 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0008_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-03-13 10:06:25,778 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0008_000001 (auth:SIMPLE)
2015-03-13 10:06:25,780 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0008_01_000001 by user soberoi
2015-03-13 10:06:25,780 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0008
2015-03-13 10:06:25,780 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0008	CONTAINERID=container_1426266260362_0008_01_000001
2015-03-13 10:06:25,780 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0008 transitioned from NEW to INITING
2015-03-13 10:06:25,780 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0008_01_000001 to application application_1426266260362_0008
2015-03-13 10:06:25,780 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0008 transitioned from INITING to RUNNING
2015-03-13 10:06:25,781 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0008_01_000001, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] for AM appattempt_1426266260362_0008_000001
2015-03-13 10:06:25,781 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:06:25,781 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0008
2015-03-13 10:06:25,781 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0008_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:06:25,781 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:06:25,781 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:06:25,781 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:06:25,781 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:06:25,782 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0008_01_000001
2015-03-13 10:06:25,790 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426266260362_0008_01_000001.tokens. Credentials list: 
2015-03-13 10:06:25,805 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:06:25,876 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426266260362_0008_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000001.tokens
2015-03-13 10:06:25,876 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0008 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0008
2015-03-13 10:06:25,933 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.jar	dst=null	perm=null
2015-03-13 10:06:25,934 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.jar	dst=null	perm=null
2015-03-13 10:06:25,935 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.jar	dst=null	perm=null
2015-03-13 10:06:25,940 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61348, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_711767688_4481, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741914_1090, duration: 551000
2015-03-13 10:06:25,959 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741914_1090
2015-03-13 10:06:25,960 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:06:25,960 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741915_1091
2015-03-13 10:06:25,962 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741914_1090
2015-03-13 10:06:25,963 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741909_1085
2015-03-13 10:06:25,963 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741910_1086
2015-03-13 10:06:25,963 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741916_1092
2015-03-13 10:06:25,964 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741913_1089
2015-03-13 10:06:25,977 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:06:25,977 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:06:25,978 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:06:25,982 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741907_1083
2015-03-13 10:06:25,983 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741917_1093
2015-03-13 10:06:25,983 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741912_1088
2015-03-13 10:06:25,984 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741915_1091
2015-03-13 10:06:25,984 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741908_1084
2015-03-13 10:06:25,984 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741913_1089
2015-03-13 10:06:25,985 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741910_1086
2015-03-13 10:06:25,986 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61371, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_711767688_4481, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741916_1092, duration: 154000
2015-03-13 10:06:25,998 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:06:26,015 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.split	dst=null	perm=null
2015-03-13 10:06:26,016 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.split	dst=null	perm=null
2015-03-13 10:06:26,017 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.split	dst=null	perm=null
2015-03-13 10:06:26,022 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61348, bytes: 1794, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_711767688_4481, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741915_1091, duration: 192000
2015-03-13 10:06:26,034 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:06:26,051 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.xml	dst=null	perm=null
2015-03-13 10:06:26,051 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.xml	dst=null	perm=null
2015-03-13 10:06:26,052 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.xml	dst=null	perm=null
2015-03-13 10:06:26,058 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61348, bytes: 101710, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_711767688_4481, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741917_1093, duration: 312000
2015-03-13 10:06:26,071 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:06:26,071 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:06:26,096 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:06:26,096 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:26,168 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000001/default_container_executor.sh]
2015-03-13 10:06:26,187 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741914_1090
2015-03-13 10:06:26,774 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:26,774 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:26,775 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0008_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:06:27,736 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60686 to replicate blk_1073741914_1090 to datanode(s) 127.0.0.1:60693
2015-03-13 10:06:27,737 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073741904_1080, blk_1073741905_1081, blk_1073741908_1084, blk_1073741893_1069, blk_1073741902_1078, blk_1073741903_1079]
2015-03-13 10:06:27,737 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073741906_1082, blk_1073741893_1069, blk_1073741898_1074, blk_1073741902_1078, blk_1073741903_1079]
2015-03-13 10:06:27,739 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:06:27,761 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/COMMIT_STARTED	dst=null	perm=null
2015-03-13 10:06:27,762 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/COMMIT_SUCCESS	dst=null	perm=null
2015-03-13 10:06:27,762 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/COMMIT_FAIL	dst=null	perm=null
2015-03-13 10:06:27,779 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:27,779 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:27,814 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008	dst=null	perm=null
2015-03-13 10:06:27,816 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:06:27,817 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:06:28,087 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:06:28,093 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:06:28,148 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61373, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-789528504_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741916_1092, duration: 133000
2015-03-13 10:06:28,389 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741904_1080 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741904 for deletion
2015-03-13 10:06:28,389 INFO  datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-1907321454-10.1.1.144-60686-1426266259166, infoPort=60687, ipcPort=60688, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073741914_1090 to 127.0.0.1:60693 
2015-03-13 10:06:28,390 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741904_1080 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741904
2015-03-13 10:06:28,390 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741905_1081 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741905 for deletion
2015-03-13 10:06:28,390 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741908_1084 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741908 for deletion
2015-03-13 10:06:28,390 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741893_1069 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741893 for deletion
2015-03-13 10:06:28,390 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741902_1078 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741902 for deletion
2015-03-13 10:06:28,391 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741903_1079 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741903 for deletion
2015-03-13 10:06:28,390 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741905_1081 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741905
2015-03-13 10:06:28,391 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741902_1078 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741902
2015-03-13 10:06:28,391 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741908_1084 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741908
2015-03-13 10:06:28,391 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741914_1090 src: /127.0.0.1:61376 dest: /127.0.0.1:60693
2015-03-13 10:06:28,392 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741893_1069 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741893
2015-03-13 10:06:28,392 INFO  datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073741914_1090 (numBytes=254067) to /127.0.0.1:60693
2015-03-13 10:06:28,392 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741903_1079 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741903
2015-03-13 10:06:28,393 INFO  datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073741914_1090 src: /127.0.0.1:61376 dest: /127.0.0.1:60693 of size 254067
2015-03-13 10:06:28,394 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741914_1090 size 254067
2015-03-13 10:06:28,747 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741906_1082 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741906 for deletion
2015-03-13 10:06:28,747 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741893_1069 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741893 for deletion
2015-03-13 10:06:28,747 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741898_1074 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741898 for deletion
2015-03-13 10:06:28,747 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741902_1078 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741902 for deletion
2015-03-13 10:06:28,748 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741903_1079 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741903 for deletion
2015-03-13 10:06:28,748 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741906_1082 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741906
2015-03-13 10:06:28,748 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741893_1069 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741893
2015-03-13 10:06:28,748 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741898_1074 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741898
2015-03-13 10:06:28,748 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741903_1079 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741903
2015-03-13 10:06:28,748 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741902_1078 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741902
2015-03-13 10:06:28,781 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:28,781 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:28,949 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0008_000001 (auth:SIMPLE)
2015-03-13 10:06:28,950 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0008_000001
2015-03-13 10:06:28,950 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi	IP=10.1.1.144	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1426266260362_0008	APPATTEMPTID=appattempt_1426266260362_0008_000001
2015-03-13 10:06:28,951 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0008_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:06:28,951 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0008 State change from ACCEPTED to RUNNING
2015-03-13 10:06:28,971 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job_1426266260362_0008_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:28,974 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:06:29,037 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job_1426266260362_0008_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:29,158 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job_1426266260362_0008_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073741918_1094{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:06:29,197 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741918_1094 src: /127.0.0.1:61380 dest: /127.0.0.1:60686
2015-03-13 10:06:29,199 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741918_1094 src: /127.0.0.1:61381 dest: /127.0.0.1:60693
2015-03-13 10:06:29,200 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741918_1094 src: /127.0.0.1:61382 dest: /127.0.0.1:60696
2015-03-13 10:06:29,209 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61382, dest: /127.0.0.1:60696, bytes: 93243, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-789528504_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741918_1094, duration: 6690000
2015-03-13 10:06:29,210 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741918_1094, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:29,211 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61381, dest: /127.0.0.1:60693, bytes: 93243, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-789528504_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741918_1094, duration: 6507000
2015-03-13 10:06:29,211 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741918_1094, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:29,211 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741918_1094{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:06:29,212 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741918_1094{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:06:29,212 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61380, dest: /127.0.0.1:60686, bytes: 93243, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-789528504_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741918_1094, duration: 8118000
2015-03-13 10:06:29,213 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741918_1094, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:29,213 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741918_1094{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:06:29,217 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job_1426266260362_0008_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-789528504_1
2015-03-13 10:06:29,786 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:29,786 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:30,064 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0007_01_000001 succeeded 
2015-03-13 10:06:30,064 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0007_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:06:30,065 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0007_01_000001
2015-03-13 10:06:30,073 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0007/container_1426266260362_0007_01_000001
2015-03-13 10:06:30,073 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0007/container_1426266260362_0007_01_000001
2015-03-13 10:06:30,073 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0007/container_1426266260362_0007_01_000001
2015-03-13 10:06:30,073 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0007	CONTAINERID=container_1426266260362_0007_01_000001
2015-03-13 10:06:30,073 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0007_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:06:30,073 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0007/container_1426266260362_0007_01_000001
2015-03-13 10:06:30,074 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0007_01_000001 from application application_1426266260362_0007
2015-03-13 10:06:30,074 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:30,074 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0007
2015-03-13 10:06:30,596 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741918_1094
2015-03-13 10:06:30,738 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073741904_1080, blk_1073741905_1081, blk_1073741906_1082, blk_1073741908_1084, blk_1073741898_1074, blk_1073741902_1078, blk_1073741903_1079]
2015-03-13 10:06:30,738 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073741904_1080, blk_1073741905_1081, blk_1073741906_1082, blk_1073741908_1084, blk_1073741893_1069, blk_1073741898_1074, blk_1073741902_1078, blk_1073741903_1079]
2015-03-13 10:06:30,791 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:06:30,791 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:30,792 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0007_01_000001
2015-03-13 10:06:30,793 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0008_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:06:30,793 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0008	CONTAINERID=container_1426266260362_0008_01_000002
2015-03-13 10:06:30,793 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0008_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:06:30,793 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0008 container=Container: [ContainerId: container_1426266260362_0008_01_000002, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0008_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:30,794 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:06:30,794 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:30,794 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0008_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:06:30,794 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0008	CONTAINERID=container_1426266260362_0008_01_000003
2015-03-13 10:06:30,795 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0008_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available
2015-03-13 10:06:30,795 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0008 container=Container: [ContainerId: container_1426266260362_0008_01_000003, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0008_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:30,795 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:06:30,795 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:30,796 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0007_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:06:30,796 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0007_000001
2015-03-13 10:06:30,796 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0007_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:06:30,796 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0007_000001 State change from FINISHING to FINISHED
2015-03-13 10:06:30,796 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0007	CONTAINERID=container_1426266260362_0007_01_000001
2015-03-13 10:06:30,796 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0007 State change from FINISHING to FINISHED
2015-03-13 10:06:30,796 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0007_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60711, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:06:30,796 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1426266260362_0007
2015-03-13 10:06:30,796 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:06:30,797 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0007,name=[FC83D3BF82BA4B999048416E4B0AF853/28CD4D9B5CB64D6CB627C92EC12090D1] lower*upper/(3/3) ...dpipesplatform/afterevery,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0007/jobhistory/job/job_1426266260362_0007,appMasterHost=Edinburgh.local,startTime=1426266375072,finishTime=1426266383922,finalStatus=SUCCEEDED
2015-03-13 10:06:30,796 INFO  amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0007_000001
2015-03-13 10:06:30,797 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0007_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:30,797 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:30,797 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=3
2015-03-13 10:06:30,797 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0007_000001 released container container_1426266260362_0007_01_000001 on node: host: 10.1.1.144:60711 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:06:30,797 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741914_1090
2015-03-13 10:06:30,798 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0008_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:06:30,798 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0008	CONTAINERID=container_1426266260362_0008_01_000004
2015-03-13 10:06:30,798 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0008_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:06:30,798 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0008 container=Container: [ContainerId: container_1426266260362_0008_01_000004, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0008_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:30,798 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=4
2015-03-13 10:06:30,798 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:30,799 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0008_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:06:30,799 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0008	CONTAINERID=container_1426266260362_0008_01_000005
2015-03-13 10:06:30,799 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0008_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:06:30,799 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0008 container=Container: [ContainerId: container_1426266260362_0008_01_000005, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0008_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:30,799 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=5
2015-03-13 10:06:30,800 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:30,800 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0007_000001 (auth:SIMPLE)
2015-03-13 10:06:30,800 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0008_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:06:30,800 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0008	CONTAINERID=container_1426266260362_0008_01_000006
2015-03-13 10:06:30,800 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0008_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:06:30,801 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0008 container=Container: [ContainerId: container_1426266260362_0008_01_000006, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0008_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:30,801 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6
2015-03-13 10:06:30,801 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:30,801 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0007_01_000001
2015-03-13 10:06:30,801 INFO  capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0007_000001 is done. finalState=FINISHED
2015-03-13 10:06:30,801 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0007 requests cleared
2015-03-13 10:06:30,801 INFO  capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0007 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:06:30,802 INFO  capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0007 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:06:30,966 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741918_1094
2015-03-13 10:06:30,970 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741918_1094
2015-03-13 10:06:30,984 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0008_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:06:30,985 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0008_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:06:30,985 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0008_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:06:30,985 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0008_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:06:30,985 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0008_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:06:31,014 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.jar	dst=null	perm=null
2015-03-13 10:06:31,015 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.jar	dst=null	perm=null
2015-03-13 10:06:31,023 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.xml	dst=null	perm=null
2015-03-13 10:06:31,024 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.xml	dst=null	perm=null
2015-03-13 10:06:31,026 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:06:31,028 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:06:31,048 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:06:31,050 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:06:31,052 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:06:31,053 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:06:31,108 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0008_000001 (auth:SIMPLE)
2015-03-13 10:06:31,108 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0008_000001 (auth:SIMPLE)
2015-03-13 10:06:31,112 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0008_01_000006 by user soberoi
2015-03-13 10:06:31,112 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0008_01_000002 by user soberoi
2015-03-13 10:06:31,112 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0008
2015-03-13 10:06:31,112 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0008	CONTAINERID=container_1426266260362_0008_01_000002
2015-03-13 10:06:31,112 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0008_01_000004 by user soberoi
2015-03-13 10:06:31,112 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0008	CONTAINERID=container_1426266260362_0008_01_000004
2015-03-13 10:06:31,113 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0008_01_000003 by user soberoi
2015-03-13 10:06:31,113 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0008 transitioned from NEW to INITING
2015-03-13 10:06:31,112 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0008_01_000005 by user soberoi
2015-03-13 10:06:31,113 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0008	CONTAINERID=container_1426266260362_0008_01_000005
2015-03-13 10:06:31,112 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0008	CONTAINERID=container_1426266260362_0008_01_000006
2015-03-13 10:06:31,113 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0008_01_000006 to application application_1426266260362_0008
2015-03-13 10:06:31,114 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0008_01_000004 to application application_1426266260362_0008
2015-03-13 10:06:31,114 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0008_01_000005 to application application_1426266260362_0008
2015-03-13 10:06:31,114 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0008 transitioned from INITING to RUNNING
2015-03-13 10:06:31,113 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0008	CONTAINERID=container_1426266260362_0008_01_000003
2015-03-13 10:06:31,113 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0008_01_000002 to application application_1426266260362_0008
2015-03-13 10:06:31,114 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0008_01_000003 to application application_1426266260362_0008
2015-03-13 10:06:31,115 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:06:31,114 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:06:31,115 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:06:31,115 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0008
2015-03-13 10:06:31,115 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:06:31,115 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:06:31,115 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0008
2015-03-13 10:06:31,115 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0008
2015-03-13 10:06:31,116 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:06:31,116 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0008
2015-03-13 10:06:31,116 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:06:31,116 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:06:31,115 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0008
2015-03-13 10:06:31,116 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:06:31,116 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0008
2015-03-13 10:06:31,116 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0008
2015-03-13 10:06:31,116 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0008
2015-03-13 10:06:31,116 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:06:31,117 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0008
2015-03-13 10:06:31,117 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0008
2015-03-13 10:06:31,117 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0008
2015-03-13 10:06:31,117 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:06:31,116 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0008
2015-03-13 10:06:31,117 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0008
2015-03-13 10:06:31,117 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:06:31,117 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0008
2015-03-13 10:06:31,118 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:06:31,117 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0008
2015-03-13 10:06:31,118 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:06:31,118 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0008_01_000006
2015-03-13 10:06:31,121 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0008_01_000005
2015-03-13 10:06:31,124 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0008_01_000004
2015-03-13 10:06:31,146 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0008_01_000004.tokens. Credentials list: 
2015-03-13 10:06:31,146 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1426266260362_0008_01_000006.tokens. Credentials list: 
2015-03-13 10:06:31,147 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1426266260362_0008_01_000005.tokens. Credentials list: 
2015-03-13 10:06:31,158 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:06:31,158 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:31,164 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:06:31,164 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:31,169 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:06:31,248 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000003/default_container_executor.sh]
2015-03-13 10:06:31,254 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000002/default_container_executor.sh]
2015-03-13 10:06:31,268 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0008_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000004.tokens
2015-03-13 10:06:31,268 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0008 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0008
2015-03-13 10:06:31,373 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.jar	dst=null	perm=null
2015-03-13 10:06:31,374 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.jar	dst=null	perm=null
2015-03-13 10:06:31,375 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.jar	dst=null	perm=null
2015-03-13 10:06:31,384 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61388, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_481678973_4634, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741914_1090, duration: 472000
2015-03-13 10:06:31,394 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741904_1080 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741904 for deletion
2015-03-13 10:06:31,394 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741905_1081 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741905 for deletion
2015-03-13 10:06:31,394 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741906_1082 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741906 for deletion
2015-03-13 10:06:31,394 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741908_1084 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741908 for deletion
2015-03-13 10:06:31,394 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741904_1080 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741904
2015-03-13 10:06:31,394 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741906_1082 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741906
2015-03-13 10:06:31,395 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741905_1081 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741905
2015-03-13 10:06:31,395 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741908_1084 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741908
2015-03-13 10:06:31,394 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741898_1074 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741898 for deletion
2015-03-13 10:06:31,395 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741902_1078 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741902 for deletion
2015-03-13 10:06:31,395 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741903_1079 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741903 for deletion
2015-03-13 10:06:31,395 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741898_1074 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741898
2015-03-13 10:06:31,396 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741903_1079 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741903
2015-03-13 10:06:31,396 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741902_1078 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741902
2015-03-13 10:06:31,414 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:06:31,438 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.xml	dst=null	perm=null
2015-03-13 10:06:31,439 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.xml	dst=null	perm=null
2015-03-13 10:06:31,440 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.xml	dst=null	perm=null
2015-03-13 10:06:31,448 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61388, bytes: 101710, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_481678973_4634, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741917_1093, duration: 229000
2015-03-13 10:06:31,469 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:06:31,470 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:06:31,470 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:06:31,470 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:06:31,517 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:06:31,517 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:31,518 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:06:31,518 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:31,519 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:06:31,519 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:31,556 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741904_1080 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741904 for deletion
2015-03-13 10:06:31,556 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741905_1081 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741905 for deletion
2015-03-13 10:06:31,556 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741906_1082 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741906 for deletion
2015-03-13 10:06:31,556 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741908_1084 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741908 for deletion
2015-03-13 10:06:31,557 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741893_1069 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741893 for deletion
2015-03-13 10:06:31,556 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741904_1080 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741904
2015-03-13 10:06:31,557 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741905_1081 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741905
2015-03-13 10:06:31,557 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741898_1074 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741898 for deletion
2015-03-13 10:06:31,557 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741893_1069 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741893
2015-03-13 10:06:31,557 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741906_1082 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741906
2015-03-13 10:06:31,558 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741908_1084 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741908
2015-03-13 10:06:31,558 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741898_1074 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741898
2015-03-13 10:06:31,557 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741902_1078 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741902 for deletion
2015-03-13 10:06:31,558 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741903_1079 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741903 for deletion
2015-03-13 10:06:31,559 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741902_1078 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741902
2015-03-13 10:06:31,559 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741903_1079 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741903
2015-03-13 10:06:31,647 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000004/default_container_executor.sh]
2015-03-13 10:06:31,655 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000005/default_container_executor.sh]
2015-03-13 10:06:31,656 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000006/default_container_executor.sh]
2015-03-13 10:06:31,796 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:31,796 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:31,797 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:31,797 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:31,797 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:31,797 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:31,797 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0007 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:06:31,798 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0008_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:06:31,798 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0008_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:06:31,798 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0008_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:06:31,797 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0007 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:06:31,798 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0008_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:06:31,798 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0007
2015-03-13 10:06:31,798 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0007
2015-03-13 10:06:31,798 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0007
2015-03-13 10:06:31,798 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0007
2015-03-13 10:06:31,798 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0007
2015-03-13 10:06:31,799 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0007 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:06:31,799 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0007 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:06:31,799 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0007, with delay of 10800 seconds
2015-03-13 10:06:31,799 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0007
2015-03-13 10:06:31,800 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0007
2015-03-13 10:06:31,799 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0007, with delay of 10800 seconds
2015-03-13 10:06:31,800 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0007
2015-03-13 10:06:31,800 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0007
2015-03-13 10:06:31,798 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0008_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:06:31,800 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0007
2015-03-13 10:06:32,000 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:06:32,500 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:06:32,619 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1426266260362_0008_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000005.tokens
2015-03-13 10:06:32,619 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0008 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0008
2015-03-13 10:06:32,721 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:06:32,798 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:32,798 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:32,798 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:32,798 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:32,798 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:32,798 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:32,855 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1426266260362_0008_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000006.tokens
2015-03-13 10:06:32,856 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0008 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0008
2015-03-13 10:06:33,800 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:33,800 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:33,800 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:33,800 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:33,800 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:33,801 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:34,803 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:34,803 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:34,803 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:34,803 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:34,803 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:34,804 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:35,806 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:35,806 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:35,806 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:35,807 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:35,807 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:35,807 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:36,807 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:36,807 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:36,808 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:36,808 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:36,808 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:36,808 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:37,809 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:37,809 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:37,809 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:37,809 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:37,809 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:37,809 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:38,812 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:38,812 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:38,812 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:38,812 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:38,813 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:38,813 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:38,968 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.split	dst=null	perm=null
2015-03-13 10:06:39,006 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.split	dst=null	perm=null
2015-03-13 10:06:39,185 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61398, bytes: 1794, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0008_m_000000_0_675622110_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741915_1091, duration: 152000
2015-03-13 10:06:39,239 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61399, bytes: 1794, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0008_m_000001_0_266420541_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741915_1091, duration: 165000
2015-03-13 10:06:39,257 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.split	dst=null	perm=null
2015-03-13 10:06:39,375 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.split	dst=null	perm=null
2015-03-13 10:06:39,398 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt	dst=null	perm=null
2015-03-13 10:06:39,402 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61403, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0008_m_000000_0_675622110_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741913_1089, duration: 196000
2015-03-13 10:06:39,423 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt	dst=null	perm=null
2015-03-13 10:06:39,435 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61402, bytes: 762, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0008_m_000004_0_288813979_1, offset: 1024, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741915_1091, duration: 164000
2015-03-13 10:06:39,438 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.split	dst=null	perm=null
2015-03-13 10:06:39,534 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61405, bytes: 762, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0008_m_000003_0_-1274735834_1, offset: 1024, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741915_1091, duration: 182000
2015-03-13 10:06:39,573 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:06:39,574 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61406, bytes: 1278, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0008_m_000002_0_-1826248674_1, offset: 512, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741915_1091, duration: 154000
2015-03-13 10:06:39,577 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61407, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0008_m_000004_0_288813979_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 187000
2015-03-13 10:06:39,671 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:06:39,674 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61405, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0008_m_000003_0_-1274735834_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 153000
2015-03-13 10:06:39,709 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:06:39,813 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:39,813 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:39,813 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:39,814 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:39,814 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:39,814 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:39,870 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61408, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0008_m_000001_0_266420541_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741913_1089, duration: 164000
2015-03-13 10:06:39,891 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_temporary/1/_temporary/attempt_1426266260362_0008_m_000000_0	dst=null	perm=null
2015-03-13 10:06:39,918 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0008_01_000002
2015-03-13 10:06:39,918 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0008	CONTAINERID=container_1426266260362_0008_01_000002
2015-03-13 10:06:39,918 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:06:39,918 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0008_01_000002
2015-03-13 10:06:39,919 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:39,919 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:06:39,919 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:39,931 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0008_01_000002 is : 143
2015-03-13 10:06:39,933 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job_1426266260362_0008_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073741919_1095{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:06:39,934 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741919_1095 src: /127.0.0.1:61409 dest: /127.0.0.1:60696
2015-03-13 10:06:39,936 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741919_1095 src: /127.0.0.1:61410 dest: /127.0.0.1:60689
2015-03-13 10:06:39,937 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741919_1095 src: /127.0.0.1:61411 dest: /127.0.0.1:60693
2015-03-13 10:06:39,941 INFO  hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job_1426266260362_0008_1.jhist for DFSClient_NONMAPREDUCE_-789528504_1
2015-03-13 10:06:39,944 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:06:39,944 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000002
2015-03-13 10:06:39,944 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0008	CONTAINERID=container_1426266260362_0008_01_000002
2015-03-13 10:06:39,944 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:06:39,945 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000002
2015-03-13 10:06:39,945 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000002
2015-03-13 10:06:39,945 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000002
2015-03-13 10:06:39,945 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0008_01_000002 from application application_1426266260362_0008
2015-03-13 10:06:39,946 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:39,946 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0008
2015-03-13 10:06:39,970 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_temporary/1/_temporary/attempt_1426266260362_0008_m_000001_0	dst=null	perm=null
2015-03-13 10:06:39,984 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0008_01_000003
2015-03-13 10:06:39,985 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0008	CONTAINERID=container_1426266260362_0008_01_000003
2015-03-13 10:06:39,985 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:06:39,985 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0008_01_000003
2015-03-13 10:06:39,985 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:39,985 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:06:39,985 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0008_01_000002
2015-03-13 10:06:39,986 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:06:39,986 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0008_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:06:39,986 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0008_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:06:39,986 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0008	CONTAINERID=container_1426266260362_0008_01_000002
2015-03-13 10:06:39,986 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0008_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available, release resources=true
2015-03-13 10:06:39,987 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:06:39,987 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0008_01_000002, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:39,987 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:39,987 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:06:39,987 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0008_000001 released container container_1426266260362_0008_01_000002 on node: host: 10.1.1.144:60719 #containers=2 available=1024 used=3072 with event: FINISHED
2015-03-13 10:06:39,998 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0008_01_000003 is : 143
2015-03-13 10:06:40,008 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:06:40,009 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000003
2015-03-13 10:06:40,009 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000003
2015-03-13 10:06:40,009 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000003
2015-03-13 10:06:40,010 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000003
2015-03-13 10:06:40,010 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0008	CONTAINERID=container_1426266260362_0008_01_000003
2015-03-13 10:06:40,010 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:06:40,010 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0008_01_000003 from application application_1426266260362_0008
2015-03-13 10:06:40,011 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:40,011 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0008
2015-03-13 10:06:40,136 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:06:40,150 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:06:40,152 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:06:40,157 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61412, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0008_m_000004_0_288813979_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 166000
2015-03-13 10:06:40,164 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt	dst=null	perm=null
2015-03-13 10:06:40,166 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt	dst=null	perm=null
2015-03-13 10:06:40,168 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt	dst=null	perm=null
2015-03-13 10:06:40,172 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61413, bytes: 56, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0008_m_000004_0_288813979_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741912_1088, duration: 166000
2015-03-13 10:06:40,199 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_temporary/1/_temporary/attempt_1426266260362_0008_m_000004_0	dst=null	perm=null
2015-03-13 10:06:40,207 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0008_01_000006
2015-03-13 10:06:40,207 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0008	CONTAINERID=container_1426266260362_0008_01_000006
2015-03-13 10:06:40,207 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:06:40,207 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0008_01_000006
2015-03-13 10:06:40,208 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:40,208 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:40,208 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:06:40,222 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0008_01_000006 is : 143
2015-03-13 10:06:40,235 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:06:40,235 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000006
2015-03-13 10:06:40,236 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000006
2015-03-13 10:06:40,236 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000006
2015-03-13 10:06:40,236 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000006
2015-03-13 10:06:40,237 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0008	CONTAINERID=container_1426266260362_0008_01_000006
2015-03-13 10:06:40,237 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:06:40,237 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0008_01_000006 from application application_1426266260362_0008
2015-03-13 10:06:40,238 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:40,238 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0008
2015-03-13 10:06:40,240 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:06:40,253 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:06:40,258 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:06:40,261 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:06:40,262 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61414, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0008_m_000003_0_-1274735834_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 152000
2015-03-13 10:06:40,268 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt	dst=null	perm=null
2015-03-13 10:06:40,269 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt	dst=null	perm=null
2015-03-13 10:06:40,271 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt	dst=null	perm=null
2015-03-13 10:06:40,274 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61415, bytes: 56, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0008_m_000003_0_-1274735834_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741912_1088, duration: 158000
2015-03-13 10:06:40,274 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:06:40,277 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:06:40,280 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61416, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0008_m_000002_0_-1826248674_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 149000
2015-03-13 10:06:40,285 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt	dst=null	perm=null
2015-03-13 10:06:40,286 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt	dst=null	perm=null
2015-03-13 10:06:40,288 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt	dst=null	perm=null
2015-03-13 10:06:40,291 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61417, bytes: 56, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0008_m_000002_0_-1826248674_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741912_1088, duration: 165000
2015-03-13 10:06:40,294 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61416, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0008_m_000002_0_-1826248674_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 128000
2015-03-13 10:06:40,300 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_temporary/1/_temporary/attempt_1426266260362_0008_m_000003_0	dst=null	perm=null
2015-03-13 10:06:40,311 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0008_01_000005
2015-03-13 10:06:40,311 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0008	CONTAINERID=container_1426266260362_0008_01_000005
2015-03-13 10:06:40,311 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:40,312 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:06:40,312 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:06:40,313 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:06:40,313 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0008_01_000006
2015-03-13 10:06:40,313 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0008_01_000005
2015-03-13 10:06:40,313 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0008_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:06:40,313 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0008_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:06:40,314 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0008	CONTAINERID=container_1426266260362_0008_01_000006
2015-03-13 10:06:40,314 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0008_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:06:40,314 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:06:40,314 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0008_01_000006, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:40,314 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:40,314 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:06:40,314 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0008_000001 released container container_1426266260362_0008_01_000006 on node: host: 10.1.1.144:60711 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:06:40,325 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0008_01_000005 is : 143
2015-03-13 10:06:40,331 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_temporary/1/_temporary/attempt_1426266260362_0008_m_000002_0	dst=null	perm=null
2015-03-13 10:06:40,334 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:06:40,334 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000005
2015-03-13 10:06:40,335 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000005
2015-03-13 10:06:40,335 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000005
2015-03-13 10:06:40,335 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000005
2015-03-13 10:06:40,336 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0008	CONTAINERID=container_1426266260362_0008_01_000005
2015-03-13 10:06:40,336 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:06:40,336 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0008_01_000005 from application application_1426266260362_0008
2015-03-13 10:06:40,336 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:40,337 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0008
2015-03-13 10:06:40,343 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0008_01_000004
2015-03-13 10:06:40,343 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0008	CONTAINERID=container_1426266260362_0008_01_000004
2015-03-13 10:06:40,343 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:06:40,344 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0008_01_000004
2015-03-13 10:06:40,344 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:06:40,344 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:06:40,344 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0008_01_000005
2015-03-13 10:06:40,345 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0008_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:06:40,345 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0008_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:06:40,345 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0008	CONTAINERID=container_1426266260362_0008_01_000005
2015-03-13 10:06:40,345 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0008_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:06:40,345 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:06:40,345 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0008_01_000005, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:40,346 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:40,346 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:06:40,346 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0008_000001 released container container_1426266260362_0008_01_000005 on node: host: 10.1.1.144:60711 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:06:40,356 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0008_01_000004 is : 143
2015-03-13 10:06:40,368 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:06:40,369 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000004
2015-03-13 10:06:40,369 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000004
2015-03-13 10:06:40,369 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000004
2015-03-13 10:06:40,369 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000004
2015-03-13 10:06:40,369 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0008	CONTAINERID=container_1426266260362_0008_01_000004
2015-03-13 10:06:40,370 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:06:40,370 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0008_01_000004 from application application_1426266260362_0008
2015-03-13 10:06:40,370 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:40,370 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0008
2015-03-13 10:06:40,992 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:40,992 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:06:40,992 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0008_01_000003
2015-03-13 10:06:40,993 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0008_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:06:40,993 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0008_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:06:40,993 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0008	CONTAINERID=container_1426266260362_0008_01_000003
2015-03-13 10:06:40,993 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0008_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:06:40,994 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:06:40,994 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0008_01_000003, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:40,994 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:40,994 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:06:40,994 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0008_000001 released container container_1426266260362_0008_01_000003 on node: host: 10.1.1.144:60719 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:06:41,348 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:06:41,348 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0008_01_000004
2015-03-13 10:06:41,349 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0008_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:06:41,349 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0008_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:06:41,349 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0008	CONTAINERID=container_1426266260362_0008_01_000004
2015-03-13 10:06:41,349 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0008_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:06:41,350 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:06:41,350 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0008_01_000004, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:41,350 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:41,350 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:06:41,350 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0008_000001 released container container_1426266260362_0008_01_000004 on node: host: 10.1.1.144:60711 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:06:41,351 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0008_01_000007 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:06:41,351 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0008	CONTAINERID=container_1426266260362_0008_01_000007
2015-03-13 10:06:41,351 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0008_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:06:41,352 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0008 container=Container: [ContainerId: container_1426266260362_0008_01_000007, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0008_01_000007 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:41,352 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:06:41,352 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:41,996 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:42,047 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0008_01_000007 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:06:42,056 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0008_01_000007 by user soberoi
2015-03-13 10:06:42,056 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0008_01_000007 to application application_1426266260362_0008
2015-03-13 10:06:42,056 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0008	CONTAINERID=container_1426266260362_0008_01_000007
2015-03-13 10:06:42,056 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000007 transitioned from NEW to LOCALIZING
2015-03-13 10:06:42,056 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0008
2015-03-13 10:06:42,056 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0008
2015-03-13 10:06:42,056 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:06:42,057 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0008
2015-03-13 10:06:42,057 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000007 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:06:42,081 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000007 transitioned from LOCALIZED to RUNNING
2015-03-13 10:06:42,081 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:42,144 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000007/default_container_executor.sh]
2015-03-13 10:06:42,349 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:42,350 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0008_01_000007 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:06:43,000 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:43,057 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:06:43,351 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:44,003 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:44,353 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:44,450 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_temporary/1/_temporary/attempt_1426266260362_0008_r_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:44,502 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_temporary/1/_temporary/attempt_1426266260362_0008_r_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073741920_1096{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:06:44,559 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741920_1096 src: /127.0.0.1:61423 dest: /127.0.0.1:60696
2015-03-13 10:06:44,560 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741920_1096 src: /127.0.0.1:61424 dest: /127.0.0.1:60689
2015-03-13 10:06:44,561 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741920_1096 src: /127.0.0.1:61425 dest: /127.0.0.1:60693
2015-03-13 10:06:44,571 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61425, dest: /127.0.0.1:60693, bytes: 592, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0008_r_000000_0_1392375621_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741920_1096, duration: 8305000
2015-03-13 10:06:44,571 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741920_1096, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:44,571 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741920_1096{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:44,572 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61424, dest: /127.0.0.1:60689, bytes: 592, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0008_r_000000_0_1392375621_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741920_1096, duration: 8786000
2015-03-13 10:06:44,572 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741920_1096, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:44,572 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741920_1096{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:44,573 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61423, dest: /127.0.0.1:60696, bytes: 592, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0008_r_000000_0_1392375621_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741920_1096, duration: 9776000
2015-03-13 10:06:44,573 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741920_1096, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:44,573 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741920_1096{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:44,577 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_temporary/1/_temporary/attempt_1426266260362_0008_r_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0008_r_000000_0_1392375621_1
2015-03-13 10:06:44,584 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_temporary/1/_temporary/attempt_1426266260362_0008_r_000000_0	dst=null	perm=null
2015-03-13 10:06:44,590 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_temporary/1/_temporary/attempt_1426266260362_0008_r_000000_0	dst=null	perm=null
2015-03-13 10:06:44,591 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_temporary/1/task_1426266260362_0008_r_000000	dst=null	perm=null
2015-03-13 10:06:44,594 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_temporary/1/_temporary/attempt_1426266260362_0008_r_000000_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_temporary/1/task_1426266260362_0008_r_000000	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:06:44,602 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0008_01_000007
2015-03-13 10:06:44,602 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0008	CONTAINERID=container_1426266260362_0008_01_000007
2015-03-13 10:06:44,602 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000007 transitioned from RUNNING to KILLING
2015-03-13 10:06:44,602 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0008_01_000007
2015-03-13 10:06:44,603 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:06:44,608 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:44,610 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-789528504_1
2015-03-13 10:06:44,612 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0008_01_000007 is : 143
2015-03-13 10:06:44,613 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_temporary/1	dst=null	perm=null
2015-03-13 10:06:44,618 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin	dst=null	perm=null
2015-03-13 10:06:44,619 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin	dst=null	perm=null
2015-03-13 10:06:44,620 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_temporary/1/task_1426266260362_0008_r_000000	dst=null	perm=null
2015-03-13 10:06:44,621 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/part-00000	dst=null	perm=null
2015-03-13 10:06:44,621 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000007 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:06:44,621 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000007
2015-03-13 10:06:44,622 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0008	CONTAINERID=container_1426266260362_0008_01_000007
2015-03-13 10:06:44,622 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000007 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:06:44,622 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0008_01_000007 from application application_1426266260362_0008
2015-03-13 10:06:44,622 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:44,622 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0008
2015-03-13 10:06:44,622 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000007
2015-03-13 10:06:44,622 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000007
2015-03-13 10:06:44,622 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000007
2015-03-13 10:06:44,624 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_temporary/1/task_1426266260362_0008_r_000000/part-00000	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/part-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:44,628 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_temporary	dst=null	perm=null
2015-03-13 10:06:44,631 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:44,632 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-789528504_1
2015-03-13 10:06:44,634 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:44,635 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-789528504_1
2015-03-13 10:06:44,647 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61411, dest: /127.0.0.1:60693, bytes: 66973, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-789528504_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741919_1095, duration: 4708953000
2015-03-13 10:06:44,648 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741919_1095, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:44,648 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741919_1095{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:44,649 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61410, dest: /127.0.0.1:60689, bytes: 66973, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-789528504_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741919_1095, duration: 4709983000
2015-03-13 10:06:44,649 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741919_1095, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:44,650 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741919_1095{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:44,650 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61409, dest: /127.0.0.1:60696, bytes: 66973, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-789528504_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741919_1095, duration: 4711162000
2015-03-13 10:06:44,650 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741919_1095, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:44,651 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741919_1095{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:44,652 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job_1426266260362_0008_1.jhist is closed by DFSClient_NONMAPREDUCE_-789528504_1
2015-03-13 10:06:44,654 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0008.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:44,656 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0008.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741921_1097{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:06:44,657 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741921_1097 src: /127.0.0.1:61426 dest: /127.0.0.1:60689
2015-03-13 10:06:44,659 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741921_1097 src: /127.0.0.1:61427 dest: /127.0.0.1:60693
2015-03-13 10:06:44,660 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741921_1097 src: /127.0.0.1:61428 dest: /127.0.0.1:60686
2015-03-13 10:06:44,663 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61428, dest: /127.0.0.1:60686, bytes: 454, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-789528504_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741921_1097, duration: 1342000
2015-03-13 10:06:44,663 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741921_1097, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:44,663 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741921_1097{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:06:44,663 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61427, dest: /127.0.0.1:60693, bytes: 454, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-789528504_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741921_1097, duration: 1848000
2015-03-13 10:06:44,664 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741921_1097, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:44,664 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741921_1097{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:06:44,664 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61426, dest: /127.0.0.1:60689, bytes: 454, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-789528504_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741921_1097, duration: 2713000
2015-03-13 10:06:44,664 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741921_1097, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:44,665 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741921_1097{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:06:44,666 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0008.summary_tmp is closed by DFSClient_NONMAPREDUCE_-789528504_1
2015-03-13 10:06:44,670 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0008.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:06:44,673 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job_1426266260362_0008_1.jhist	dst=null	perm=null
2015-03-13 10:06:44,674 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0008-1426266385192-soberoi-%5B60C5B77597CA4154960349C96889F7F7%2FB3FE72BB40B04538-1426266404636-5-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:06:44,677 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job_1426266260362_0008_1.jhist	dst=null	perm=null
2015-03-13 10:06:44,678 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0008-1426266385192-soberoi-%5B60C5B77597CA4154960349C96889F7F7%2FB3FE72BB40B04538-1426266404636-5-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:06:44,678 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job_1426266260362_0008_1.jhist	dst=null	perm=null
2015-03-13 10:06:44,680 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0008-1426266385192-soberoi-%5B60C5B77597CA4154960349C96889F7F7%2FB3FE72BB40B04538-1426266404636-5-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:44,682 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61429, bytes: 67497, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-789528504_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741919_1095, duration: 260000
2015-03-13 10:06:44,684 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0008-1426266385192-soberoi-%5B60C5B77597CA4154960349C96889F7F7%2FB3FE72BB40B04538-1426266404636-5-1-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741922_1098{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:06:44,685 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741922_1098 src: /127.0.0.1:61430 dest: /127.0.0.1:60696
2015-03-13 10:06:44,687 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741922_1098 src: /127.0.0.1:61431 dest: /127.0.0.1:60686
2015-03-13 10:06:44,688 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741922_1098 src: /127.0.0.1:61432 dest: /127.0.0.1:60693
2015-03-13 10:06:44,690 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61432, dest: /127.0.0.1:60693, bytes: 66973, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-789528504_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741922_1098, duration: 1832000
2015-03-13 10:06:44,691 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741922_1098, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:44,691 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741922_1098{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:44,691 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61431, dest: /127.0.0.1:60686, bytes: 66973, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-789528504_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741922_1098, duration: 2331000
2015-03-13 10:06:44,691 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741922_1098, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:44,692 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741922_1098{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:44,692 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61430, dest: /127.0.0.1:60696, bytes: 66973, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-789528504_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741922_1098, duration: 3105000
2015-03-13 10:06:44,692 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741922_1098, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:44,692 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741922_1098{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:44,694 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0008-1426266385192-soberoi-%5B60C5B77597CA4154960349C96889F7F7%2FB3FE72BB40B04538-1426266404636-5-1-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-789528504_1
2015-03-13 10:06:44,696 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0008-1426266385192-soberoi-%5B60C5B77597CA4154960349C96889F7F7%2FB3FE72BB40B04538-1426266404636-5-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:06:44,697 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job_1426266260362_0008_1_conf.xml	dst=null	perm=null
2015-03-13 10:06:44,698 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0008_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:06:44,699 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job_1426266260362_0008_1_conf.xml	dst=null	perm=null
2015-03-13 10:06:44,701 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0008_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:06:44,702 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job_1426266260362_0008_1_conf.xml	dst=null	perm=null
2015-03-13 10:06:44,704 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0008_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:44,707 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61433, bytes: 93975, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-789528504_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741918_1094, duration: 253000
2015-03-13 10:06:44,709 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0008_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741923_1099{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:06:44,710 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741923_1099 src: /127.0.0.1:61434 dest: /127.0.0.1:60686
2015-03-13 10:06:44,712 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741923_1099 src: /127.0.0.1:61435 dest: /127.0.0.1:60696
2015-03-13 10:06:44,713 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741923_1099 src: /127.0.0.1:61436 dest: /127.0.0.1:60693
2015-03-13 10:06:44,716 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61436, dest: /127.0.0.1:60693, bytes: 93243, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-789528504_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741923_1099, duration: 1923000
2015-03-13 10:06:44,716 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741923_1099, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:44,717 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741923_1099{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:44,717 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61435, dest: /127.0.0.1:60696, bytes: 93243, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-789528504_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741923_1099, duration: 2636000
2015-03-13 10:06:44,717 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741923_1099, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:44,718 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741923_1099{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:44,718 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61434, dest: /127.0.0.1:60686, bytes: 93243, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-789528504_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741923_1099, duration: 3371000
2015-03-13 10:06:44,718 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741923_1099, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:44,718 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741923_1099{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:44,719 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0008_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-789528504_1
2015-03-13 10:06:44,721 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0008_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:06:44,722 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0008.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0008.summary	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:06:44,723 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0008_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0008_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:06:44,725 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0008-1426266385192-soberoi-%5B60C5B77597CA4154960349C96889F7F7%2FB3FE72BB40B04538-1426266404636-5-1-SUCCEEDED-default.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0008-1426266385192-soberoi-%5B60C5B77597CA4154960349C96889F7F7%2FB3FE72BB40B04538-1426266404636-5-1-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:06:44,732 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0008_000001 State change from RUNNING to FINISHING
2015-03-13 10:06:44,732 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0008
2015-03-13 10:06:44,732 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0008 State change from RUNNING to REMOVING
2015-03-13 10:06:44,732 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0008
2015-03-13 10:06:44,732 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0008 State change from REMOVING to FINISHING
2015-03-13 10:06:45,003 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:45,603 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:06:45,604 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0008_01_000007
2015-03-13 10:06:45,604 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0008_01_000007 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:06:45,604 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0008_01_000007 in state: COMPLETED event:FINISHED
2015-03-13 10:06:45,605 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0008	CONTAINERID=container_1426266260362_0008_01_000007
2015-03-13 10:06:45,605 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0008_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:06:45,605 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:06:45,605 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0008_01_000007, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:45,605 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:45,606 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:06:45,606 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0008_000001 released container container_1426266260362_0008_01_000007 on node: host: 10.1.1.144:60711 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:06:45,742 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741914_1090 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60693 
2015-03-13 10:06:45,742 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741915_1091 127.0.0.1:60686 127.0.0.1:60693 127.0.0.1:60689 127.0.0.1:60696 
2015-03-13 10:06:45,742 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741916_1092 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60693 
2015-03-13 10:06:45,742 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741917_1093 127.0.0.1:60689 127.0.0.1:60693 127.0.0.1:60686 
2015-03-13 10:06:45,742 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741919_1095 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60693 
2015-03-13 10:06:45,743 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741918_1094 127.0.0.1:60686 127.0.0.1:60693 127.0.0.1:60696 
2015-03-13 10:06:45,743 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008	dst=null	perm=null
2015-03-13 10:06:45,748 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073741914_1090, blk_1073741915_1091, blk_1073741916_1092, blk_1073741917_1093, blk_1073741918_1094]
2015-03-13 10:06:45,749 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073741914_1090, blk_1073741915_1091, blk_1073741917_1093, blk_1073741919_1095]
2015-03-13 10:06:45,778 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin	dst=null	perm=null
2015-03-13 10:06:45,778 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_temporary
2015-03-13 10:06:45,779 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_temporary	dst=null	perm=null
2015-03-13 10:06:45,786 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:06:45,786 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:06:45,787 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:06:45,789 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin	dst=null	perm=null
2015-03-13 10:06:45,789 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin	dst=null	perm=null
2015-03-13 10:06:45,790 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin	dst=null	perm=null
2015-03-13 10:06:45,790 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:06:45,791 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/part-00000	dst=null	perm=null
2015-03-13 10:06:45,793 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61438, bytes: 600, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741920_1096, duration: 149000
2015-03-13 10:06:45,800 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:06:45,800 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:06:45,801 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:06:45,802 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin	dst=null	perm=null
2015-03-13 10:06:45,803 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin	dst=null	perm=null
2015-03-13 10:06:45,805 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin	dst=null	perm=null
2015-03-13 10:06:45,805 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741921_1097
2015-03-13 10:06:45,806 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741922_1098
2015-03-13 10:06:45,806 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741920_1096
2015-03-13 10:06:45,806 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:06:45,807 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741919_1095
2015-03-13 10:06:45,807 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/part-00000	dst=null	perm=null
2015-03-13 10:06:45,808 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741923_1099
2015-03-13 10:06:45,809 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61439, bytes: 600, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741920_1096, duration: 165000
2015-03-13 10:06:45,810 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin
2015-03-13 10:06:45,811 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin	dst=null	perm=null
2015-03-13 10:06:45,811 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin	dst=null	perm=null
2015-03-13 10:06:45,812 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin	dst=null	perm=null
2015-03-13 10:06:45,812 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin	dst=null	perm=null
2015-03-13 10:06:45,813 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/part-00000	dst=null	perm=null
2015-03-13 10:06:45,813 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/part-00000	dst=null	perm=null
2015-03-13 10:06:45,815 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61439, bytes: 600, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741920_1096, duration: 164000
2015-03-13 10:06:45,815 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:06:45,816 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:06:45,817 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt	dst=null	perm=null
2015-03-13 10:06:45,817 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt	dst=null	perm=null
2015-03-13 10:06:45,828 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:06:45,829 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:06:45,829 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:06:45,859 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs	dst=null	perm=null
2015-03-13 10:06:45,861 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping] starting
2015-03-13 10:06:45,861 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt"]
2015-03-13 10:06:45,861 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-03-13 10:06:45,861 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt"]
2015-03-13 10:06:45,861 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-03-13 10:06:45,862 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping]  sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs"]
2015-03-13 10:06:45,862 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping]  parallel execution is enabled: true
2015-03-13 10:06:45,862 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping]  starting jobs: 2
2015-03-13 10:06:45,862 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping]  allocating threads: 2
2015-03-13 10:06:45,863 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [cogrouping] starting step: (2/2)
2015-03-13 10:06:45,871 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:06:45,879 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:06:45,880 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177	dst=null	perm=null
2015-03-13 10:06:45,880 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:06:45,881 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:06:45,883 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 9
2015-03-13 10:06:45,884 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009	dst=null	perm=null
2015-03-13 10:06:45,885 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009	dst=null	perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:06:45,886 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009	dst=null	perm=soberoi:supergroup:rwx------
2015-03-13 10:06:45,886 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.jar	dst=null	perm=null
2015-03-13 10:06:45,888 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:06:45,889 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073741924_1100{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:06:45,890 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741924_1100 src: /127.0.0.1:61441 dest: /127.0.0.1:60696
2015-03-13 10:06:45,891 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741924_1100 src: /127.0.0.1:61442 dest: /127.0.0.1:60686
2015-03-13 10:06:45,892 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741924_1100 src: /127.0.0.1:61443 dest: /127.0.0.1:60693
2015-03-13 10:06:45,896 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61443, dest: /127.0.0.1:60693, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741924_1100, duration: 1803000
2015-03-13 10:06:45,896 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741924_1100, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:45,897 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61442, dest: /127.0.0.1:60686, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741924_1100, duration: 2457000
2015-03-13 10:06:45,897 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741924_1100{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:45,897 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741924_1100, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:45,897 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741924_1100{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:45,897 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61441, dest: /127.0.0.1:60696, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741924_1100, duration: 2902000
2015-03-13 10:06:45,898 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741924_1100, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:45,899 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741924_1100{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:45,900 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:06:45,900 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.jar
2015-03-13 10:06:45,901 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.jar	dst=null	perm=null
2015-03-13 10:06:45,902 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:06:45,903 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:06:45,904 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:06:45,905 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:06:45,905 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:06:45,906 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:06:45,907 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:06:45,907 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:06:45,908 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:06:45,908 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:06:45,910 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:06:45,910 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:06:45,911 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:06:45,913 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:06:45,914 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:06:45,914 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.split
2015-03-13 10:06:45,915 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.split	dst=null	perm=null
2015-03-13 10:06:45,916 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073741925_1101{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:06:45,917 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741925_1101 src: /127.0.0.1:61444 dest: /127.0.0.1:60686
2015-03-13 10:06:45,919 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741925_1101 src: /127.0.0.1:61445 dest: /127.0.0.1:60689
2015-03-13 10:06:45,920 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741925_1101 src: /127.0.0.1:61446 dest: /127.0.0.1:60696
2015-03-13 10:06:45,921 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741925_1101 src: /127.0.0.1:61447 dest: /127.0.0.1:60693
2015-03-13 10:06:45,924 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61447, dest: /127.0.0.1:60693, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741925_1101, duration: 1620000
2015-03-13 10:06:45,924 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741925_1101, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:45,924 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741925_1101{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:45,924 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61446, dest: /127.0.0.1:60696, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741925_1101, duration: 1900000
2015-03-13 10:06:45,924 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741925_1101, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:45,925 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741925_1101{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:45,925 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61445, dest: /127.0.0.1:60689, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741925_1101, duration: 2582000
2015-03-13 10:06:45,925 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741925_1101, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:45,926 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741925_1101{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:45,926 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61444, dest: /127.0.0.1:60686, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741925_1101, duration: 3676000
2015-03-13 10:06:45,926 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741925_1101, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:45,926 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741925_1101{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:45,928 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:06:45,929 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:06:45,930 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:06:45,931 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073741926_1102{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:06:45,933 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741926_1102 src: /127.0.0.1:61448 dest: /127.0.0.1:60696
2015-03-13 10:06:45,934 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741926_1102 src: /127.0.0.1:61449 dest: /127.0.0.1:60693
2015-03-13 10:06:45,935 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741926_1102 src: /127.0.0.1:61450 dest: /127.0.0.1:60686
2015-03-13 10:06:45,937 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61450, dest: /127.0.0.1:60686, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741926_1102, duration: 1336000
2015-03-13 10:06:45,937 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741926_1102, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:45,938 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741926_1102{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:06:45,938 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61449, dest: /127.0.0.1:60693, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741926_1102, duration: 1749000
2015-03-13 10:06:45,938 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741926_1102, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:45,938 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741926_1102{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:06:45,938 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61448, dest: /127.0.0.1:60696, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741926_1102, duration: 2503000
2015-03-13 10:06:45,939 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741926_1102, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:45,939 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741926_1102{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:06:45,941 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:06:45,941 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:06:45,942 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:06:45,944 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:06:45,945 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:06:45,945 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:06:45,946 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:06:45,950 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073741927_1103{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:06:45,951 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741927_1103 src: /127.0.0.1:61451 dest: /127.0.0.1:60693
2015-03-13 10:06:45,952 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741927_1103 src: /127.0.0.1:61452 dest: /127.0.0.1:60696
2015-03-13 10:06:45,954 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741927_1103 src: /127.0.0.1:61453 dest: /127.0.0.1:60686
2015-03-13 10:06:45,956 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61453, dest: /127.0.0.1:60686, bytes: 97842, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741927_1103, duration: 1504000
2015-03-13 10:06:45,957 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741927_1103, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:45,957 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741927_1103{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:06:45,957 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61452, dest: /127.0.0.1:60696, bytes: 97842, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741927_1103, duration: 1944000
2015-03-13 10:06:45,958 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741927_1103, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:45,958 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741927_1103{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:06:45,958 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61451, dest: /127.0.0.1:60693, bytes: 97842, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741927_1103, duration: 2948000
2015-03-13 10:06:45,958 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741927_1103, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:45,960 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741927_1103{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:06:45,961 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:06:45,961 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0009
2015-03-13 10:06:45,962 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009	dst=null	perm=null
2015-03-13 10:06:45,963 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.xml	dst=null	perm=null
2015-03-13 10:06:45,964 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.xml	dst=null	perm=null
2015-03-13 10:06:45,965 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.jar	dst=null	perm=null
2015-03-13 10:06:45,965 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.jar	dst=null	perm=null
2015-03-13 10:06:45,966 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.split	dst=null	perm=null
2015-03-13 10:06:45,967 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.split	dst=null	perm=null
2015-03-13 10:06:45,967 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:06:45,968 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:06:45,969 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:06:45,970 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:06:45,971 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:06:45,971 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:06:45,972 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:06:45,972 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:06:45,973 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 9 submitted by user soberoi
2015-03-13 10:06:45,973 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0009
2015-03-13 10:06:45,974 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0009 State change from NEW to NEW_SAVING
2015-03-13 10:06:45,974 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0009
2015-03-13 10:06:45,973 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	IP=10.1.1.144	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1426266260362_0009
2015-03-13 10:06:45,974 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0009 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:06:45,974 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0009_000001
2015-03-13 10:06:45,974 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0009_000001 State change from NEW to SUBMITTED
2015-03-13 10:06:45,974 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0009 from user: soberoi activated in queue: default
2015-03-13 10:06:45,975 INFO  capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0009 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:06:45,975 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0009 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:06:45,975 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0009 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:06:45,975 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0009_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:06:45,975 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0009_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:06:45,975 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0009 State change from SUBMITTED to ACCEPTED
2015-03-13 10:06:45,977 INFO  mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0009/
2015-03-13 10:06:45,977 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [cogrouping] submitted hadoop job: job_1426266260362_0009
2015-03-13 10:06:45,977 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [cogrouping] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0009/
2015-03-13 10:06:45,980 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741927_1103
2015-03-13 10:06:45,980 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741921_1097
2015-03-13 10:06:45,980 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741923_1099
2015-03-13 10:06:45,982 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741924_1100
2015-03-13 10:06:46,005 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:46,006 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0009_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:06:46,006 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0009	CONTAINERID=container_1426266260362_0009_01_000001
2015-03-13 10:06:46,006 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0009_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60719, which currently has 2 containers, <memory:4096, vCores:2> used and <memory:0, vCores:6> available
2015-03-13 10:06:46,006 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0009 container=Container: [ContainerId: container_1426266260362_0009_01_000001, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0009_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:46,006 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:06:46,006 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0009_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:06:46,006 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:46,007 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0009 AttemptId: appattempt_1426266260362_0009_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0009_01_000001, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ]
2015-03-13 10:06:46,007 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0009_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:06:46,007 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0009_000001
2015-03-13 10:06:46,007 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0009_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:06:46,007 INFO  amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0009_000001
2015-03-13 10:06:46,008 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0009_01_000001, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] for AM appattempt_1426266260362_0009_000001
2015-03-13 10:06:46,009 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0009_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-03-13 10:06:46,012 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0009_000001 (auth:SIMPLE)
2015-03-13 10:06:46,014 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0009_01_000001 by user soberoi
2015-03-13 10:06:46,014 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0009
2015-03-13 10:06:46,014 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0009	CONTAINERID=container_1426266260362_0009_01_000001
2015-03-13 10:06:46,014 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0009 transitioned from NEW to INITING
2015-03-13 10:06:46,014 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0009_01_000001 to application application_1426266260362_0009
2015-03-13 10:06:46,014 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0009 transitioned from INITING to RUNNING
2015-03-13 10:06:46,015 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0009_01_000001, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] for AM appattempt_1426266260362_0009_000001
2015-03-13 10:06:46,015 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0009_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:06:46,015 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:06:46,015 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0009
2015-03-13 10:06:46,015 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:06:46,015 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:06:46,015 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:06:46,015 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:06:46,015 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0009_01_000001
2015-03-13 10:06:46,025 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1426266260362_0009_01_000001.tokens. Credentials list: 
2015-03-13 10:06:46,039 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:06:46,111 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1426266260362_0009_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000001.tokens
2015-03-13 10:06:46,111 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0009 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0009
2015-03-13 10:06:46,168 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.jar	dst=null	perm=null
2015-03-13 10:06:46,169 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.jar	dst=null	perm=null
2015-03-13 10:06:46,170 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.jar	dst=null	perm=null
2015-03-13 10:06:46,176 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61457, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1915343812_4952, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741924_1100, duration: 388000
2015-03-13 10:06:46,184 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741927_1103
2015-03-13 10:06:46,184 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741925_1101
2015-03-13 10:06:46,184 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741924_1100
2015-03-13 10:06:46,185 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741922_1098
2015-03-13 10:06:46,185 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741926_1102
2015-03-13 10:06:46,195 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:06:46,200 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741919_1095
2015-03-13 10:06:46,200 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741920_1096
2015-03-13 10:06:46,201 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741921_1097
2015-03-13 10:06:46,201 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741925_1101
2015-03-13 10:06:46,213 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:06:46,213 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:06:46,214 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:06:46,220 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61457, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1915343812_4952, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741926_1102, duration: 172000
2015-03-13 10:06:46,232 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:06:46,248 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.split	dst=null	perm=null
2015-03-13 10:06:46,249 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.split	dst=null	perm=null
2015-03-13 10:06:46,249 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.split	dst=null	perm=null
2015-03-13 10:06:46,255 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61458, bytes: 1798, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1915343812_4952, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741925_1101, duration: 164000
2015-03-13 10:06:46,267 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:06:46,283 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.xml	dst=null	perm=null
2015-03-13 10:06:46,283 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.xml	dst=null	perm=null
2015-03-13 10:06:46,284 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.xml	dst=null	perm=null
2015-03-13 10:06:46,290 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61458, bytes: 98610, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1915343812_4952, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741927_1103, duration: 280000
2015-03-13 10:06:46,302 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:06:46,303 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:06:46,327 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:06:46,327 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:46,380 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741919_1095
2015-03-13 10:06:46,381 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741920_1096
2015-03-13 10:06:46,381 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741923_1099
2015-03-13 10:06:46,381 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741925_1101
2015-03-13 10:06:46,381 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741926_1102
2015-03-13 10:06:46,382 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741922_1098
2015-03-13 10:06:46,399 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000001/default_container_executor.sh]
2015-03-13 10:06:46,402 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741914_1090 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741914 for deletion
2015-03-13 10:06:46,402 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741915_1091 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741915 for deletion
2015-03-13 10:06:46,402 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741916_1092 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741916 for deletion
2015-03-13 10:06:46,403 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741917_1093 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741917 for deletion
2015-03-13 10:06:46,403 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741918_1094 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741918 for deletion
2015-03-13 10:06:46,402 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741914_1090 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741914 for deletion
2015-03-13 10:06:46,403 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741915_1091 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741915 for deletion
2015-03-13 10:06:46,403 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741915_1091 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741915
2015-03-13 10:06:46,403 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741914_1090 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741914
2015-03-13 10:06:46,403 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741915_1091 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741915
2015-03-13 10:06:46,404 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741916_1092 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741916
2015-03-13 10:06:46,404 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741918_1094 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741918
2015-03-13 10:06:46,403 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741917_1093 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741917
2015-03-13 10:06:46,403 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741914_1090 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741914
2015-03-13 10:06:46,403 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741917_1093 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741917 for deletion
2015-03-13 10:06:46,404 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741919_1095 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741919 for deletion
2015-03-13 10:06:46,405 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741917_1093 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741917
2015-03-13 10:06:46,405 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741919_1095 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741919
2015-03-13 10:06:47,005 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:47,006 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:47,006 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0009_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:06:47,984 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:06:48,004 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/COMMIT_STARTED	dst=null	perm=null
2015-03-13 10:06:48,005 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/COMMIT_SUCCESS	dst=null	perm=null
2015-03-13 10:06:48,006 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/COMMIT_FAIL	dst=null	perm=null
2015-03-13 10:06:48,007 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:48,007 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:48,058 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009	dst=null	perm=null
2015-03-13 10:06:48,059 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:06:48,060 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:06:48,334 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:06:48,340 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:06:48,400 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61460, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_634066759_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741926_1102, duration: 152000
2015-03-13 10:06:48,750 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60696 to replicate blk_1073741924_1100 to datanode(s) 127.0.0.1:60689
2015-03-13 10:06:48,750 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073741914_1090, blk_1073741915_1091, blk_1073741916_1092, blk_1073741918_1094, blk_1073741919_1095]
2015-03-13 10:06:48,750 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073741914_1090, blk_1073741915_1091, blk_1073741916_1092, blk_1073741917_1093, blk_1073741918_1094, blk_1073741919_1095]
2015-03-13 10:06:49,010 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:49,010 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:49,225 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0009_000001 (auth:SIMPLE)
2015-03-13 10:06:49,227 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0009_000001
2015-03-13 10:06:49,227 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi	IP=10.1.1.144	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1426266260362_0009	APPATTEMPTID=appattempt_1426266260362_0009_000001
2015-03-13 10:06:49,227 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0009_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:06:49,227 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0009 State change from ACCEPTED to RUNNING
2015-03-13 10:06:49,247 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job_1426266260362_0009_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:49,249 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:06:49,322 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job_1426266260362_0009_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:49,458 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job_1426266260362_0009_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073741928_1104{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:06:49,495 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741928_1104 src: /127.0.0.1:61466 dest: /127.0.0.1:60689
2015-03-13 10:06:49,497 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741928_1104 src: /127.0.0.1:61467 dest: /127.0.0.1:60693
2015-03-13 10:06:49,499 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741928_1104 src: /127.0.0.1:61468 dest: /127.0.0.1:60686
2015-03-13 10:06:49,507 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61468, dest: /127.0.0.1:60686, bytes: 90774, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_634066759_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741928_1104, duration: 6530000
2015-03-13 10:06:49,507 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741928_1104, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:49,508 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741928_1104{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:06:49,508 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61467, dest: /127.0.0.1:60693, bytes: 90774, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_634066759_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741928_1104, duration: 7260000
2015-03-13 10:06:49,509 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741928_1104, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:49,509 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61466, dest: /127.0.0.1:60689, bytes: 90774, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_634066759_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741928_1104, duration: 8196000
2015-03-13 10:06:49,509 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741928_1104, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:49,509 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741928_1104{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:06:49,510 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741928_1104{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:06:49,514 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job_1426266260362_0009_1_conf.xml is closed by DFSClient_NONMAPREDUCE_634066759_1
2015-03-13 10:06:49,570 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741914_1090 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741914 for deletion
2015-03-13 10:06:49,570 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741915_1091 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741915 for deletion
2015-03-13 10:06:49,570 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741916_1092 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741916 for deletion
2015-03-13 10:06:49,571 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741917_1093 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741917 for deletion
2015-03-13 10:06:49,571 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741918_1094 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741918 for deletion
2015-03-13 10:06:49,571 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741919_1095 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741919 for deletion
2015-03-13 10:06:49,571 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741914_1090 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741914
2015-03-13 10:06:49,571 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741915_1091 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741915
2015-03-13 10:06:49,571 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741916_1092 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741916
2015-03-13 10:06:49,571 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741917_1093 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741917
2015-03-13 10:06:49,571 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741919_1095 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741919
2015-03-13 10:06:49,572 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741918_1094 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741918
2015-03-13 10:06:49,758 INFO  datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-318492837-10.1.1.144-60696-1426266259571, infoPort=60697, ipcPort=60698, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073741924_1100 to 127.0.0.1:60689 
2015-03-13 10:06:49,759 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741914_1090 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741914 for deletion
2015-03-13 10:06:49,759 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741915_1091 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741915 for deletion
2015-03-13 10:06:49,759 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741916_1092 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741916 for deletion
2015-03-13 10:06:49,759 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741918_1094 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741918 for deletion
2015-03-13 10:06:49,759 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741914_1090 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741914
2015-03-13 10:06:49,759 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741916_1092 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741916
2015-03-13 10:06:49,759 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741919_1095 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741919 for deletion
2015-03-13 10:06:49,760 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741915_1091 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741915
2015-03-13 10:06:49,760 INFO  datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073741924_1100 (numBytes=254067) to /127.0.0.1:60689
2015-03-13 10:06:49,760 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741918_1094 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741918
2015-03-13 10:06:49,760 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741919_1095 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741919
2015-03-13 10:06:49,761 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741924_1100 src: /127.0.0.1:61469 dest: /127.0.0.1:60689
2015-03-13 10:06:49,762 INFO  datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073741924_1100 src: /127.0.0.1:61469 dest: /127.0.0.1:60689 of size 254067
2015-03-13 10:06:49,763 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741924_1100 size 254067
2015-03-13 10:06:50,016 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:50,017 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:50,625 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0009_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:06:50,625 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0009	CONTAINERID=container_1426266260362_0009_01_000002
2015-03-13 10:06:50,625 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0009_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:06:50,625 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0009 container=Container: [ContainerId: container_1426266260362_0009_01_000002, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0009_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:50,626 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:06:50,626 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:50,626 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0009_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:06:50,626 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0009	CONTAINERID=container_1426266260362_0009_01_000003
2015-03-13 10:06:50,627 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0009_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:06:50,627 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0009 container=Container: [ContainerId: container_1426266260362_0009_01_000003, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0009_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:50,627 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:06:50,627 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:50,628 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0009_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:06:50,628 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0009	CONTAINERID=container_1426266260362_0009_01_000004
2015-03-13 10:06:50,628 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0009_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:06:50,628 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0009 container=Container: [ContainerId: container_1426266260362_0009_01_000004, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0009_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:50,628 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:06:50,628 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:50,629 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0009_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:06:50,629 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0009	CONTAINERID=container_1426266260362_0009_01_000005
2015-03-13 10:06:50,629 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0009_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:06:50,629 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0009 container=Container: [ContainerId: container_1426266260362_0009_01_000005, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0009_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:50,629 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:06:50,629 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:50,770 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0008_01_000001 succeeded 
2015-03-13 10:06:50,770 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:06:50,771 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0008_01_000001
2015-03-13 10:06:50,778 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000001
2015-03-13 10:06:50,778 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000001
2015-03-13 10:06:50,778 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0008	CONTAINERID=container_1426266260362_0008_01_000001
2015-03-13 10:06:50,779 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:06:50,779 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0008_01_000001 from application application_1426266260362_0008
2015-03-13 10:06:50,779 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:50,779 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0008
2015-03-13 10:06:50,779 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000001
2015-03-13 10:06:50,779 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000001
2015-03-13 10:06:50,810 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741926_1102
2015-03-13 10:06:50,811 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741928_1104
2015-03-13 10:06:50,812 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741925_1101
2015-03-13 10:06:50,812 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741927_1103
2015-03-13 10:06:50,894 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0009_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:06:50,894 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0009	CONTAINERID=container_1426266260362_0009_01_000006
2015-03-13 10:06:50,894 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0009_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:06:50,894 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0009 container=Container: [ContainerId: container_1426266260362_0009_01_000006, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0009_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:50,895 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7
2015-03-13 10:06:50,895 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:51,017 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741924_1100
2015-03-13 10:06:51,019 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:06:51,019 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0008_01_000001
2015-03-13 10:06:51,019 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:51,020 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0008_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:06:51,020 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0008_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:06:51,020 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0008_000001
2015-03-13 10:06:51,020 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0008	CONTAINERID=container_1426266260362_0008_01_000001
2015-03-13 10:06:51,021 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0008_000001 State change from FINISHING to FINISHED
2015-03-13 10:06:51,021 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0008_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:06:51,021 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0008 State change from FINISHING to FINISHED
2015-03-13 10:06:51,021 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:7168, vCores:6> numContainers=6 user=soberoi user-resources=<memory:7168, vCores:6>
2015-03-13 10:06:51,021 INFO  amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0008_000001
2015-03-13 10:06:51,021 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1426266260362_0008
2015-03-13 10:06:51,021 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0008_01_000001, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:51,021 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0008,name=[60C5B77597CA4154960349C96889F7F7/B3FE72BB40B045389F47AAE64AC74701] cogrouping/(1/1) ...intocogrouplhsswappedjoin,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0008/jobhistory/job/job_1426266260362_0008,appMasterHost=Edinburgh.local,startTime=1426266385193,finishTime=1426266404732,finalStatus=SUCCEEDED
2015-03-13 10:06:51,021 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:51,022 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6
2015-03-13 10:06:51,022 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0008_000001 released container container_1426266260362_0008_01_000001 on node: host: 10.1.1.144:60719 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:06:51,022 INFO  capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0008_000001 is done. finalState=FINISHED
2015-03-13 10:06:51,022 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0008 requests cleared
2015-03-13 10:06:51,022 INFO  capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0008 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:06:51,022 INFO  capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0008 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:06:51,024 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0008_000001 (auth:SIMPLE)
2015-03-13 10:06:51,025 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0008_01_000001
2015-03-13 10:06:51,208 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741924_1100
2015-03-13 10:06:51,209 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741928_1104
2015-03-13 10:06:51,261 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0009_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:06:51,261 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0009_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:06:51,261 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0009_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:06:51,261 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0009_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:06:51,262 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0009_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:06:51,289 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.jar	dst=null	perm=null
2015-03-13 10:06:51,290 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.jar	dst=null	perm=null
2015-03-13 10:06:51,298 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.xml	dst=null	perm=null
2015-03-13 10:06:51,299 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.xml	dst=null	perm=null
2015-03-13 10:06:51,302 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:06:51,303 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:06:51,308 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:06:51,309 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:06:51,310 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:06:51,312 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:06:51,385 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741928_1104
2015-03-13 10:06:51,387 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0009_000001 (auth:SIMPLE)
2015-03-13 10:06:51,387 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0009_000001 (auth:SIMPLE)
2015-03-13 10:06:51,390 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0009_01_000002 by user soberoi
2015-03-13 10:06:51,390 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0009
2015-03-13 10:06:51,390 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0009	CONTAINERID=container_1426266260362_0009_01_000002
2015-03-13 10:06:51,390 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0009_01_000003 by user soberoi
2015-03-13 10:06:51,391 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0009	CONTAINERID=container_1426266260362_0009_01_000003
2015-03-13 10:06:51,391 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0009 transitioned from NEW to INITING
2015-03-13 10:06:51,391 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0009_01_000002 to application application_1426266260362_0009
2015-03-13 10:06:51,391 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0009_01_000003 to application application_1426266260362_0009
2015-03-13 10:06:51,391 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0009 transitioned from INITING to RUNNING
2015-03-13 10:06:51,392 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:06:51,392 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0009_01_000004 by user soberoi
2015-03-13 10:06:51,392 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:06:51,392 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0009
2015-03-13 10:06:51,392 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0009
2015-03-13 10:06:51,392 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:06:51,392 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0009
2015-03-13 10:06:51,392 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:06:51,392 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:06:51,393 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0009
2015-03-13 10:06:51,393 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0009
2015-03-13 10:06:51,393 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:06:51,393 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0009
2015-03-13 10:06:51,393 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0009_01_000004 to application application_1426266260362_0009
2015-03-13 10:06:51,393 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0009_01_000003
2015-03-13 10:06:51,391 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0009_01_000006 by user soberoi
2015-03-13 10:06:51,394 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0009_01_000005 by user soberoi
2015-03-13 10:06:51,394 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0009_01_000002
2015-03-13 10:06:51,392 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0009	CONTAINERID=container_1426266260362_0009_01_000004
2015-03-13 10:06:51,394 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0009	CONTAINERID=container_1426266260362_0009_01_000005
2015-03-13 10:06:51,394 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0009
2015-03-13 10:06:51,395 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0009	CONTAINERID=container_1426266260362_0009_01_000006
2015-03-13 10:06:51,396 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:06:51,396 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0009_01_000005 to application application_1426266260362_0009
2015-03-13 10:06:51,396 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0009
2015-03-13 10:06:51,396 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0009
2015-03-13 10:06:51,396 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:06:51,396 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0009
2015-03-13 10:06:51,397 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:06:51,397 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0009_01_000004
2015-03-13 10:06:51,397 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0009 transitioned from NEW to INITING
2015-03-13 10:06:51,397 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0009_01_000006 to application application_1426266260362_0009
2015-03-13 10:06:51,397 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0009 transitioned from INITING to RUNNING
2015-03-13 10:06:51,398 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:06:51,398 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0009
2015-03-13 10:06:51,398 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0009
2015-03-13 10:06:51,398 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:06:51,398 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0009
2015-03-13 10:06:51,398 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:06:51,398 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:06:51,398 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0009_01_000006
2015-03-13 10:06:51,399 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0009
2015-03-13 10:06:51,399 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0009
2015-03-13 10:06:51,399 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:06:51,399 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0009
2015-03-13 10:06:51,399 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0009_01_000005
2015-03-13 10:06:51,420 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0009_01_000003.tokens. Credentials list: 
2015-03-13 10:06:51,423 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1426266260362_0009_01_000002.tokens. Credentials list: 
2015-03-13 10:06:51,427 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0009_01_000004.tokens. Credentials list: 
2015-03-13 10:06:51,427 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426266260362_0009_01_000006.tokens. Credentials list: 
2015-03-13 10:06:51,428 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0009_01_000005.tokens. Credentials list: 
2015-03-13 10:06:51,441 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:06:51,446 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:06:51,519 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0009_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000003.tokens
2015-03-13 10:06:51,519 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0009 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0009
2015-03-13 10:06:51,523 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426266260362_0009_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000006.tokens
2015-03-13 10:06:51,524 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0009 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0009
2015-03-13 10:06:51,584 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.jar	dst=null	perm=null
2015-03-13 10:06:51,594 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.jar	dst=null	perm=null
2015-03-13 10:06:51,596 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.jar	dst=null	perm=null
2015-03-13 10:06:51,598 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.jar	dst=null	perm=null
2015-03-13 10:06:51,599 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.jar	dst=null	perm=null
2015-03-13 10:06:51,600 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.jar	dst=null	perm=null
2015-03-13 10:06:51,606 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61477, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_873968378_5098, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741924_1100, duration: 522000
2015-03-13 10:06:51,608 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61478, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_766654705_5101, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741924_1100, duration: 472000
2015-03-13 10:06:51,626 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:51,626 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:51,627 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:51,627 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:51,627 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0008 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:06:51,627 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0009_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:06:51,627 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0008
2015-03-13 10:06:51,627 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0009_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:06:51,627 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0009_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:06:51,627 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0008
2015-03-13 10:06:51,628 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0008 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:06:51,628 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0008, with delay of 10800 seconds
2015-03-13 10:06:51,627 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0009_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:06:51,628 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0008
2015-03-13 10:06:51,629 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0008
2015-03-13 10:06:51,629 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0008
2015-03-13 10:06:51,632 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:06:51,633 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:06:51,652 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.xml	dst=null	perm=null
2015-03-13 10:06:51,653 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.xml	dst=null	perm=null
2015-03-13 10:06:51,653 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.xml	dst=null	perm=null
2015-03-13 10:06:51,654 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.xml	dst=null	perm=null
2015-03-13 10:06:51,654 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.xml	dst=null	perm=null
2015-03-13 10:06:51,655 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.xml	dst=null	perm=null
2015-03-13 10:06:51,663 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61479, bytes: 98610, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_766654705_5101, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741927_1103, duration: 297000
2015-03-13 10:06:51,663 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61480, bytes: 98610, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_873968378_5098, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741927_1103, duration: 285000
2015-03-13 10:06:51,677 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:06:51,677 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:06:51,677 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:06:51,678 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:06:51,677 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:06:51,678 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:06:51,678 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:06:51,727 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:06:51,727 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:51,727 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:06:51,728 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:51,728 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:06:51,728 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:51,728 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:06:51,728 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:51,737 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:06:51,737 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:51,869 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000003/default_container_executor.sh]
2015-03-13 10:06:51,871 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000005/default_container_executor.sh]
2015-03-13 10:06:51,873 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000006/default_container_executor.sh]
2015-03-13 10:06:51,881 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000004/default_container_executor.sh]
2015-03-13 10:06:51,883 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000002/default_container_executor.sh]
2015-03-13 10:06:51,896 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:51,897 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0009_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:06:52,023 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:52,024 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0008 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:06:52,024 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0008
2015-03-13 10:06:52,024 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0008
2015-03-13 10:06:52,024 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0008
2015-03-13 10:06:52,024 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0008
2015-03-13 10:06:52,025 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0008
2015-03-13 10:06:52,024 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0008 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:06:52,025 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0008, with delay of 10800 seconds
2015-03-13 10:06:52,281 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:06:52,632 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:52,633 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:52,633 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:52,633 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:52,708 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:06:52,846 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0009_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000005.tokens
2015-03-13 10:06:52,847 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0009 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0009
2015-03-13 10:06:52,898 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:52,957 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:06:53,026 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:53,074 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0009_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000004.tokens
2015-03-13 10:06:53,074 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0009 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0009
2015-03-13 10:06:53,176 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:06:53,333 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1426266260362_0009_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000002.tokens
2015-03-13 10:06:53,333 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0009 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0009
2015-03-13 10:06:53,638 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:53,638 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:53,639 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:53,639 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:53,904 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:54,029 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:54,643 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:54,643 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:54,644 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:54,644 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:54,906 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:55,031 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:55,646 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:55,646 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:55,647 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:55,647 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:55,910 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:56,037 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:56,648 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:56,648 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:56,648 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:56,649 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:56,912 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:57,041 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:57,649 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:57,649 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:57,650 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:57,650 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:57,918 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:58,045 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:58,651 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:58,651 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:58,651 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:58,652 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:58,919 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:59,046 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:59,601 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.split	dst=null	perm=null
2015-03-13 10:06:59,653 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:59,653 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:59,653 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:59,653 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:59,752 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.split	dst=null	perm=null
2015-03-13 10:06:59,783 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.split	dst=null	perm=null
2015-03-13 10:06:59,848 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61492, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0009_m_000000_0_154459683_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741925_1101, duration: 167000
2015-03-13 10:06:59,859 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.split	dst=null	perm=null
2015-03-13 10:06:59,877 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.split	dst=null	perm=null
2015-03-13 10:06:59,925 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:59,934 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61495, bytes: 1282, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0009_m_000002_0_-1960666537_1, offset: 512, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741925_1101, duration: 166000
2015-03-13 10:06:59,934 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61496, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0009_m_000003_0_1185482097_1, offset: 1024, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741925_1101, duration: 121000
2015-03-13 10:07:00,000 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61497, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0009_m_000004_0_-1714208805_1, offset: 1024, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741925_1101, duration: 156000
2015-03-13 10:07:00,002 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61498, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0009_m_000001_0_30834488_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741925_1101, duration: 172000
2015-03-13 10:07:00,011 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:07:00,047 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/_temporary/attempt_1426266260362_0009_m_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:00,047 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:00,061 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:07:00,065 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61496, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0009_m_000003_0_1185482097_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 154000
2015-03-13 10:07:00,078 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:07:00,082 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61499, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0009_m_000002_0_-1960666537_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 231000
2015-03-13 10:07:00,106 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/_temporary/attempt_1426266260362_0009_m_000003_0/part-00003	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:00,120 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/_temporary/attempt_1426266260362_0009_m_000002_0/part-00002	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:00,121 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:07:00,125 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:07:00,125 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61500, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0009_m_000001_0_30834488_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 151000
2015-03-13 10:07:00,129 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61497, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0009_m_000004_0_-1714208805_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 161000
2015-03-13 10:07:00,189 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/_temporary/attempt_1426266260362_0009_m_000004_0/part-00004	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:00,189 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/_temporary/attempt_1426266260362_0009_m_000001_0/part-00001	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:00,480 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:07:00,490 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:07:00,493 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:07:00,498 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61501, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0009_m_000000_0_154459683_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 157000
2015-03-13 10:07:00,502 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61502, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0009_m_000000_0_154459683_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 196000
2015-03-13 10:07:00,528 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/_temporary/attempt_1426266260362_0009_m_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073741929_1105{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:07:00,561 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:07:00,568 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741929_1105 src: /127.0.0.1:61503 dest: /127.0.0.1:60696
2015-03-13 10:07:00,570 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741929_1105 src: /127.0.0.1:61504 dest: /127.0.0.1:60686
2015-03-13 10:07:00,570 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:07:00,571 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741929_1105 src: /127.0.0.1:61505 dest: /127.0.0.1:60689
2015-03-13 10:07:00,575 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:07:00,578 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61505, dest: /127.0.0.1:60689, bytes: 138, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0009_m_000000_0_154459683_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741929_1105, duration: 5379000
2015-03-13 10:07:00,579 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741929_1105, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:00,579 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61506, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0009_m_000003_0_1185482097_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 167000
2015-03-13 10:07:00,579 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741929_1105{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:00,580 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61504, dest: /127.0.0.1:60686, bytes: 138, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0009_m_000000_0_154459683_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741929_1105, duration: 6464000
2015-03-13 10:07:00,580 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741929_1105, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:00,581 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741929_1105{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:00,581 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61503, dest: /127.0.0.1:60696, bytes: 138, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0009_m_000000_0_154459683_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741929_1105, duration: 7733000
2015-03-13 10:07:00,581 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741929_1105, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:00,582 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741929_1105{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:00,590 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/_temporary/attempt_1426266260362_0009_m_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0009_m_000000_0_154459683_1
2015-03-13 10:07:00,595 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:07:00,599 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/_temporary/attempt_1426266260362_0009_m_000000_0	dst=null	perm=null
2015-03-13 10:07:00,605 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/_temporary/attempt_1426266260362_0009_m_000000_0	dst=null	perm=null
2015-03-13 10:07:00,606 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/task_1426266260362_0009_m_000000	dst=null	perm=null
2015-03-13 10:07:00,609 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/_temporary/attempt_1426266260362_0009_m_000000_0	dst=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/task_1426266260362_0009_m_000000	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:07:00,611 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:07:00,616 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:07:00,621 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61507, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0009_m_000002_0_-1960666537_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 163000
2015-03-13 10:07:00,631 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:07:00,631 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/_temporary/attempt_1426266260362_0009_m_000003_0/part-00003. BP-1005356445-10.1.1.144-1426266257849 blk_1073741930_1106{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:07:00,639 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0009_01_000002
2015-03-13 10:07:00,639 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0009	CONTAINERID=container_1426266260362_0009_01_000002
2015-03-13 10:07:00,639 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:07:00,639 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0009_01_000002
2015-03-13 10:07:00,639 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:07:00,640 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:00,640 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:00,640 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:00,652 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0009_01_000002 is : 143
2015-03-13 10:07:00,655 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job_1426266260362_0009_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073741931_1107{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:07:00,657 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741931_1107 src: /127.0.0.1:61509 dest: /127.0.0.1:60686
2015-03-13 10:07:00,659 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741931_1107 src: /127.0.0.1:61510 dest: /127.0.0.1:60689
2015-03-13 10:07:00,660 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741931_1107 src: /127.0.0.1:61511 dest: /127.0.0.1:60693
2015-03-13 10:07:00,664 INFO  hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job_1426266260362_0009_1.jhist for DFSClient_NONMAPREDUCE_634066759_1
2015-03-13 10:07:00,665 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:07:00,665 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000002
2015-03-13 10:07:00,665 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000002
2015-03-13 10:07:00,665 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0009	CONTAINERID=container_1426266260362_0009_01_000002
2015-03-13 10:07:00,666 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:07:00,666 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0009_01_000002 from application application_1426266260362_0009
2015-03-13 10:07:00,666 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:00,666 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0009
2015-03-13 10:07:00,666 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000002
2015-03-13 10:07:00,666 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000002
2015-03-13 10:07:00,679 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:07:00,681 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/_temporary/attempt_1426266260362_0009_m_000002_0/part-00002. BP-1005356445-10.1.1.144-1426266257849 blk_1073741932_1108{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:07:00,685 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:07:00,689 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61513, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0009_m_000001_0_30834488_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 154000
2015-03-13 10:07:00,691 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741930_1106 src: /127.0.0.1:61508 dest: /127.0.0.1:60693
2015-03-13 10:07:00,692 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741930_1106 src: /127.0.0.1:61514 dest: /127.0.0.1:60696
2015-03-13 10:07:00,694 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741930_1106 src: /127.0.0.1:61515 dest: /127.0.0.1:60689
2015-03-13 10:07:00,702 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61515, dest: /127.0.0.1:60689, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0009_m_000003_0_1185482097_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741930_1106, duration: 6417000
2015-03-13 10:07:00,702 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741930_1106, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:00,703 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741930_1106{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:00,703 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61514, dest: /127.0.0.1:60696, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0009_m_000003_0_1185482097_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741930_1106, duration: 7430000
2015-03-13 10:07:00,703 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741930_1106, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:00,704 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61508, dest: /127.0.0.1:60693, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0009_m_000003_0_1185482097_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741930_1106, duration: 8271000
2015-03-13 10:07:00,704 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741930_1106, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:00,704 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741930_1106{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:00,705 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741930_1106{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:00,710 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/_temporary/attempt_1426266260362_0009_m_000003_0/part-00003 is closed by DFSClient_attempt_1426266260362_0009_m_000003_0_1185482097_1
2015-03-13 10:07:00,719 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/_temporary/attempt_1426266260362_0009_m_000003_0	dst=null	perm=null
2015-03-13 10:07:00,724 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/_temporary/attempt_1426266260362_0009_m_000001_0/part-00001. BP-1005356445-10.1.1.144-1426266257849 blk_1073741933_1109{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:07:00,725 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741932_1108 src: /127.0.0.1:61512 dest: /127.0.0.1:60689
2015-03-13 10:07:00,725 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/_temporary/attempt_1426266260362_0009_m_000003_0	dst=null	perm=null
2015-03-13 10:07:00,727 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741932_1108 src: /127.0.0.1:61516 dest: /127.0.0.1:60693
2015-03-13 10:07:00,727 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/task_1426266260362_0009_m_000003	dst=null	perm=null
2015-03-13 10:07:00,728 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741932_1108 src: /127.0.0.1:61517 dest: /127.0.0.1:60686
2015-03-13 10:07:00,731 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:07:00,733 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/_temporary/attempt_1426266260362_0009_m_000003_0	dst=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/task_1426266260362_0009_m_000003	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:07:00,737 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61517, dest: /127.0.0.1:60686, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0009_m_000002_0_-1960666537_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741932_1108, duration: 7599000
2015-03-13 10:07:00,737 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741932_1108, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:00,738 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741932_1108{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:07:00,738 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61516, dest: /127.0.0.1:60693, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0009_m_000002_0_-1960666537_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741932_1108, duration: 8302000
2015-03-13 10:07:00,738 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741932_1108, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:00,738 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741932_1108{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:07:00,739 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61512, dest: /127.0.0.1:60689, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0009_m_000002_0_-1960666537_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741932_1108, duration: 9165000
2015-03-13 10:07:00,739 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741932_1108, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:00,739 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741932_1108{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:07:00,745 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/_temporary/attempt_1426266260362_0009_m_000002_0/part-00002 is closed by DFSClient_attempt_1426266260362_0009_m_000002_0_-1960666537_1
2015-03-13 10:07:00,749 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0009_01_000005
2015-03-13 10:07:00,749 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0009	CONTAINERID=container_1426266260362_0009_01_000005
2015-03-13 10:07:00,749 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:07:00,750 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:07:00,750 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0009_01_000002
2015-03-13 10:07:00,750 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0009_01_000005
2015-03-13 10:07:00,750 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:00,750 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:00,750 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:07:00,751 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0009_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:07:00,751 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0009_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:07:00,751 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0009	CONTAINERID=container_1426266260362_0009_01_000002
2015-03-13 10:07:00,751 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0009_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:07:00,751 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:07:00,751 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0009_01_000002, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:00,751 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:00,751 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:07:00,752 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0009_000001 released container container_1426266260362_0009_01_000002 on node: host: 10.1.1.144:60711 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:07:00,764 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0009_01_000005 is : 143
2015-03-13 10:07:00,772 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/_temporary/attempt_1426266260362_0009_m_000002_0	dst=null	perm=null
2015-03-13 10:07:00,776 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:07:00,777 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000005
2015-03-13 10:07:00,777 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000005
2015-03-13 10:07:00,777 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000005
2015-03-13 10:07:00,778 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000005
2015-03-13 10:07:00,778 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0009	CONTAINERID=container_1426266260362_0009_01_000005
2015-03-13 10:07:00,778 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:07:00,778 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0009_01_000005 from application application_1426266260362_0009
2015-03-13 10:07:00,778 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:00,778 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0009
2015-03-13 10:07:00,780 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/_temporary/attempt_1426266260362_0009_m_000002_0	dst=null	perm=null
2015-03-13 10:07:00,781 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/task_1426266260362_0009_m_000002	dst=null	perm=null
2015-03-13 10:07:00,783 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741933_1109 src: /127.0.0.1:61518 dest: /127.0.0.1:60696
2015-03-13 10:07:00,784 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741933_1109 src: /127.0.0.1:61519 dest: /127.0.0.1:60686
2015-03-13 10:07:00,785 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/_temporary/attempt_1426266260362_0009_m_000002_0	dst=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/task_1426266260362_0009_m_000002	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:07:00,786 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741933_1109 src: /127.0.0.1:61520 dest: /127.0.0.1:60693
2015-03-13 10:07:00,790 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:07:00,793 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61520, dest: /127.0.0.1:60693, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0009_m_000001_0_30834488_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741933_1109, duration: 6175000
2015-03-13 10:07:00,794 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741933_1109, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:00,794 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741933_1109{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:07:00,794 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61519, dest: /127.0.0.1:60686, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0009_m_000001_0_30834488_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741933_1109, duration: 6813000
2015-03-13 10:07:00,794 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741933_1109, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:00,795 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741933_1109{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:07:00,795 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61518, dest: /127.0.0.1:60696, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0009_m_000001_0_30834488_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741933_1109, duration: 7620000
2015-03-13 10:07:00,795 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741933_1109, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:00,795 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:07:00,795 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741933_1109{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:07:00,798 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0009_01_000004
2015-03-13 10:07:00,798 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0009	CONTAINERID=container_1426266260362_0009_01_000004
2015-03-13 10:07:00,798 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:07:00,799 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:00,799 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0009_01_000004
2015-03-13 10:07:00,799 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:07:00,799 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:07:00,799 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0009_01_000005
2015-03-13 10:07:00,800 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0009_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:07:00,800 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0009_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:07:00,800 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0009	CONTAINERID=container_1426266260362_0009_01_000005
2015-03-13 10:07:00,800 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61521, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0009_m_000004_0_-1714208805_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 154000
2015-03-13 10:07:00,800 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0009_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:07:00,800 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:07:00,801 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0009_01_000005, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:00,801 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:00,801 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:07:00,801 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0009_000001 released container container_1426266260362_0009_01_000005 on node: host: 10.1.1.144:60711 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:07:00,807 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/_temporary/attempt_1426266260362_0009_m_000001_0/part-00001 is closed by DFSClient_attempt_1426266260362_0009_m_000001_0_30834488_1
2015-03-13 10:07:00,812 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0009_01_000004 is : 143
2015-03-13 10:07:00,817 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/_temporary/attempt_1426266260362_0009_m_000001_0	dst=null	perm=null
2015-03-13 10:07:00,823 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/_temporary/attempt_1426266260362_0009_m_000001_0	dst=null	perm=null
2015-03-13 10:07:00,824 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/task_1426266260362_0009_m_000001	dst=null	perm=null
2015-03-13 10:07:00,825 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:07:00,825 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000004
2015-03-13 10:07:00,826 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000004
2015-03-13 10:07:00,826 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000004
2015-03-13 10:07:00,826 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000004
2015-03-13 10:07:00,827 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0009	CONTAINERID=container_1426266260362_0009_01_000004
2015-03-13 10:07:00,827 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:07:00,827 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0009_01_000004 from application application_1426266260362_0009
2015-03-13 10:07:00,827 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:00,828 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0009
2015-03-13 10:07:00,828 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/_temporary/attempt_1426266260362_0009_m_000004_0/part-00004. BP-1005356445-10.1.1.144-1426266257849 blk_1073741934_1110{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:07:00,831 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/_temporary/attempt_1426266260362_0009_m_000001_0	dst=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/task_1426266260362_0009_m_000001	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:07:00,841 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0009_01_000003
2015-03-13 10:07:00,841 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0009	CONTAINERID=container_1426266260362_0009_01_000003
2015-03-13 10:07:00,841 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:00,842 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:07:00,842 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0009_01_000004
2015-03-13 10:07:00,842 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:07:00,842 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0009_01_000003
2015-03-13 10:07:00,842 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0009_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:07:00,842 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0009_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:07:00,842 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0009	CONTAINERID=container_1426266260362_0009_01_000004
2015-03-13 10:07:00,842 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0009_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:07:00,843 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:07:00,843 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0009_01_000004, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:00,843 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:00,843 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:07:00,844 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0009_000001 released container container_1426266260362_0009_01_000004 on node: host: 10.1.1.144:60711 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:07:00,856 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0009_01_000003 is : 143
2015-03-13 10:07:00,870 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:07:00,870 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000003
2015-03-13 10:07:00,871 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000003
2015-03-13 10:07:00,871 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000003
2015-03-13 10:07:00,872 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000003
2015-03-13 10:07:00,873 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0009	CONTAINERID=container_1426266260362_0009_01_000003
2015-03-13 10:07:00,873 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:07:00,873 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0009_01_000003 from application application_1426266260362_0009
2015-03-13 10:07:00,873 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:00,873 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0009
2015-03-13 10:07:00,876 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741934_1110 src: /127.0.0.1:61522 dest: /127.0.0.1:60693
2015-03-13 10:07:00,877 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741934_1110 src: /127.0.0.1:61523 dest: /127.0.0.1:60686
2015-03-13 10:07:00,878 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741934_1110 src: /127.0.0.1:61524 dest: /127.0.0.1:60689
2015-03-13 10:07:00,885 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61524, dest: /127.0.0.1:60689, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0009_m_000004_0_-1714208805_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741934_1110, duration: 5196000
2015-03-13 10:07:00,885 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741934_1110, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:00,885 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741934_1110{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:00,886 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61523, dest: /127.0.0.1:60686, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0009_m_000004_0_-1714208805_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741934_1110, duration: 5792000
2015-03-13 10:07:00,886 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741934_1110, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:00,886 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741934_1110{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:00,886 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61522, dest: /127.0.0.1:60693, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0009_m_000004_0_-1714208805_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741934_1110, duration: 6537000
2015-03-13 10:07:00,887 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741934_1110, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:00,887 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741934_1110{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:00,890 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/_temporary/attempt_1426266260362_0009_m_000004_0/part-00004 is closed by DFSClient_attempt_1426266260362_0009_m_000004_0_-1714208805_1
2015-03-13 10:07:00,904 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/_temporary/attempt_1426266260362_0009_m_000004_0	dst=null	perm=null
2015-03-13 10:07:00,931 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:01,021 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741934_1110
2015-03-13 10:07:01,021 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741932_1108
2015-03-13 10:07:01,022 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741930_1106
2015-03-13 10:07:01,023 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741933_1109
2015-03-13 10:07:01,052 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:01,215 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741934_1110
2015-03-13 10:07:01,216 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741929_1105
2015-03-13 10:07:01,216 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741930_1106
2015-03-13 10:07:01,216 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741932_1108
2015-03-13 10:07:01,396 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741934_1110
2015-03-13 10:07:01,396 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741930_1106
2015-03-13 10:07:01,396 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741932_1108
2015-03-13 10:07:01,396 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741929_1105
2015-03-13 10:07:01,397 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741929_1105
2015-03-13 10:07:01,397 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741933_1109
2015-03-13 10:07:01,397 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741933_1109
2015-03-13 10:07:01,847 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:07:01,847 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0009_01_000003
2015-03-13 10:07:01,848 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0009_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:07:01,848 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0009_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:07:01,848 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0009	CONTAINERID=container_1426266260362_0009_01_000003
2015-03-13 10:07:01,848 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0009_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:07:01,849 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:07:01,849 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0009_01_000003, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:01,849 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:01,849 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:07:01,849 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0009_000001 released container container_1426266260362_0009_01_000003 on node: host: 10.1.1.144:60711 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:07:01,913 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/_temporary/attempt_1426266260362_0009_m_000004_0	dst=null	perm=null
2015-03-13 10:07:01,914 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/task_1426266260362_0009_m_000004	dst=null	perm=null
2015-03-13 10:07:01,917 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/_temporary/attempt_1426266260362_0009_m_000004_0	dst=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/task_1426266260362_0009_m_000004	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:07:01,928 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0009_000001 (auth:SIMPLE)
2015-03-13 10:07:01,929 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0009_01_000006
2015-03-13 10:07:01,929 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0009	CONTAINERID=container_1426266260362_0009_01_000006
2015-03-13 10:07:01,929 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:07:01,929 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0009_01_000006
2015-03-13 10:07:01,929 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:07:01,933 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:01,935 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_634066759_1
2015-03-13 10:07:01,938 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1	dst=null	perm=null
2015-03-13 10:07:01,938 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0009_01_000006 is : 143
2015-03-13 10:07:01,943 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177	dst=null	perm=null
2015-03-13 10:07:01,944 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177	dst=null	perm=null
2015-03-13 10:07:01,945 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/task_1426266260362_0009_m_000000	dst=null	perm=null
2015-03-13 10:07:01,946 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/part-00000	dst=null	perm=null
2015-03-13 10:07:01,948 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:07:01,948 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000006
2015-03-13 10:07:01,948 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000006
2015-03-13 10:07:01,948 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0009	CONTAINERID=container_1426266260362_0009_01_000006
2015-03-13 10:07:01,949 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:07:01,949 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0009_01_000006 from application application_1426266260362_0009
2015-03-13 10:07:01,949 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:01,949 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0009
2015-03-13 10:07:01,949 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/task_1426266260362_0009_m_000000/part-00000	dst=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/part-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:01,948 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000006
2015-03-13 10:07:01,949 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000006
2015-03-13 10:07:01,952 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177	dst=null	perm=null
2015-03-13 10:07:01,953 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177	dst=null	perm=null
2015-03-13 10:07:01,954 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/task_1426266260362_0009_m_000001	dst=null	perm=null
2015-03-13 10:07:01,955 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/part-00001	dst=null	perm=null
2015-03-13 10:07:01,956 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/task_1426266260362_0009_m_000001/part-00001	dst=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/part-00001	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:01,957 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177	dst=null	perm=null
2015-03-13 10:07:01,958 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177	dst=null	perm=null
2015-03-13 10:07:01,958 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/task_1426266260362_0009_m_000002	dst=null	perm=null
2015-03-13 10:07:01,960 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/part-00002	dst=null	perm=null
2015-03-13 10:07:01,961 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/task_1426266260362_0009_m_000002/part-00002	dst=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/part-00002	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:01,962 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177	dst=null	perm=null
2015-03-13 10:07:01,962 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177	dst=null	perm=null
2015-03-13 10:07:01,963 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/task_1426266260362_0009_m_000003	dst=null	perm=null
2015-03-13 10:07:01,964 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/part-00003	dst=null	perm=null
2015-03-13 10:07:01,965 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/task_1426266260362_0009_m_000003/part-00003	dst=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/part-00003	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:01,966 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177	dst=null	perm=null
2015-03-13 10:07:01,967 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177	dst=null	perm=null
2015-03-13 10:07:01,968 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/task_1426266260362_0009_m_000004	dst=null	perm=null
2015-03-13 10:07:01,969 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/part-00004	dst=null	perm=null
2015-03-13 10:07:01,970 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/task_1426266260362_0009_m_000004/part-00004	dst=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/part-00004	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:01,973 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary	dst=null	perm=null
2015-03-13 10:07:01,976 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:01,978 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_SUCCESS is closed by DFSClient_NONMAPREDUCE_634066759_1
2015-03-13 10:07:01,980 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:01,981 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_634066759_1
2015-03-13 10:07:01,991 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61511, dest: /127.0.0.1:60693, bytes: 53334, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_634066759_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741931_1107, duration: 1329613000
2015-03-13 10:07:01,992 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741931_1107, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:01,992 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741931_1107{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:07:01,993 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61510, dest: /127.0.0.1:60689, bytes: 53334, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_634066759_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741931_1107, duration: 1330707000
2015-03-13 10:07:01,993 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741931_1107, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:01,994 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741931_1107{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:07:01,994 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61509, dest: /127.0.0.1:60686, bytes: 53334, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_634066759_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741931_1107, duration: 1332049000
2015-03-13 10:07:01,994 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741931_1107, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:01,994 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741931_1107{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:07:01,996 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job_1426266260362_0009_1.jhist is closed by DFSClient_NONMAPREDUCE_634066759_1
2015-03-13 10:07:01,998 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0009.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:02,000 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0009.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741935_1111{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:07:02,002 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741935_1111 src: /127.0.0.1:61526 dest: /127.0.0.1:60686
2015-03-13 10:07:02,003 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741935_1111 src: /127.0.0.1:61527 dest: /127.0.0.1:60689
2015-03-13 10:07:02,005 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741935_1111 src: /127.0.0.1:61528 dest: /127.0.0.1:60696
2015-03-13 10:07:02,008 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61528, dest: /127.0.0.1:60696, bytes: 410, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_634066759_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741935_1111, duration: 1215000
2015-03-13 10:07:02,008 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741935_1111, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:02,008 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741935_1111{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:07:02,008 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61527, dest: /127.0.0.1:60689, bytes: 410, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_634066759_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741935_1111, duration: 2032000
2015-03-13 10:07:02,009 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741935_1111, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:02,009 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741935_1111{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:07:02,009 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61526, dest: /127.0.0.1:60686, bytes: 410, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_634066759_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741935_1111, duration: 2919000
2015-03-13 10:07:02,009 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741935_1111, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:02,010 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741935_1111{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:07:02,011 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0009.summary_tmp is closed by DFSClient_NONMAPREDUCE_634066759_1
2015-03-13 10:07:02,015 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0009.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:02,020 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job_1426266260362_0009_1.jhist	dst=null	perm=null
2015-03-13 10:07:02,021 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0009-1426266405973-soberoi-%5BE808F612428A4495876D015977ED92F6%2FA1D84621FEBB4086-1426266421982-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:07:02,024 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job_1426266260362_0009_1.jhist	dst=null	perm=null
2015-03-13 10:07:02,025 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0009-1426266405973-soberoi-%5BE808F612428A4495876D015977ED92F6%2FA1D84621FEBB4086-1426266421982-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:07:02,026 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job_1426266260362_0009_1.jhist	dst=null	perm=null
2015-03-13 10:07:02,028 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0009-1426266405973-soberoi-%5BE808F612428A4495876D015977ED92F6%2FA1D84621FEBB4086-1426266421982-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:02,030 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61529, bytes: 53754, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_634066759_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741931_1107, duration: 209000
2015-03-13 10:07:02,032 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0009-1426266405973-soberoi-%5BE808F612428A4495876D015977ED92F6%2FA1D84621FEBB4086-1426266421982-5-0-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741936_1112{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:07:02,033 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741936_1112 src: /127.0.0.1:61530 dest: /127.0.0.1:60689
2015-03-13 10:07:02,034 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741936_1112 src: /127.0.0.1:61531 dest: /127.0.0.1:60693
2015-03-13 10:07:02,035 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741936_1112 src: /127.0.0.1:61532 dest: /127.0.0.1:60686
2015-03-13 10:07:02,038 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61532, dest: /127.0.0.1:60686, bytes: 53334, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_634066759_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741936_1112, duration: 1674000
2015-03-13 10:07:02,038 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741936_1112, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:02,039 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741936_1112{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:07:02,039 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61531, dest: /127.0.0.1:60693, bytes: 53334, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_634066759_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741936_1112, duration: 2242000
2015-03-13 10:07:02,039 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741936_1112, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:02,039 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741936_1112{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:07:02,040 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61530, dest: /127.0.0.1:60689, bytes: 53334, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_634066759_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741936_1112, duration: 2861000
2015-03-13 10:07:02,040 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741936_1112, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:02,040 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741936_1112{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:07:02,041 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0009-1426266405973-soberoi-%5BE808F612428A4495876D015977ED92F6%2FA1D84621FEBB4086-1426266421982-5-0-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_634066759_1
2015-03-13 10:07:02,043 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0009-1426266405973-soberoi-%5BE808F612428A4495876D015977ED92F6%2FA1D84621FEBB4086-1426266421982-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:02,044 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job_1426266260362_0009_1_conf.xml	dst=null	perm=null
2015-03-13 10:07:02,045 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0009_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:07:02,045 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job_1426266260362_0009_1_conf.xml	dst=null	perm=null
2015-03-13 10:07:02,046 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0009_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:07:02,047 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job_1426266260362_0009_1_conf.xml	dst=null	perm=null
2015-03-13 10:07:02,050 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0009_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:02,052 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61529, bytes: 91486, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_634066759_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741928_1104, duration: 263000
2015-03-13 10:07:02,054 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:02,054 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0009_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741937_1113{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:07:02,056 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741937_1113 src: /127.0.0.1:61533 dest: /127.0.0.1:60693
2015-03-13 10:07:02,057 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741937_1113 src: /127.0.0.1:61534 dest: /127.0.0.1:60686
2015-03-13 10:07:02,059 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741937_1113 src: /127.0.0.1:61535 dest: /127.0.0.1:60696
2015-03-13 10:07:02,062 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61535, dest: /127.0.0.1:60696, bytes: 90774, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_634066759_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741937_1113, duration: 2037000
2015-03-13 10:07:02,062 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741937_1113, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:02,063 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741937_1113{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:07:02,063 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61534, dest: /127.0.0.1:60686, bytes: 90774, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_634066759_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741937_1113, duration: 2630000
2015-03-13 10:07:02,063 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741937_1113, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:02,063 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741937_1113{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:07:02,064 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61533, dest: /127.0.0.1:60693, bytes: 90774, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_634066759_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741937_1113, duration: 3474000
2015-03-13 10:07:02,064 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741937_1113, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:02,064 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741937_1113{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:07:02,065 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0009_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_634066759_1
2015-03-13 10:07:02,067 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0009_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:02,069 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0009.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0009.summary	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:02,071 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0009_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0009_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:02,072 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0009-1426266405973-soberoi-%5BE808F612428A4495876D015977ED92F6%2FA1D84621FEBB4086-1426266421982-5-0-SUCCEEDED-default.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0009-1426266405973-soberoi-%5BE808F612428A4495876D015977ED92F6%2FA1D84621FEBB4086-1426266421982-5-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:02,078 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0009_000001 State change from RUNNING to FINISHING
2015-03-13 10:07:02,078 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0009
2015-03-13 10:07:02,078 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0009 State change from RUNNING to REMOVING
2015-03-13 10:07:02,078 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0009
2015-03-13 10:07:02,078 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0009 State change from REMOVING to FINISHING
2015-03-13 10:07:02,931 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:07:02,931 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0009_01_000006
2015-03-13 10:07:02,931 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0009_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:07:02,931 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0009_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:07:02,932 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0009	CONTAINERID=container_1426266260362_0009_01_000006
2015-03-13 10:07:02,932 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0009_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:07:02,932 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:07:02,933 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0009_01_000006, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:02,933 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:02,933 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:07:02,933 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0009_000001 released container container_1426266260362_0009_01_000006 on node: host: 10.1.1.144:60715 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:07:03,058 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:03,088 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741924_1100 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60693 127.0.0.1:60689 
2015-03-13 10:07:03,088 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741925_1101 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60696 127.0.0.1:60693 
2015-03-13 10:07:03,088 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741926_1102 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60686 
2015-03-13 10:07:03,088 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741927_1103 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60686 
2015-03-13 10:07:03,088 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741931_1107 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60693 
2015-03-13 10:07:03,089 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741928_1104 127.0.0.1:60689 127.0.0.1:60693 127.0.0.1:60686 
2015-03-13 10:07:03,089 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009	dst=null	perm=null
2015-03-13 10:07:03,122 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [cogrouping] starting step: (1/2) ...tform/joinsintocogrouplhs
2015-03-13 10:07:03,130 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:07:03,139 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:07:03,142 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs	dst=null	perm=null
2015-03-13 10:07:03,142 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:07:03,143 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:07:03,145 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 10
2015-03-13 10:07:03,146 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010	dst=null	perm=null
2015-03-13 10:07:03,147 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010	dst=null	perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:07:03,148 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010	dst=null	perm=soberoi:supergroup:rwx------
2015-03-13 10:07:03,148 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.jar	dst=null	perm=null
2015-03-13 10:07:03,150 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:07:03,151 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073741938_1114{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:07:03,153 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741938_1114 src: /127.0.0.1:61538 dest: /127.0.0.1:60696
2015-03-13 10:07:03,154 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741938_1114 src: /127.0.0.1:61539 dest: /127.0.0.1:60689
2015-03-13 10:07:03,155 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741938_1114 src: /127.0.0.1:61540 dest: /127.0.0.1:60686
2015-03-13 10:07:03,159 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61540, dest: /127.0.0.1:60686, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741938_1114, duration: 1875000
2015-03-13 10:07:03,159 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741938_1114, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:03,159 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741938_1114{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:07:03,159 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61539, dest: /127.0.0.1:60689, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741938_1114, duration: 2603000
2015-03-13 10:07:03,159 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741938_1114, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:03,160 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741938_1114{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:07:03,160 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61538, dest: /127.0.0.1:60696, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741938_1114, duration: 3361000
2015-03-13 10:07:03,160 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741938_1114, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:03,161 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741938_1114{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:07:03,162 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:07:03,163 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.jar
2015-03-13 10:07:03,163 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.jar	dst=null	perm=null
2015-03-13 10:07:03,164 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:07:03,166 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:07:03,167 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:07:03,168 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:07:03,168 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:07:03,169 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:07:03,170 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:07:03,170 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:07:03,171 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:07:03,171 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:07:03,173 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt	dst=null	perm=null
2015-03-13 10:07:03,173 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:07:03,174 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt	dst=null	perm=null
2015-03-13 10:07:03,175 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt	dst=null	perm=null
2015-03-13 10:07:03,175 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:07:03,176 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt	dst=null	perm=null
2015-03-13 10:07:03,177 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt	dst=null	perm=null
2015-03-13 10:07:03,177 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:07:03,177 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt	dst=null	perm=null
2015-03-13 10:07:03,178 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt	dst=null	perm=null
2015-03-13 10:07:03,178 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:07:03,179 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt	dst=null	perm=null
2015-03-13 10:07:03,180 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:07:03,182 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:07:03,182 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.split
2015-03-13 10:07:03,182 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.split	dst=null	perm=null
2015-03-13 10:07:03,183 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073741939_1115{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:07:03,184 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741939_1115 src: /127.0.0.1:61541 dest: /127.0.0.1:60693
2015-03-13 10:07:03,186 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741939_1115 src: /127.0.0.1:61542 dest: /127.0.0.1:60696
2015-03-13 10:07:03,187 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741939_1115 src: /127.0.0.1:61543 dest: /127.0.0.1:60689
2015-03-13 10:07:03,188 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741939_1115 src: /127.0.0.1:61544 dest: /127.0.0.1:60686
2015-03-13 10:07:03,190 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61544, dest: /127.0.0.1:60686, bytes: 1772, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741939_1115, duration: 1553000
2015-03-13 10:07:03,190 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741939_1115, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:03,191 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741939_1115{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:07:03,191 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61543, dest: /127.0.0.1:60689, bytes: 1772, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741939_1115, duration: 1940000
2015-03-13 10:07:03,191 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741939_1115, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:03,191 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741939_1115{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:07:03,192 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61542, dest: /127.0.0.1:60696, bytes: 1772, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741939_1115, duration: 2448000
2015-03-13 10:07:03,192 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741939_1115, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:03,192 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61541, dest: /127.0.0.1:60693, bytes: 1772, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741939_1115, duration: 3511000
2015-03-13 10:07:03,192 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741939_1115{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:07:03,193 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741939_1115, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:03,193 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741939_1115{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:07:03,197 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:07:03,199 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:07:03,200 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:07:03,201 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073741940_1116{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:07:03,203 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741940_1116 src: /127.0.0.1:61545 dest: /127.0.0.1:60696
2015-03-13 10:07:03,204 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741940_1116 src: /127.0.0.1:61546 dest: /127.0.0.1:60689
2015-03-13 10:07:03,205 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741940_1116 src: /127.0.0.1:61547 dest: /127.0.0.1:60686
2015-03-13 10:07:03,208 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61547, dest: /127.0.0.1:60686, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741940_1116, duration: 1067000
2015-03-13 10:07:03,208 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741940_1116, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:03,208 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741940_1116{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:07:03,209 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61546, dest: /127.0.0.1:60689, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741940_1116, duration: 1605000
2015-03-13 10:07:03,209 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741940_1116, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:03,209 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741940_1116{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:07:03,209 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61545, dest: /127.0.0.1:60696, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741940_1116, duration: 2345000
2015-03-13 10:07:03,210 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741940_1116, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:03,211 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741940_1116{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:07:03,211 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:07:03,212 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:07:03,213 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:07:03,215 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:07:03,216 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:07:03,217 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:07:03,217 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:07:03,234 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073741941_1117{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:07:03,235 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741941_1117 src: /127.0.0.1:61548 dest: /127.0.0.1:60693
2015-03-13 10:07:03,236 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741941_1117 src: /127.0.0.1:61549 dest: /127.0.0.1:60689
2015-03-13 10:07:03,237 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741941_1117 src: /127.0.0.1:61550 dest: /127.0.0.1:60686
2015-03-13 10:07:03,240 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61550, dest: /127.0.0.1:60686, bytes: 100395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741941_1117, duration: 1642000
2015-03-13 10:07:03,240 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741941_1117, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:03,241 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741941_1117{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:07:03,241 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61549, dest: /127.0.0.1:60689, bytes: 100395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741941_1117, duration: 2134000
2015-03-13 10:07:03,241 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741941_1117, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:03,241 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741941_1117{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:07:03,242 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61548, dest: /127.0.0.1:60693, bytes: 100395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741941_1117, duration: 2814000
2015-03-13 10:07:03,242 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741941_1117, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:03,243 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741941_1117{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:07:03,244 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:07:03,245 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0010
2015-03-13 10:07:03,245 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010	dst=null	perm=null
2015-03-13 10:07:03,246 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.xml	dst=null	perm=null
2015-03-13 10:07:03,247 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.xml	dst=null	perm=null
2015-03-13 10:07:03,248 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.jar	dst=null	perm=null
2015-03-13 10:07:03,249 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.jar	dst=null	perm=null
2015-03-13 10:07:03,249 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.split	dst=null	perm=null
2015-03-13 10:07:03,250 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.split	dst=null	perm=null
2015-03-13 10:07:03,250 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:07:03,251 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:07:03,253 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:07:03,254 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:07:03,255 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:07:03,255 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:07:03,256 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:07:03,257 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:07:03,259 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 10 submitted by user soberoi
2015-03-13 10:07:03,259 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0010
2015-03-13 10:07:03,259 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	IP=10.1.1.144	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1426266260362_0010
2015-03-13 10:07:03,259 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0010
2015-03-13 10:07:03,259 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0010 State change from NEW to NEW_SAVING
2015-03-13 10:07:03,259 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0010 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:07:03,259 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0010_000001
2015-03-13 10:07:03,260 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0010_000001 State change from NEW to SUBMITTED
2015-03-13 10:07:03,260 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0010 from user: soberoi activated in queue: default
2015-03-13 10:07:03,260 INFO  capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0010 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:07:03,260 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0010 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:07:03,260 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0010 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:07:03,260 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0010_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:07:03,260 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0010_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:07:03,262 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0010 State change from SUBMITTED to ACCEPTED
2015-03-13 10:07:03,263 INFO  mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0010/
2015-03-13 10:07:03,263 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [cogrouping] submitted hadoop job: job_1426266260362_0010
2015-03-13 10:07:03,263 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [cogrouping] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0010/
2015-03-13 10:07:03,761 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60686 to replicate blk_1073741938_1114 to datanode(s) 127.0.0.1:60693
2015-03-13 10:07:03,761 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073741924_1100, blk_1073741925_1101, blk_1073741928_1104, blk_1073741931_1107]
2015-03-13 10:07:03,761 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073741924_1100, blk_1073741925_1101, blk_1073741926_1102, blk_1073741927_1103, blk_1073741928_1104, blk_1073741931_1107]
2015-03-13 10:07:03,850 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0010_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:07:03,850 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0010	CONTAINERID=container_1426266260362_0010_01_000001
2015-03-13 10:07:03,850 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0010_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:07:03,850 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0010 container=Container: [ContainerId: container_1426266260362_0010_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0010_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:03,850 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:07:03,850 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0010_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:07:03,851 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:03,852 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0010 AttemptId: appattempt_1426266260362_0010_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0010_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ]
2015-03-13 10:07:03,852 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0010_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:07:03,852 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0010_000001
2015-03-13 10:07:03,852 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0010_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:07:03,852 INFO  amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0010_000001
2015-03-13 10:07:03,853 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0010_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] for AM appattempt_1426266260362_0010_000001
2015-03-13 10:07:03,853 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0010_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-03-13 10:07:03,855 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0010_000001 (auth:SIMPLE)
2015-03-13 10:07:03,856 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0010_01_000001 by user soberoi
2015-03-13 10:07:03,857 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0010
2015-03-13 10:07:03,857 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0010	CONTAINERID=container_1426266260362_0010_01_000001
2015-03-13 10:07:03,857 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0010 transitioned from NEW to INITING
2015-03-13 10:07:03,857 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0010_01_000001 to application application_1426266260362_0010
2015-03-13 10:07:03,857 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0010 transitioned from INITING to RUNNING
2015-03-13 10:07:03,857 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0010_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] for AM appattempt_1426266260362_0010_000001
2015-03-13 10:07:03,858 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0010_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:07:03,858 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:07:03,858 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0010
2015-03-13 10:07:03,858 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:07:03,858 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:07:03,858 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:07:03,858 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:07:03,859 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0010_01_000001
2015-03-13 10:07:03,867 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0010_01_000001.tokens. Credentials list: 
2015-03-13 10:07:03,882 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:07:03,950 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0010_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000001.tokens
2015-03-13 10:07:03,950 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0010 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0010
2015-03-13 10:07:04,010 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.jar	dst=null	perm=null
2015-03-13 10:07:04,011 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.jar	dst=null	perm=null
2015-03-13 10:07:04,011 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.jar	dst=null	perm=null
2015-03-13 10:07:04,018 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61554, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1107403650_5504, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741938_1114, duration: 475000
2015-03-13 10:07:04,035 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:07:04,053 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:07:04,053 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:07:04,054 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:07:04,060 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61555, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1107403650_5504, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741940_1116, duration: 177000
2015-03-13 10:07:04,062 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:04,073 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:07:04,089 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.split	dst=null	perm=null
2015-03-13 10:07:04,090 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.split	dst=null	perm=null
2015-03-13 10:07:04,090 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.split	dst=null	perm=null
2015-03-13 10:07:04,096 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61555, bytes: 1788, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1107403650_5504, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741939_1115, duration: 154000
2015-03-13 10:07:04,108 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:07:04,123 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.xml	dst=null	perm=null
2015-03-13 10:07:04,124 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.xml	dst=null	perm=null
2015-03-13 10:07:04,125 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.xml	dst=null	perm=null
2015-03-13 10:07:04,130 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61555, bytes: 101183, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1107403650_5504, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741941_1117, duration: 282000
2015-03-13 10:07:04,143 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:07:04,143 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:07:04,168 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:07:04,168 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:04,236 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000001/default_container_executor.sh]
2015-03-13 10:07:04,416 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741924_1100 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741924 for deletion
2015-03-13 10:07:04,416 INFO  datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-1907321454-10.1.1.144-60686-1426266259166, infoPort=60687, ipcPort=60688, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073741938_1114 to 127.0.0.1:60693 
2015-03-13 10:07:04,416 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741925_1101 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741925 for deletion
2015-03-13 10:07:04,416 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741924_1100 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741924
2015-03-13 10:07:04,417 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741924_1100 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741924 for deletion
2015-03-13 10:07:04,417 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741925_1101 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741925 for deletion
2015-03-13 10:07:04,417 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741926_1102 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741926 for deletion
2015-03-13 10:07:04,417 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741927_1103 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741927 for deletion
2015-03-13 10:07:04,417 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741924_1100 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741924
2015-03-13 10:07:04,416 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741928_1104 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741928 for deletion
2015-03-13 10:07:04,417 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741926_1102 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741926
2015-03-13 10:07:04,417 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741925_1101 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741925
2015-03-13 10:07:04,418 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741927_1103 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741927
2015-03-13 10:07:04,417 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741928_1104 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741928 for deletion
2015-03-13 10:07:04,418 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741928_1104 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741928
2015-03-13 10:07:04,417 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741925_1101 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741925
2015-03-13 10:07:04,418 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741928_1104 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741928
2015-03-13 10:07:04,418 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741931_1107 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741931 for deletion
2015-03-13 10:07:04,418 INFO  datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073741938_1114 (numBytes=254067) to /127.0.0.1:60693
2015-03-13 10:07:04,419 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741931_1107 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741931
2015-03-13 10:07:04,417 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741931_1107 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741931 for deletion
2015-03-13 10:07:04,418 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741938_1114 src: /127.0.0.1:61556 dest: /127.0.0.1:60693
2015-03-13 10:07:04,419 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741931_1107 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741931
2015-03-13 10:07:04,420 INFO  datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073741938_1114 src: /127.0.0.1:61556 dest: /127.0.0.1:60693 of size 254067
2015-03-13 10:07:04,421 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741938_1114 size 254067
2015-03-13 10:07:04,854 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:04,855 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0010_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:07:05,063 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:05,815 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:07:05,837 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/COMMIT_STARTED	dst=null	perm=null
2015-03-13 10:07:05,838 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/COMMIT_SUCCESS	dst=null	perm=null
2015-03-13 10:07:05,840 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/COMMIT_FAIL	dst=null	perm=null
2015-03-13 10:07:05,857 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:05,892 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010	dst=null	perm=null
2015-03-13 10:07:05,893 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:07:05,894 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:07:06,030 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741937_1113
2015-03-13 10:07:06,031 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741939_1115
2015-03-13 10:07:06,031 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741936_1112
2015-03-13 10:07:06,032 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741931_1107
2015-03-13 10:07:06,066 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:06,180 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:07:06,187 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:07:06,221 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741940_1116
2015-03-13 10:07:06,222 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741938_1114
2015-03-13 10:07:06,222 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741935_1111
2015-03-13 10:07:06,222 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741939_1115
2015-03-13 10:07:06,234 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741938_1114
2015-03-13 10:07:06,235 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741941_1117
2015-03-13 10:07:06,243 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61558, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1675890031_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741940_1116, duration: 173000
2015-03-13 10:07:06,400 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741935_1111
2015-03-13 10:07:06,401 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741940_1116
2015-03-13 10:07:06,402 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741938_1114
2015-03-13 10:07:06,402 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741939_1115
2015-03-13 10:07:06,402 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741938_1114
2015-03-13 10:07:06,403 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741940_1116
2015-03-13 10:07:06,403 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741939_1115
2015-03-13 10:07:06,421 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741936_1112
2015-03-13 10:07:06,422 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741941_1117
2015-03-13 10:07:06,604 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741941_1117
2015-03-13 10:07:06,604 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741937_1113
2015-03-13 10:07:06,605 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741936_1112
2015-03-13 10:07:06,605 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741937_1113
2015-03-13 10:07:06,606 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741935_1111
2015-03-13 10:07:06,762 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073741924_1100, blk_1073741925_1101, blk_1073741926_1102, blk_1073741927_1103]
2015-03-13 10:07:06,762 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073741924_1100, blk_1073741925_1101, blk_1073741926_1102, blk_1073741927_1103, blk_1073741928_1104, blk_1073741931_1107]
2015-03-13 10:07:06,859 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:07,013 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0010_000001 (auth:SIMPLE)
2015-03-13 10:07:07,014 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0010_000001
2015-03-13 10:07:07,014 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi	IP=10.1.1.144	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1426266260362_0010	APPATTEMPTID=appattempt_1426266260362_0010_000001
2015-03-13 10:07:07,015 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0010_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:07:07,015 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0010 State change from ACCEPTED to RUNNING
2015-03-13 10:07:07,034 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job_1426266260362_0010_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:07,039 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:07:07,071 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:07,102 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job_1426266260362_0010_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:07,220 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job_1426266260362_0010_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073741942_1118{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:07:07,266 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741942_1118 src: /127.0.0.1:61564 dest: /127.0.0.1:60696
2015-03-13 10:07:07,267 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741942_1118 src: /127.0.0.1:61565 dest: /127.0.0.1:60686
2015-03-13 10:07:07,269 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741942_1118 src: /127.0.0.1:61566 dest: /127.0.0.1:60689
2015-03-13 10:07:07,277 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61566, dest: /127.0.0.1:60689, bytes: 92709, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1675890031_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741942_1118, duration: 6080000
2015-03-13 10:07:07,277 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741942_1118, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:07,278 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61565, dest: /127.0.0.1:60686, bytes: 92709, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1675890031_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741942_1118, duration: 7151000
2015-03-13 10:07:07,278 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741942_1118, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:07,279 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741942_1118{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:07,280 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61564, dest: /127.0.0.1:60696, bytes: 92709, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1675890031_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741942_1118, duration: 8801000
2015-03-13 10:07:07,280 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741942_1118, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:07,281 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741942_1118{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:07,282 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741942_1118{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:07,285 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job_1426266260362_0010_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-1675890031_1
2015-03-13 10:07:07,581 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741924_1100 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741924 for deletion
2015-03-13 10:07:07,581 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741925_1101 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741925 for deletion
2015-03-13 10:07:07,581 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741926_1102 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741926 for deletion
2015-03-13 10:07:07,581 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741927_1103 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741927 for deletion
2015-03-13 10:07:07,581 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741928_1104 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741928 for deletion
2015-03-13 10:07:07,581 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741931_1107 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741931 for deletion
2015-03-13 10:07:07,581 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741924_1100 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741924
2015-03-13 10:07:07,582 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741925_1101 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741925
2015-03-13 10:07:07,582 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741926_1102 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741926
2015-03-13 10:07:07,582 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741927_1103 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741927
2015-03-13 10:07:07,582 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741928_1104 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741928
2015-03-13 10:07:07,582 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741931_1107 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741931
2015-03-13 10:07:07,771 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741924_1100 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741924 for deletion
2015-03-13 10:07:07,771 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741925_1101 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741925 for deletion
2015-03-13 10:07:07,771 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741926_1102 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741926 for deletion
2015-03-13 10:07:07,771 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741924_1100 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741924
2015-03-13 10:07:07,771 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741927_1103 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741927 for deletion
2015-03-13 10:07:07,771 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741925_1101 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741925
2015-03-13 10:07:07,772 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741926_1102 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741926
2015-03-13 10:07:07,772 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741927_1103 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741927
2015-03-13 10:07:07,860 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:08,073 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:08,074 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0010_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:07:08,074 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0010	CONTAINERID=container_1426266260362_0010_01_000002
2015-03-13 10:07:08,074 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0010_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:07:08,075 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0010 container=Container: [ContainerId: container_1426266260362_0010_01_000002, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0010_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:08,075 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:07:08,075 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:08,076 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0010_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:07:08,076 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0010	CONTAINERID=container_1426266260362_0010_01_000003
2015-03-13 10:07:08,076 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0010_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available
2015-03-13 10:07:08,076 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0010 container=Container: [ContainerId: container_1426266260362_0010_01_000003, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0010_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:08,076 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:07:08,077 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:08,223 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0009_01_000001 succeeded 
2015-03-13 10:07:08,224 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:07:08,224 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0009_01_000001
2015-03-13 10:07:08,232 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000001
2015-03-13 10:07:08,232 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000001
2015-03-13 10:07:08,232 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000001
2015-03-13 10:07:08,232 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000001
2015-03-13 10:07:08,232 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0009	CONTAINERID=container_1426266260362_0009_01_000001
2015-03-13 10:07:08,233 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:07:08,233 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0009_01_000001 from application application_1426266260362_0009
2015-03-13 10:07:08,233 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:08,233 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0009
2015-03-13 10:07:08,862 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:08,863 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0010_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:07:08,863 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0010	CONTAINERID=container_1426266260362_0010_01_000004
2015-03-13 10:07:08,863 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0010_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:07:08,863 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0010 container=Container: [ContainerId: container_1426266260362_0010_01_000004, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0010_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:08,864 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:07:08,864 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:08,864 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0010_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:07:08,865 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0010	CONTAINERID=container_1426266260362_0010_01_000005
2015-03-13 10:07:08,865 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0010_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available
2015-03-13 10:07:08,865 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0010 container=Container: [ContainerId: container_1426266260362_0010_01_000005, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0010_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:08,865 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:07:08,865 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:08,949 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0010_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:07:08,950 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0010	CONTAINERID=container_1426266260362_0010_01_000006
2015-03-13 10:07:08,950 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0010_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:07:08,950 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0010 container=Container: [ContainerId: container_1426266260362_0010_01_000006, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0010_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:08,950 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7
2015-03-13 10:07:08,950 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:09,049 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0010_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:07:09,049 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0010_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:07:09,049 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0010_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:07:09,049 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0010_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:07:09,049 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0010_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:07:09,075 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:07:09,075 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.jar	dst=null	perm=null
2015-03-13 10:07:09,075 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0009_01_000001
2015-03-13 10:07:09,075 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0009_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:07:09,075 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0009_000001
2015-03-13 10:07:09,075 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0009_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:07:09,076 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0009	CONTAINERID=container_1426266260362_0009_01_000001
2015-03-13 10:07:09,076 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0009_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60719, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:07:09,076 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0009_000001 State change from FINISHING to FINISHED
2015-03-13 10:07:09,076 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:7168, vCores:6> numContainers=6 user=soberoi user-resources=<memory:7168, vCores:6>
2015-03-13 10:07:09,076 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0009 State change from FINISHING to FINISHED
2015-03-13 10:07:09,076 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0009_01_000001, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:09,076 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1426266260362_0009
2015-03-13 10:07:09,076 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.jar	dst=null	perm=null
2015-03-13 10:07:09,076 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0009,name=[E808F612428A4495876D015977ED92F6/A1D84621FEBB4086ADCD0292D5B55714] cogrouping/(2/2),user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0009/jobhistory/job/job_1426266260362_0009,appMasterHost=Edinburgh.local,startTime=1426266405973,finishTime=1426266422078,finalStatus=SUCCEEDED
2015-03-13 10:07:09,076 INFO  amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0009_000001
2015-03-13 10:07:09,076 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:09,077 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6
2015-03-13 10:07:09,077 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0009_000001 released container container_1426266260362_0009_01_000001 on node: host: 10.1.1.144:60719 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:07:09,077 INFO  capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0009_000001 is done. finalState=FINISHED
2015-03-13 10:07:09,077 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0009 requests cleared
2015-03-13 10:07:09,077 INFO  capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0009 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:07:09,077 INFO  capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0009 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:07:09,081 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0009_000001 (auth:SIMPLE)
2015-03-13 10:07:09,082 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0009_01_000001
2015-03-13 10:07:09,087 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.xml	dst=null	perm=null
2015-03-13 10:07:09,088 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.xml	dst=null	perm=null
2015-03-13 10:07:09,090 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:07:09,091 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:07:09,096 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:07:09,098 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:07:09,099 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:07:09,100 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:07:09,178 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0010_000001 (auth:SIMPLE)
2015-03-13 10:07:09,178 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0010_000001 (auth:SIMPLE)
2015-03-13 10:07:09,178 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0010_000001 (auth:SIMPLE)
2015-03-13 10:07:09,181 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0010_01_000003 by user soberoi
2015-03-13 10:07:09,181 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0010
2015-03-13 10:07:09,181 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0010	CONTAINERID=container_1426266260362_0010_01_000003
2015-03-13 10:07:09,181 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0010_01_000005 by user soberoi
2015-03-13 10:07:09,182 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0010 transitioned from NEW to INITING
2015-03-13 10:07:09,182 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0010	CONTAINERID=container_1426266260362_0010_01_000005
2015-03-13 10:07:09,182 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0010_01_000002 by user soberoi
2015-03-13 10:07:09,182 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0010	CONTAINERID=container_1426266260362_0010_01_000002
2015-03-13 10:07:09,183 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0010_01_000006 by user soberoi
2015-03-13 10:07:09,183 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0010
2015-03-13 10:07:09,182 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0010_01_000005 to application application_1426266260362_0010
2015-03-13 10:07:09,183 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0010	CONTAINERID=container_1426266260362_0010_01_000006
2015-03-13 10:07:09,183 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:07:09,183 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0010
2015-03-13 10:07:09,182 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0010_01_000003 to application application_1426266260362_0010
2015-03-13 10:07:09,183 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0010_01_000002 to application application_1426266260362_0010
2015-03-13 10:07:09,183 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0010
2015-03-13 10:07:09,184 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:07:09,183 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0010 transitioned from NEW to INITING
2015-03-13 10:07:09,184 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0010
2015-03-13 10:07:09,184 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0010 transitioned from INITING to RUNNING
2015-03-13 10:07:09,184 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:07:09,184 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:07:09,184 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0010_01_000006 to application application_1426266260362_0010
2015-03-13 10:07:09,185 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0010 transitioned from INITING to RUNNING
2015-03-13 10:07:09,185 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:07:09,185 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0010
2015-03-13 10:07:09,185 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0010
2015-03-13 10:07:09,185 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:07:09,184 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:07:09,185 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0010
2015-03-13 10:07:09,185 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0010
2015-03-13 10:07:09,185 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:07:09,185 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0010
2015-03-13 10:07:09,185 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0010
2015-03-13 10:07:09,186 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:07:09,186 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:07:09,186 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0010_01_000006
2015-03-13 10:07:09,185 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:07:09,186 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:07:09,186 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0010
2015-03-13 10:07:09,187 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0010
2015-03-13 10:07:09,187 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:07:09,187 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0010
2015-03-13 10:07:09,187 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0010_01_000002
2015-03-13 10:07:09,187 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0010_01_000004 by user soberoi
2015-03-13 10:07:09,187 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0010	CONTAINERID=container_1426266260362_0010_01_000004
2015-03-13 10:07:09,188 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0010_01_000004 to application application_1426266260362_0010
2015-03-13 10:07:09,188 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:07:09,188 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0010
2015-03-13 10:07:09,188 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0010
2015-03-13 10:07:09,188 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:07:09,188 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0010
2015-03-13 10:07:09,189 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:07:09,189 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0010_01_000003
2015-03-13 10:07:09,210 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0010_01_000006.tokens. Credentials list: 
2015-03-13 10:07:09,211 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1426266260362_0010_01_000002.tokens. Credentials list: 
2015-03-13 10:07:09,213 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1426266260362_0010_01_000003.tokens. Credentials list: 
2015-03-13 10:07:09,234 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:07:09,234 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:09,239 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:07:09,239 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:09,240 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:07:09,240 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:07:09,355 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1426266260362_0010_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000002.tokens
2015-03-13 10:07:09,356 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0010 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0010
2015-03-13 10:07:09,357 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0010_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000006.tokens
2015-03-13 10:07:09,357 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0010 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0010
2015-03-13 10:07:09,358 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000004/default_container_executor.sh]
2015-03-13 10:07:09,365 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000005/default_container_executor.sh]
2015-03-13 10:07:09,464 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.jar	dst=null	perm=null
2015-03-13 10:07:09,465 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.jar	dst=null	perm=null
2015-03-13 10:07:09,466 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.jar	dst=null	perm=null
2015-03-13 10:07:09,467 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.jar	dst=null	perm=null
2015-03-13 10:07:09,467 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.jar	dst=null	perm=null
2015-03-13 10:07:09,468 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.jar	dst=null	perm=null
2015-03-13 10:07:09,477 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61575, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_684912219_5690, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741938_1114, duration: 511000
2015-03-13 10:07:09,477 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61576, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1423446636_5689, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741938_1114, duration: 590000
2015-03-13 10:07:09,505 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:07:09,506 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:07:09,536 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.xml	dst=null	perm=null
2015-03-13 10:07:09,537 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.xml	dst=null	perm=null
2015-03-13 10:07:09,538 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.xml	dst=null	perm=null
2015-03-13 10:07:09,541 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.xml	dst=null	perm=null
2015-03-13 10:07:09,542 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.xml	dst=null	perm=null
2015-03-13 10:07:09,543 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.xml	dst=null	perm=null
2015-03-13 10:07:09,549 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61577, bytes: 101183, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_684912219_5690, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741941_1117, duration: 267000
2015-03-13 10:07:09,556 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61576, bytes: 101183, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1423446636_5689, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741941_1117, duration: 264000
2015-03-13 10:07:09,569 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:07:09,569 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:07:09,569 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:07:09,575 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:07:09,575 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:07:09,622 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:07:09,622 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:09,630 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:07:09,630 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:07:09,630 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:09,630 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:09,771 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000003/default_container_executor.sh]
2015-03-13 10:07:09,771 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000006/default_container_executor.sh]
2015-03-13 10:07:09,771 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000002/default_container_executor.sh]
2015-03-13 10:07:09,864 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:09,864 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:09,864 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:09,865 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0009 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:07:09,865 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0010_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:07:09,865 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0010_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:07:09,865 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0009
2015-03-13 10:07:09,865 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0009
2015-03-13 10:07:09,865 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0009 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:07:09,865 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0009, with delay of 10800 seconds
2015-03-13 10:07:09,866 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0009
2015-03-13 10:07:09,865 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0009
2015-03-13 10:07:09,865 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0009
2015-03-13 10:07:09,950 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:09,951 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0009 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:07:09,951 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0010_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:07:09,951 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0009
2015-03-13 10:07:09,951 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0009
2015-03-13 10:07:09,951 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0009
2015-03-13 10:07:09,951 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0009
2015-03-13 10:07:09,951 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0009 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:07:09,951 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0009, with delay of 10800 seconds
2015-03-13 10:07:09,952 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0009
2015-03-13 10:07:10,065 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:07:10,077 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:10,077 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:10,077 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0009 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:07:10,077 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0010_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:07:10,077 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0010_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:07:10,078 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0009
2015-03-13 10:07:10,078 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0009
2015-03-13 10:07:10,078 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0009
2015-03-13 10:07:10,077 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0009
2015-03-13 10:07:10,078 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0009 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:07:10,078 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0009, with delay of 10800 seconds
2015-03-13 10:07:10,078 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0009
2015-03-13 10:07:10,601 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:07:10,741 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1426266260362_0010_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000003.tokens
2015-03-13 10:07:10,741 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0010 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0010
2015-03-13 10:07:10,870 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:10,870 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:10,870 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:10,955 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:11,083 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:11,083 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:11,431 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741942_1118
2015-03-13 10:07:11,607 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741942_1118
2015-03-13 10:07:11,609 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741942_1118
2015-03-13 10:07:11,876 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:11,876 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:11,876 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:11,956 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:12,086 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:12,086 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:12,881 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:12,881 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:12,881 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:12,959 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:13,091 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:13,092 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:13,887 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:13,887 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:13,887 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:13,961 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:14,096 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:14,096 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:14,892 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:14,892 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:14,893 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:14,962 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:15,101 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:15,101 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:15,898 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:15,898 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:15,898 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:15,965 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:16,102 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:16,102 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:16,901 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:16,902 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:16,902 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:16,970 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:17,108 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:17,108 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:17,215 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.split	dst=null	perm=null
2015-03-13 10:07:17,311 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.split	dst=null	perm=null
2015-03-13 10:07:17,397 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61586, bytes: 756, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0010_m_000003_0_411470128_1, offset: 1024, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741939_1115, duration: 161000
2015-03-13 10:07:17,458 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.split	dst=null	perm=null
2015-03-13 10:07:17,543 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61587, bytes: 1788, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0010_m_000000_0_483516617_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741939_1115, duration: 150000
2015-03-13 10:07:17,563 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.split	dst=null	perm=null
2015-03-13 10:07:17,644 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.split	dst=null	perm=null
2015-03-13 10:07:17,658 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt	dst=null	perm=null
2015-03-13 10:07:17,662 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61592, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0010_m_000003_0_411470128_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741913_1089, duration: 155000
2015-03-13 10:07:17,691 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61591, bytes: 1272, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0010_m_000002_0_816705034_1, offset: 512, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741939_1115, duration: 172000
2015-03-13 10:07:17,716 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61593, bytes: 1788, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0010_m_000001_0_-244765215_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741939_1115, duration: 157000
2015-03-13 10:07:17,717 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt	dst=null	perm=null
2015-03-13 10:07:17,782 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61594, bytes: 756, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0010_m_000004_0_730506202_1, offset: 1024, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741939_1115, duration: 159000
2015-03-13 10:07:17,805 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt	dst=null	perm=null
2015-03-13 10:07:17,847 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt	dst=null	perm=null
2015-03-13 10:07:17,851 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61595, bytes: 56, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0010_m_000001_0_-244765215_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741912_1088, duration: 142000
2015-03-13 10:07:17,906 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:17,906 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:17,907 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:17,911 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt	dst=null	perm=null
2015-03-13 10:07:17,915 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61594, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0010_m_000004_0_730506202_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741913_1089, duration: 166000
2015-03-13 10:07:17,973 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:18,109 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:18,109 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:18,191 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs/_temporary/1/_temporary/attempt_1426266260362_0010_m_000003_0	dst=null	perm=null
2015-03-13 10:07:18,221 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0010_01_000005
2015-03-13 10:07:18,221 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0010	CONTAINERID=container_1426266260362_0010_01_000005
2015-03-13 10:07:18,221 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:07:18,222 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0010_01_000005
2015-03-13 10:07:18,222 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:18,222 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:18,222 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:07:18,234 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0010_01_000005 is : 143
2015-03-13 10:07:18,236 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job_1426266260362_0010_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073741943_1119{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:07:18,237 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741943_1119 src: /127.0.0.1:61596 dest: /127.0.0.1:60689
2015-03-13 10:07:18,239 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741943_1119 src: /127.0.0.1:61597 dest: /127.0.0.1:60696
2015-03-13 10:07:18,240 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741943_1119 src: /127.0.0.1:61598 dest: /127.0.0.1:60686
2015-03-13 10:07:18,244 INFO  hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job_1426266260362_0010_1.jhist for DFSClient_NONMAPREDUCE_-1675890031_1
2015-03-13 10:07:18,247 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:07:18,248 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0010	CONTAINERID=container_1426266260362_0010_01_000005
2015-03-13 10:07:18,248 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:07:18,248 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0010_01_000005 from application application_1426266260362_0010
2015-03-13 10:07:18,248 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:18,248 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000005
2015-03-13 10:07:18,248 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000005
2015-03-13 10:07:18,249 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000005
2015-03-13 10:07:18,248 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000005
2015-03-13 10:07:18,248 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0010
2015-03-13 10:07:18,279 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177	dst=null	perm=null
2015-03-13 10:07:18,288 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177	dst=null	perm=null
2015-03-13 10:07:18,291 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177	dst=null	perm=null
2015-03-13 10:07:18,325 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61591, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0010_m_000002_0_816705034_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741913_1089, duration: 160000
2015-03-13 10:07:18,345 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/part-00000	dst=null	perm=null
2015-03-13 10:07:18,346 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/part-00000	dst=null	perm=null
2015-03-13 10:07:18,349 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61599, bytes: 142, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0010_m_000000_0_483516617_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741929_1105, duration: 154000
2015-03-13 10:07:18,360 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/part-00001	dst=null	perm=null
2015-03-13 10:07:18,361 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/part-00001	dst=null	perm=null
2015-03-13 10:07:18,364 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61600, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0010_m_000000_0_483516617_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741933_1109, duration: 158000
2015-03-13 10:07:18,366 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/part-00002	dst=null	perm=null
2015-03-13 10:07:18,367 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/part-00002	dst=null	perm=null
2015-03-13 10:07:18,370 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61599, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0010_m_000000_0_483516617_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741932_1108, duration: 168000
2015-03-13 10:07:18,372 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/part-00003	dst=null	perm=null
2015-03-13 10:07:18,372 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs/_temporary/1/_temporary/attempt_1426266260362_0010_m_000002_0	dst=null	perm=null
2015-03-13 10:07:18,373 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/part-00003	dst=null	perm=null
2015-03-13 10:07:18,375 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61600, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0010_m_000000_0_483516617_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741930_1106, duration: 125000
2015-03-13 10:07:18,378 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/part-00004	dst=null	perm=null
2015-03-13 10:07:18,379 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/part-00004	dst=null	perm=null
2015-03-13 10:07:18,381 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61587, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0010_m_000000_0_483516617_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741934_1110, duration: 157000
2015-03-13 10:07:18,385 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61600, bytes: 56, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0010_m_000000_0_483516617_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741912_1088, duration: 159000
2015-03-13 10:07:18,396 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0010_01_000004
2015-03-13 10:07:18,396 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0010	CONTAINERID=container_1426266260362_0010_01_000004
2015-03-13 10:07:18,396 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:07:18,396 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:18,396 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0010_01_000004
2015-03-13 10:07:18,397 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:07:18,397 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:07:18,397 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0010_01_000005
2015-03-13 10:07:18,397 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0010_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:07:18,397 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0010_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:07:18,397 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0010	CONTAINERID=container_1426266260362_0010_01_000005
2015-03-13 10:07:18,398 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0010_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available, release resources=true
2015-03-13 10:07:18,398 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:07:18,398 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0010_01_000005, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:18,398 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:18,398 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:07:18,398 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0010_000001 released container container_1426266260362_0010_01_000005 on node: host: 10.1.1.144:60711 #containers=2 available=1024 used=3072 with event: FINISHED
2015-03-13 10:07:18,410 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0010_01_000004 is : 143
2015-03-13 10:07:18,422 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:07:18,423 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000004
2015-03-13 10:07:18,423 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000004
2015-03-13 10:07:18,423 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000004
2015-03-13 10:07:18,423 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000004
2015-03-13 10:07:18,423 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0010	CONTAINERID=container_1426266260362_0010_01_000004
2015-03-13 10:07:18,424 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:07:18,424 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0010_01_000004 from application application_1426266260362_0010
2015-03-13 10:07:18,424 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:18,424 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0010
2015-03-13 10:07:18,427 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs/_temporary/1/_temporary/attempt_1426266260362_0010_m_000000_0	dst=null	perm=null
2015-03-13 10:07:18,437 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0010_01_000002
2015-03-13 10:07:18,437 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0010	CONTAINERID=container_1426266260362_0010_01_000002
2015-03-13 10:07:18,437 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:07:18,437 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0010_01_000002
2015-03-13 10:07:18,437 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:07:18,437 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:18,439 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177	dst=null	perm=null
2015-03-13 10:07:18,450 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0010_01_000002 is : 143
2015-03-13 10:07:18,459 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177	dst=null	perm=null
2015-03-13 10:07:18,461 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177	dst=null	perm=null
2015-03-13 10:07:18,462 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:07:18,463 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0010	CONTAINERID=container_1426266260362_0010_01_000002
2015-03-13 10:07:18,463 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:07:18,463 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0010_01_000002 from application application_1426266260362_0010
2015-03-13 10:07:18,463 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000002
2015-03-13 10:07:18,465 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:18,464 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000002
2015-03-13 10:07:18,465 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0010
2015-03-13 10:07:18,464 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000002
2015-03-13 10:07:18,463 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000002
2015-03-13 10:07:18,495 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs/_temporary/1/_temporary/attempt_1426266260362_0010_m_000004_0	dst=null	perm=null
2015-03-13 10:07:18,503 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/part-00000	dst=null	perm=null
2015-03-13 10:07:18,505 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/part-00000	dst=null	perm=null
2015-03-13 10:07:18,508 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61601, bytes: 142, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0010_m_000001_0_-244765215_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741929_1105, duration: 182000
2015-03-13 10:07:18,511 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0010_01_000006
2015-03-13 10:07:18,511 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0010	CONTAINERID=container_1426266260362_0010_01_000006
2015-03-13 10:07:18,511 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:07:18,511 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0010_01_000006
2015-03-13 10:07:18,512 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:07:18,521 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/part-00001	dst=null	perm=null
2015-03-13 10:07:18,523 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/part-00001	dst=null	perm=null
2015-03-13 10:07:18,523 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0010_01_000006 is : 143
2015-03-13 10:07:18,527 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61601, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0010_m_000001_0_-244765215_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741933_1109, duration: 169000
2015-03-13 10:07:18,535 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/part-00002	dst=null	perm=null
2015-03-13 10:07:18,536 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:07:18,536 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/part-00002	dst=null	perm=null
2015-03-13 10:07:18,537 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000006
2015-03-13 10:07:18,537 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000006
2015-03-13 10:07:18,537 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000006
2015-03-13 10:07:18,538 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0010	CONTAINERID=container_1426266260362_0010_01_000006
2015-03-13 10:07:18,538 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:07:18,538 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0010_01_000006 from application application_1426266260362_0010
2015-03-13 10:07:18,538 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:18,538 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0010
2015-03-13 10:07:18,538 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000006
2015-03-13 10:07:18,541 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61593, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0010_m_000001_0_-244765215_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741932_1108, duration: 172000
2015-03-13 10:07:18,543 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/part-00003	dst=null	perm=null
2015-03-13 10:07:18,545 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/part-00003	dst=null	perm=null
2015-03-13 10:07:18,547 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61602, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0010_m_000001_0_-244765215_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741930_1106, duration: 169000
2015-03-13 10:07:18,549 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/part-00004	dst=null	perm=null
2015-03-13 10:07:18,551 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/part-00004	dst=null	perm=null
2015-03-13 10:07:18,554 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61603, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0010_m_000001_0_-244765215_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741934_1110, duration: 127000
2015-03-13 10:07:18,577 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs/_temporary/1/_temporary/attempt_1426266260362_0010_m_000001_0	dst=null	perm=null
2015-03-13 10:07:18,584 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0010_01_000003
2015-03-13 10:07:18,584 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0010	CONTAINERID=container_1426266260362_0010_01_000003
2015-03-13 10:07:18,585 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:07:18,585 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0010_01_000003
2015-03-13 10:07:18,585 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:07:18,585 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0010_01_000002
2015-03-13 10:07:18,585 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:07:18,586 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0010_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:07:18,586 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0010_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:07:18,586 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0010	CONTAINERID=container_1426266260362_0010_01_000002
2015-03-13 10:07:18,586 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0010_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:07:18,586 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:07:18,586 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0010_01_000002, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:18,586 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:18,586 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:07:18,587 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0010_000001 released container container_1426266260362_0010_01_000002 on node: host: 10.1.1.144:60719 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:07:18,594 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0010_01_000003 is : 143
2015-03-13 10:07:18,604 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:07:18,604 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000003
2015-03-13 10:07:18,605 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000003
2015-03-13 10:07:18,605 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000003
2015-03-13 10:07:18,605 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000003
2015-03-13 10:07:18,605 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0010	CONTAINERID=container_1426266260362_0010_01_000003
2015-03-13 10:07:18,605 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:07:18,605 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0010_01_000003 from application application_1426266260362_0010
2015-03-13 10:07:18,606 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:18,606 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0010
2015-03-13 10:07:19,401 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:19,402 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:07:19,402 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0010_01_000004
2015-03-13 10:07:19,402 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0010_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:07:19,403 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0010_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:07:19,403 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0010	CONTAINERID=container_1426266260362_0010_01_000004
2015-03-13 10:07:19,403 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0010_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:07:19,403 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:07:19,403 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0010_01_000004, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:19,404 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:19,404 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:07:19,404 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0010_000001 released container container_1426266260362_0010_01_000004 on node: host: 10.1.1.144:60711 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:07:19,517 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:07:19,517 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0010_01_000006
2015-03-13 10:07:19,518 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0010_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:07:19,518 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0010_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:07:19,518 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0010	CONTAINERID=container_1426266260362_0010_01_000006
2015-03-13 10:07:19,518 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0010_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:07:19,519 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:07:19,519 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0010_01_000006, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:19,519 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:19,519 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:07:19,519 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0010_000001 released container container_1426266260362_0010_01_000006 on node: host: 10.1.1.144:60715 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:07:19,591 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:07:19,591 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0010_01_000003
2015-03-13 10:07:19,592 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0010_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:07:19,592 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0010_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:07:19,592 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0010	CONTAINERID=container_1426266260362_0010_01_000003
2015-03-13 10:07:19,592 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0010_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:07:19,592 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:07:19,593 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0010_01_000003, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:19,593 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:19,593 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:07:19,593 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0010_000001 released container container_1426266260362_0010_01_000003 on node: host: 10.1.1.144:60719 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:07:20,405 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:20,406 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0010_01_000007 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:07:20,406 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0010	CONTAINERID=container_1426266260362_0010_01_000007
2015-03-13 10:07:20,406 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0010_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:07:20,406 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0010 container=Container: [ContainerId: container_1426266260362_0010_01_000007, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0010_01_000007 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:20,407 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:07:20,407 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:21,121 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0010_01_000007 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:07:21,129 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0010_01_000007 by user soberoi
2015-03-13 10:07:21,130 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0010	CONTAINERID=container_1426266260362_0010_01_000007
2015-03-13 10:07:21,130 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0010_01_000007 to application application_1426266260362_0010
2015-03-13 10:07:21,130 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000007 transitioned from NEW to LOCALIZING
2015-03-13 10:07:21,130 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0010
2015-03-13 10:07:21,130 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0010
2015-03-13 10:07:21,130 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:07:21,130 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0010
2015-03-13 10:07:21,131 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000007 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:07:21,156 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000007 transitioned from LOCALIZED to RUNNING
2015-03-13 10:07:21,156 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:21,220 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000007/default_container_executor.sh]
2015-03-13 10:07:21,406 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:21,406 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:21,406 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0010_01_000007 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:07:22,130 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:07:22,411 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:22,411 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:23,417 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:23,417 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:23,527 INFO  namenode.FSEditLog (FSEditLog.java:printStatistics(663)) - Number of transactions: 982 Total time for transactions(ms): 42 Number of transactions batched in Syncs: 0 Number of syncs: 542 SyncTimes(ms): 168 130 
2015-03-13 10:07:23,529 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs/_temporary/1/_temporary/attempt_1426266260362_0010_r_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:23,581 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs/_temporary/1/_temporary/attempt_1426266260362_0010_r_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073741944_1120{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:07:23,658 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741944_1120 src: /127.0.0.1:61610 dest: /127.0.0.1:60686
2015-03-13 10:07:23,660 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741944_1120 src: /127.0.0.1:61611 dest: /127.0.0.1:60689
2015-03-13 10:07:23,662 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741944_1120 src: /127.0.0.1:61612 dest: /127.0.0.1:60696
2015-03-13 10:07:23,677 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61612, dest: /127.0.0.1:60696, bytes: 592, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0010_r_000000_0_-1932642849_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741944_1120, duration: 13976000
2015-03-13 10:07:23,677 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741944_1120, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:23,679 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741944_1120{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:07:23,679 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61611, dest: /127.0.0.1:60689, bytes: 592, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0010_r_000000_0_-1932642849_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741944_1120, duration: 15347000
2015-03-13 10:07:23,680 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741944_1120, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:23,681 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61610, dest: /127.0.0.1:60686, bytes: 592, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0010_r_000000_0_-1932642849_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741944_1120, duration: 17616000
2015-03-13 10:07:23,681 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741944_1120, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:23,682 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741944_1120{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:07:23,682 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741944_1120{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:07:23,687 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs/_temporary/1/_temporary/attempt_1426266260362_0010_r_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0010_r_000000_0_-1932642849_1
2015-03-13 10:07:23,697 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs/_temporary/1/_temporary/attempt_1426266260362_0010_r_000000_0	dst=null	perm=null
2015-03-13 10:07:23,704 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs/_temporary/1/_temporary/attempt_1426266260362_0010_r_000000_0	dst=null	perm=null
2015-03-13 10:07:23,705 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs/_temporary/1/task_1426266260362_0010_r_000000	dst=null	perm=null
2015-03-13 10:07:23,708 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs/_temporary/1/_temporary/attempt_1426266260362_0010_r_000000_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs/_temporary/1/task_1426266260362_0010_r_000000	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:07:23,718 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0010_01_000007
2015-03-13 10:07:23,718 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0010	CONTAINERID=container_1426266260362_0010_01_000007
2015-03-13 10:07:23,719 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000007 transitioned from RUNNING to KILLING
2015-03-13 10:07:23,719 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0010_01_000007
2015-03-13 10:07:23,719 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:23,719 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:07:23,727 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:23,729 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-1675890031_1
2015-03-13 10:07:23,733 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0010_01_000007 is : 143
2015-03-13 10:07:23,733 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs/_temporary/1	dst=null	perm=null
2015-03-13 10:07:23,738 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs	dst=null	perm=null
2015-03-13 10:07:23,739 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs	dst=null	perm=null
2015-03-13 10:07:23,740 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs/_temporary/1/task_1426266260362_0010_r_000000	dst=null	perm=null
2015-03-13 10:07:23,742 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs/part-00000	dst=null	perm=null
2015-03-13 10:07:23,745 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000007 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:07:23,745 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs/_temporary/1/task_1426266260362_0010_r_000000/part-00000	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs/part-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:23,746 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000007
2015-03-13 10:07:23,746 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0010	CONTAINERID=container_1426266260362_0010_01_000007
2015-03-13 10:07:23,746 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000007 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:07:23,746 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000007
2015-03-13 10:07:23,748 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000007
2015-03-13 10:07:23,748 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000007
2015-03-13 10:07:23,746 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0010_01_000007 from application application_1426266260362_0010
2015-03-13 10:07:23,749 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:23,749 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0010
2015-03-13 10:07:23,752 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs/_temporary	dst=null	perm=null
2015-03-13 10:07:23,757 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:23,759 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-1675890031_1
2015-03-13 10:07:23,760 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:23,762 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-1675890031_1
2015-03-13 10:07:23,775 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61598, dest: /127.0.0.1:60686, bytes: 67673, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1675890031_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741943_1119, duration: 5532991000
2015-03-13 10:07:23,775 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741943_1119, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:23,776 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741943_1119{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:07:23,776 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61597, dest: /127.0.0.1:60696, bytes: 67673, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1675890031_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741943_1119, duration: 5534006000
2015-03-13 10:07:23,776 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741943_1119, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:23,777 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61596, dest: /127.0.0.1:60689, bytes: 67673, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1675890031_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741943_1119, duration: 5535264000
2015-03-13 10:07:23,777 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741943_1119{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:07:23,777 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741943_1119, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:23,778 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741943_1119{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:07:23,780 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job_1426266260362_0010_1.jhist is closed by DFSClient_NONMAPREDUCE_-1675890031_1
2015-03-13 10:07:23,782 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0010.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:23,784 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0010.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741945_1121{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:07:23,786 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741945_1121 src: /127.0.0.1:61613 dest: /127.0.0.1:60689
2015-03-13 10:07:23,787 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741945_1121 src: /127.0.0.1:61614 dest: /127.0.0.1:60693
2015-03-13 10:07:23,788 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741945_1121 src: /127.0.0.1:61615 dest: /127.0.0.1:60696
2015-03-13 10:07:23,791 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61615, dest: /127.0.0.1:60696, bytes: 454, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1675890031_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741945_1121, duration: 1275000
2015-03-13 10:07:23,791 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741945_1121, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:23,791 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741945_1121{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:07:23,791 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61614, dest: /127.0.0.1:60693, bytes: 454, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1675890031_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741945_1121, duration: 1820000
2015-03-13 10:07:23,792 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741945_1121, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:23,792 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741945_1121{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:07:23,792 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61613, dest: /127.0.0.1:60689, bytes: 454, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1675890031_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741945_1121, duration: 2576000
2015-03-13 10:07:23,792 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741945_1121, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:23,793 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741945_1121{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:07:23,794 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0010.summary_tmp is closed by DFSClient_NONMAPREDUCE_-1675890031_1
2015-03-13 10:07:23,798 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0010.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:23,804 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job_1426266260362_0010_1.jhist	dst=null	perm=null
2015-03-13 10:07:23,805 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0010-1426266423258-soberoi-%5BE808F612428A4495876D015977ED92F6%2F40D364854F8D4660-1426266443763-5-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:07:23,808 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job_1426266260362_0010_1.jhist	dst=null	perm=null
2015-03-13 10:07:23,809 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0010-1426266423258-soberoi-%5BE808F612428A4495876D015977ED92F6%2F40D364854F8D4660-1426266443763-5-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:07:23,810 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job_1426266260362_0010_1.jhist	dst=null	perm=null
2015-03-13 10:07:23,812 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0010-1426266423258-soberoi-%5BE808F612428A4495876D015977ED92F6%2F40D364854F8D4660-1426266443763-5-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:23,814 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61616, bytes: 68205, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1675890031_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741943_1119, duration: 291000
2015-03-13 10:07:23,816 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0010-1426266423258-soberoi-%5BE808F612428A4495876D015977ED92F6%2F40D364854F8D4660-1426266443763-5-1-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741946_1122{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:07:23,818 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741946_1122 src: /127.0.0.1:61617 dest: /127.0.0.1:60693
2015-03-13 10:07:23,819 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741946_1122 src: /127.0.0.1:61618 dest: /127.0.0.1:60686
2015-03-13 10:07:23,820 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741946_1122 src: /127.0.0.1:61619 dest: /127.0.0.1:60689
2015-03-13 10:07:23,824 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61619, dest: /127.0.0.1:60689, bytes: 67673, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1675890031_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741946_1122, duration: 1700000
2015-03-13 10:07:23,824 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741946_1122, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:23,824 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741946_1122{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:23,824 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61618, dest: /127.0.0.1:60686, bytes: 67673, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1675890031_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741946_1122, duration: 2423000
2015-03-13 10:07:23,825 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741946_1122, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:23,825 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741946_1122{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:23,825 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61617, dest: /127.0.0.1:60693, bytes: 67673, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1675890031_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741946_1122, duration: 3269000
2015-03-13 10:07:23,826 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741946_1122, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:23,826 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741946_1122{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:23,827 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0010-1426266423258-soberoi-%5BE808F612428A4495876D015977ED92F6%2F40D364854F8D4660-1426266443763-5-1-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-1675890031_1
2015-03-13 10:07:23,829 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0010-1426266423258-soberoi-%5BE808F612428A4495876D015977ED92F6%2F40D364854F8D4660-1426266443763-5-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:23,830 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job_1426266260362_0010_1_conf.xml	dst=null	perm=null
2015-03-13 10:07:23,831 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0010_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:07:23,831 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job_1426266260362_0010_1_conf.xml	dst=null	perm=null
2015-03-13 10:07:23,832 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0010_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:07:23,833 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job_1426266260362_0010_1_conf.xml	dst=null	perm=null
2015-03-13 10:07:23,835 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0010_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:23,836 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61616, bytes: 93437, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1675890031_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741942_1118, duration: 265000
2015-03-13 10:07:23,838 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0010_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741947_1123{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:07:23,840 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741947_1123 src: /127.0.0.1:61620 dest: /127.0.0.1:60693
2015-03-13 10:07:23,841 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741947_1123 src: /127.0.0.1:61621 dest: /127.0.0.1:60686
2015-03-13 10:07:23,842 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741947_1123 src: /127.0.0.1:61622 dest: /127.0.0.1:60696
2015-03-13 10:07:23,845 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61622, dest: /127.0.0.1:60696, bytes: 92709, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1675890031_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741947_1123, duration: 1797000
2015-03-13 10:07:23,845 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741947_1123, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:23,845 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741947_1123{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:07:23,846 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61621, dest: /127.0.0.1:60686, bytes: 92709, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1675890031_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741947_1123, duration: 2344000
2015-03-13 10:07:23,846 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741947_1123, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:23,846 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741947_1123{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:07:23,846 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61620, dest: /127.0.0.1:60693, bytes: 92709, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1675890031_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741947_1123, duration: 3058000
2015-03-13 10:07:23,847 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741947_1123, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:23,847 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741947_1123{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:07:23,848 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0010_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-1675890031_1
2015-03-13 10:07:23,850 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0010_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:23,852 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0010.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0010.summary	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:23,855 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0010_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0010_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:23,859 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0010-1426266423258-soberoi-%5BE808F612428A4495876D015977ED92F6%2F40D364854F8D4660-1426266443763-5-1-SUCCEEDED-default.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0010-1426266423258-soberoi-%5BE808F612428A4495876D015977ED92F6%2F40D364854F8D4660-1426266443763-5-1-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:23,865 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0010_000001 State change from RUNNING to FINISHING
2015-03-13 10:07:23,866 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0010
2015-03-13 10:07:23,866 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0010 State change from RUNNING to REMOVING
2015-03-13 10:07:23,866 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0010
2015-03-13 10:07:23,866 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0010 State change from REMOVING to FINISHING
2015-03-13 10:07:24,724 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:24,725 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:07:24,725 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0010_01_000007
2015-03-13 10:07:24,725 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0010_01_000007 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:07:24,725 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0010_01_000007 in state: COMPLETED event:FINISHED
2015-03-13 10:07:24,726 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0010	CONTAINERID=container_1426266260362_0010_01_000007
2015-03-13 10:07:24,726 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0010_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:07:24,726 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:07:24,726 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0010_01_000007, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:24,726 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:24,727 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:07:24,727 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0010_000001 released container container_1426266260362_0010_01_000007 on node: host: 10.1.1.144:60711 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:07:24,875 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741938_1114 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60686 127.0.0.1:60693 
2015-03-13 10:07:24,875 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741939_1115 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60686 
2015-03-13 10:07:24,875 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741940_1116 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60686 
2015-03-13 10:07:24,875 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741941_1117 127.0.0.1:60693 127.0.0.1:60689 127.0.0.1:60686 
2015-03-13 10:07:24,875 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741943_1119 127.0.0.1:60689 127.0.0.1:60696 127.0.0.1:60686 
2015-03-13 10:07:24,876 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741942_1118 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60689 
2015-03-13 10:07:24,876 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010	dst=null	perm=null
2015-03-13 10:07:24,914 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741929_1105 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60689 
2015-03-13 10:07:24,914 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741933_1109 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60693 
2015-03-13 10:07:24,914 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741932_1108 127.0.0.1:60689 127.0.0.1:60693 127.0.0.1:60686 
2015-03-13 10:07:24,914 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741930_1106 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60689 
2015-03-13 10:07:24,914 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741934_1110 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60689 
2015-03-13 10:07:24,914 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177	dst=null	perm=null
2015-03-13 10:07:24,915 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs	dst=null	perm=null
2015-03-13 10:07:24,915 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs/_temporary
2015-03-13 10:07:24,916 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs/_temporary	dst=null	perm=null
2015-03-13 10:07:24,923 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:07:24,923 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:07:24,924 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:07:24,925 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs	dst=null	perm=null
2015-03-13 10:07:24,925 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs	dst=null	perm=null
2015-03-13 10:07:24,926 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs	dst=null	perm=null
2015-03-13 10:07:24,927 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:07:24,927 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs/part-00000	dst=null	perm=null
2015-03-13 10:07:24,929 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61624, bytes: 600, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741944_1120, duration: 184000
2015-03-13 10:07:24,937 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:07:24,937 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:07:24,937 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:07:24,938 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs	dst=null	perm=null
2015-03-13 10:07:24,939 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs	dst=null	perm=null
2015-03-13 10:07:24,939 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs	dst=null	perm=null
2015-03-13 10:07:24,940 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:07:24,941 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs/part-00000	dst=null	perm=null
2015-03-13 10:07:24,942 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61625, bytes: 600, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741944_1120, duration: 135000
2015-03-13 10:07:24,943 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs
2015-03-13 10:07:24,944 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs	dst=null	perm=null
2015-03-13 10:07:24,944 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs	dst=null	perm=null
2015-03-13 10:07:24,945 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs	dst=null	perm=null
2015-03-13 10:07:24,945 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs	dst=null	perm=null
2015-03-13 10:07:24,946 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs/part-00000	dst=null	perm=null
2015-03-13 10:07:24,947 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs/part-00000	dst=null	perm=null
2015-03-13 10:07:24,948 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61624, bytes: 600, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741944_1120, duration: 146000
2015-03-13 10:07:24,949 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:07:24,949 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:07:24,950 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt	dst=null	perm=null
2015-03-13 10:07:24,950 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt	dst=null	perm=null
2015-03-13 10:07:24,969 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:07:24,970 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:07:24,971 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:07:24,999 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs	dst=null	perm=null
2015-03-13 10:07:25,004 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping] starting
2015-03-13 10:07:25,004 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt"]
2015-03-13 10:07:25,004 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-03-13 10:07:25,005 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt"]
2015-03-13 10:07:25,005 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-03-13 10:07:25,005 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping]  sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs"]
2015-03-13 10:07:25,005 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping]  parallel execution is enabled: true
2015-03-13 10:07:25,005 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping]  starting jobs: 2
2015-03-13 10:07:25,005 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping]  allocating threads: 2
2015-03-13 10:07:25,006 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [cogrouping] starting step: (2/2)
2015-03-13 10:07:25,014 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:07:25,022 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:07:25,023 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4	dst=null	perm=null
2015-03-13 10:07:25,023 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:07:25,024 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:07:25,026 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 11
2015-03-13 10:07:25,026 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011	dst=null	perm=null
2015-03-13 10:07:25,027 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011	dst=null	perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:07:25,028 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011	dst=null	perm=soberoi:supergroup:rwx------
2015-03-13 10:07:25,029 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.jar	dst=null	perm=null
2015-03-13 10:07:25,030 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:07:25,031 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073741948_1124{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:07:25,033 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741948_1124 src: /127.0.0.1:61627 dest: /127.0.0.1:60696
2015-03-13 10:07:25,034 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741948_1124 src: /127.0.0.1:61628 dest: /127.0.0.1:60689
2015-03-13 10:07:25,035 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741948_1124 src: /127.0.0.1:61629 dest: /127.0.0.1:60693
2015-03-13 10:07:25,038 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61629, dest: /127.0.0.1:60693, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741948_1124, duration: 2553000
2015-03-13 10:07:25,039 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741948_1124, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:25,039 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741948_1124{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:07:25,039 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61628, dest: /127.0.0.1:60689, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741948_1124, duration: 2560000
2015-03-13 10:07:25,039 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741948_1124, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:25,039 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741948_1124{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:07:25,040 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61627, dest: /127.0.0.1:60696, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741948_1124, duration: 3396000
2015-03-13 10:07:25,040 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741948_1124, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:25,041 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741948_1124{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:07:25,042 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:07:25,042 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.jar
2015-03-13 10:07:25,043 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.jar	dst=null	perm=null
2015-03-13 10:07:25,044 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:07:25,044 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:07:25,045 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:07:25,045 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:07:25,046 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:07:25,046 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:07:25,047 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:07:25,048 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:07:25,048 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:07:25,049 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:07:25,051 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:07:25,051 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:07:25,052 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:07:25,054 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:07:25,056 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:07:25,057 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.split
2015-03-13 10:07:25,057 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.split	dst=null	perm=null
2015-03-13 10:07:25,058 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073741949_1125{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:07:25,060 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741949_1125 src: /127.0.0.1:61630 dest: /127.0.0.1:60696
2015-03-13 10:07:25,061 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741949_1125 src: /127.0.0.1:61631 dest: /127.0.0.1:60689
2015-03-13 10:07:25,062 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741949_1125 src: /127.0.0.1:61632 dest: /127.0.0.1:60686
2015-03-13 10:07:25,064 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741949_1125 src: /127.0.0.1:61633 dest: /127.0.0.1:60693
2015-03-13 10:07:25,067 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61633, dest: /127.0.0.1:60693, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741949_1125, duration: 1593000
2015-03-13 10:07:25,067 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741949_1125, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:25,067 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741949_1125{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:07:25,068 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61632, dest: /127.0.0.1:60686, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741949_1125, duration: 2040000
2015-03-13 10:07:25,068 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741949_1125, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:25,068 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741949_1125{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:07:25,068 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61631, dest: /127.0.0.1:60689, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741949_1125, duration: 2916000
2015-03-13 10:07:25,069 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741949_1125, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:25,069 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741949_1125{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:07:25,069 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61630, dest: /127.0.0.1:60696, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741949_1125, duration: 3763000
2015-03-13 10:07:25,069 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741949_1125, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:25,072 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741949_1125{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:07:25,073 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:07:25,074 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:07:25,076 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:07:25,076 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073741950_1126{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:07:25,078 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741950_1126 src: /127.0.0.1:61634 dest: /127.0.0.1:60696
2015-03-13 10:07:25,079 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741950_1126 src: /127.0.0.1:61635 dest: /127.0.0.1:60686
2015-03-13 10:07:25,080 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741950_1126 src: /127.0.0.1:61636 dest: /127.0.0.1:60693
2015-03-13 10:07:25,082 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61636, dest: /127.0.0.1:60693, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741950_1126, duration: 1408000
2015-03-13 10:07:25,082 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741950_1126, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:25,083 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741950_1126{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:07:25,083 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61635, dest: /127.0.0.1:60686, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741950_1126, duration: 1830000
2015-03-13 10:07:25,083 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741950_1126, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:25,083 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741950_1126{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:07:25,084 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61634, dest: /127.0.0.1:60696, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741950_1126, duration: 2439000
2015-03-13 10:07:25,084 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741950_1126, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:25,085 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741950_1126{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:07:25,086 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:07:25,086 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:07:25,087 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:07:25,088 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:07:25,089 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:07:25,089 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:07:25,090 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:07:25,093 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073741951_1127{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:07:25,094 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741951_1127 src: /127.0.0.1:61637 dest: /127.0.0.1:60696
2015-03-13 10:07:25,095 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741951_1127 src: /127.0.0.1:61638 dest: /127.0.0.1:60689
2015-03-13 10:07:25,097 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741951_1127 src: /127.0.0.1:61639 dest: /127.0.0.1:60686
2015-03-13 10:07:25,099 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61639, dest: /127.0.0.1:60686, bytes: 97842, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741951_1127, duration: 1493000
2015-03-13 10:07:25,100 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741951_1127, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:25,100 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741951_1127{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:07:25,100 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61638, dest: /127.0.0.1:60689, bytes: 97842, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741951_1127, duration: 2027000
2015-03-13 10:07:25,101 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741951_1127, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:25,101 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741951_1127{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:07:25,101 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61637, dest: /127.0.0.1:60696, bytes: 97842, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741951_1127, duration: 2920000
2015-03-13 10:07:25,101 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741951_1127, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:25,102 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741951_1127{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:07:25,103 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:07:25,104 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0011
2015-03-13 10:07:25,105 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011	dst=null	perm=null
2015-03-13 10:07:25,106 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.xml	dst=null	perm=null
2015-03-13 10:07:25,106 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.xml	dst=null	perm=null
2015-03-13 10:07:25,107 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.jar	dst=null	perm=null
2015-03-13 10:07:25,108 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.jar	dst=null	perm=null
2015-03-13 10:07:25,109 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.split	dst=null	perm=null
2015-03-13 10:07:25,109 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.split	dst=null	perm=null
2015-03-13 10:07:25,110 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:07:25,111 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:07:25,113 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:07:25,114 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:07:25,115 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:07:25,115 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:07:25,116 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:07:25,117 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:07:25,119 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 11 submitted by user soberoi
2015-03-13 10:07:25,119 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0011
2015-03-13 10:07:25,119 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	IP=10.1.1.144	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1426266260362_0011
2015-03-13 10:07:25,119 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0011
2015-03-13 10:07:25,119 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0011 State change from NEW to NEW_SAVING
2015-03-13 10:07:25,119 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0011 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:07:25,120 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0011_000001
2015-03-13 10:07:25,120 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0011_000001 State change from NEW to SUBMITTED
2015-03-13 10:07:25,120 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0011 from user: soberoi activated in queue: default
2015-03-13 10:07:25,120 INFO  capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0011 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:07:25,120 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0011 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:07:25,120 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0011 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:07:25,120 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0011_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:07:25,121 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0011_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:07:25,121 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0011 State change from SUBMITTED to ACCEPTED
2015-03-13 10:07:25,123 INFO  mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0011/
2015-03-13 10:07:25,123 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [cogrouping] submitted hadoop job: job_1426266260362_0011
2015-03-13 10:07:25,123 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [cogrouping] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0011/
2015-03-13 10:07:25,534 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0011_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:07:25,534 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0011	CONTAINERID=container_1426266260362_0011_01_000001
2015-03-13 10:07:25,534 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0011_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:07:25,535 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0011 container=Container: [ContainerId: container_1426266260362_0011_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0011_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:25,535 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:07:25,535 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0011_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:07:25,535 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:25,536 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0011 AttemptId: appattempt_1426266260362_0011_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0011_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ]
2015-03-13 10:07:25,536 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0011_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:07:25,536 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0011_000001
2015-03-13 10:07:25,536 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0011_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:07:25,536 INFO  amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0011_000001
2015-03-13 10:07:25,536 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0011_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] for AM appattempt_1426266260362_0011_000001
2015-03-13 10:07:25,537 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0011_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-03-13 10:07:25,539 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0011_000001 (auth:SIMPLE)
2015-03-13 10:07:25,540 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0011_01_000001 by user soberoi
2015-03-13 10:07:25,540 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0011
2015-03-13 10:07:25,540 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0011	CONTAINERID=container_1426266260362_0011_01_000001
2015-03-13 10:07:25,540 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0011 transitioned from NEW to INITING
2015-03-13 10:07:25,540 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0011_01_000001 to application application_1426266260362_0011
2015-03-13 10:07:25,540 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0011_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] for AM appattempt_1426266260362_0011_000001
2015-03-13 10:07:25,541 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0011 transitioned from INITING to RUNNING
2015-03-13 10:07:25,541 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0011_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:07:25,541 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:07:25,541 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0011
2015-03-13 10:07:25,541 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:07:25,541 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:07:25,541 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:07:25,541 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:07:25,541 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0011_01_000001
2015-03-13 10:07:25,551 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426266260362_0011_01_000001.tokens. Credentials list: 
2015-03-13 10:07:25,566 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:07:25,635 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426266260362_0011_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000001.tokens
2015-03-13 10:07:25,635 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0011 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0011
2015-03-13 10:07:25,693 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.jar	dst=null	perm=null
2015-03-13 10:07:25,693 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.jar	dst=null	perm=null
2015-03-13 10:07:25,694 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.jar	dst=null	perm=null
2015-03-13 10:07:25,701 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61643, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1099241494_5992, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741948_1124, duration: 498000
2015-03-13 10:07:25,719 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:07:25,727 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:25,735 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:07:25,735 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:07:25,736 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:07:25,741 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61625, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1099241494_5992, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741950_1126, duration: 175000
2015-03-13 10:07:25,754 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:07:25,770 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.split	dst=null	perm=null
2015-03-13 10:07:25,770 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.split	dst=null	perm=null
2015-03-13 10:07:25,771 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.split	dst=null	perm=null
2015-03-13 10:07:25,777 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61644, bytes: 1798, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1099241494_5992, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741949_1125, duration: 138000
2015-03-13 10:07:25,789 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:07:25,807 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.xml	dst=null	perm=null
2015-03-13 10:07:25,808 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.xml	dst=null	perm=null
2015-03-13 10:07:25,809 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.xml	dst=null	perm=null
2015-03-13 10:07:25,815 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61624, bytes: 98610, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1099241494_5992, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741951_1127, duration: 288000
2015-03-13 10:07:25,827 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:07:25,827 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:07:25,852 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:07:25,852 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:25,916 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000001/default_container_executor.sh]
2015-03-13 10:07:26,252 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741946_1122
2015-03-13 10:07:26,253 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741947_1123
2015-03-13 10:07:26,253 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741950_1126
2015-03-13 10:07:26,253 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741949_1125
2015-03-13 10:07:26,254 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741945_1121
2015-03-13 10:07:26,443 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741948_1124
2015-03-13 10:07:26,443 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741949_1125
2015-03-13 10:07:26,443 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741944_1120
2015-03-13 10:07:26,444 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741943_1119
2015-03-13 10:07:26,453 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741948_1124
2015-03-13 10:07:26,534 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:26,534 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0011_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:07:26,616 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741944_1120
2015-03-13 10:07:26,617 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741951_1127
2015-03-13 10:07:26,617 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741947_1123
2015-03-13 10:07:26,618 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741943_1119
2015-03-13 10:07:26,618 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741945_1121
2015-03-13 10:07:26,619 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741950_1126
2015-03-13 10:07:26,626 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741951_1127
2015-03-13 10:07:26,626 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741950_1126
2015-03-13 10:07:26,626 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741944_1120
2015-03-13 10:07:26,627 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741943_1119
2015-03-13 10:07:26,627 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741947_1123
2015-03-13 10:07:26,628 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741949_1125
2015-03-13 10:07:26,628 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741946_1122
2015-03-13 10:07:26,646 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741946_1122
2015-03-13 10:07:26,647 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741951_1127
2015-03-13 10:07:26,648 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741945_1121
2015-03-13 10:07:26,702 INFO  hs.JobHistory (JobHistory.java:run(178)) - Starting scan to move intermediate done files
2015-03-13 10:07:26,703 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:07:26,705 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:07:26,711 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0002.summary	dst=null	perm=null
2015-03-13 10:07:26,711 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0001.summary	dst=null	perm=null
2015-03-13 10:07:26,711 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0003.summary	dst=null	perm=null
2015-03-13 10:07:26,713 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61625, bytes: 423, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741853_1029, duration: 139000
2015-03-13 10:07:26,713 INFO  jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0002,submitTime=1426266286369,launchTime=1426266289929,firstMapTaskLaunchTime=1426266292118,firstReduceTaskLaunchTime=0,finishTime=1426266302068,resourcesPerMap=1024,resourcesPerReduce=0,numMaps=5,numReduces=0,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=47,reduceSlotSeconds=0,jobName=[B229A65FB52F476791CA626E2F4F95DF/B348F1FAB7B345A48FA5BE9A6836732D] upper1*upper2*lower/(2/2)
2015-03-13 10:07:26,714 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0002.summary]
2015-03-13 10:07:26,713 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61624, bytes: 452, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741866_1042, duration: 163000
2015-03-13 10:07:26,713 INFO  jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0003,submitTime=1426266303375,launchTime=1426266306986,firstMapTaskLaunchTime=1426266309145,firstReduceTaskLaunchTime=0,finishTime=1426266318647,resourcesPerMap=1024,resourcesPerReduce=0,numMaps=5,numReduces=0,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=46,reduceSlotSeconds=0,jobName=[B229A65FB52F476791CA626E2F4F95DF/98FC3601A29C48A6B4344FEFB9E0B80E] upper1*upper2*lower/(1/2) ...rm/joinaroundjoinleftmost
2015-03-13 10:07:26,714 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61645, bytes: 444, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741838_1014, duration: 180000
2015-03-13 10:07:26,714 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0003.summary]
2015-03-13 10:07:26,715 INFO  jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0001,submitTime=1426266268849,launchTime=1426266272460,firstMapTaskLaunchTime=1426266274650,firstReduceTaskLaunchTime=0,finishTime=1426266284818,resourcesPerMap=1024,resourcesPerReduce=0,numMaps=5,numReduces=0,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=49,reduceSlotSeconds=0,jobName=[3CE1BF9BD7C747EDB1F8A6829F563276/1F14FA6CB9B54C3AB9069C6E50F98834] lower*upper/(1/1) ...splatform/joininnersingle
2015-03-13 10:07:26,715 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0001.summary]
2015-03-13 10:07:26,716 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741853_1029 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60686 
2015-03-13 10:07:26,716 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0002.summary	dst=null	perm=null
2015-03-13 10:07:26,717 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741866_1042 127.0.0.1:60693 127.0.0.1:60689 127.0.0.1:60686 
2015-03-13 10:07:26,717 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0003.summary	dst=null	perm=null
2015-03-13 10:07:26,718 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741838_1014 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60689 
2015-03-13 10:07:26,718 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0001.summary	dst=null	perm=null
2015-03-13 10:07:26,718 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000	dst=null	perm=null
2015-03-13 10:07:26,720 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000	dst=null	perm=null
2015-03-13 10:07:26,721 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000	dst=null	perm=null
2015-03-13 10:07:26,721 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:26,722 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0001-1426266268849-soberoi-%5B3CE1BF9BD7C747EDB1F8A6829F563276%2F1F14FA6CB9B54C3A-1426266284818-5-0-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0001-1426266268849-soberoi-%5B3CE1BF9BD7C747EDB1F8A6829F563276%2F1F14FA6CB9B54C3A-1426266284818-5-0-SUCCEEDED-default.jhist
2015-03-13 10:07:26,722 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:26,723 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000	dst=null	perm=null
2015-03-13 10:07:26,723 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000	dst=null	perm=null
2015-03-13 10:07:26,723 INFO  hs.HistoryFileManager (HistoryFileManager.java:makeDoneSubdir(885)) - Perms after creating 504, Expected: 504
2015-03-13 10:07:26,723 INFO  hs.HistoryFileManager (HistoryFileManager.java:makeDoneSubdir(885)) - Perms after creating 504, Expected: 504
2015-03-13 10:07:26,723 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0002-1426266286369-soberoi-%5BB229A65FB52F476791CA626E2F4F95DF%2FB348F1FAB7B345A4-1426266302068-5-0-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0002-1426266286369-soberoi-%5BB229A65FB52F476791CA626E2F4F95DF%2FB348F1FAB7B345A4-1426266302068-5-0-SUCCEEDED-default.jhist
2015-03-13 10:07:26,724 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0003-1426266303375-soberoi-%5BB229A65FB52F476791CA626E2F4F95DF%2F98FC3601A29C48A6-1426266318647-5-0-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0003-1426266303375-soberoi-%5BB229A65FB52F476791CA626E2F4F95DF%2F98FC3601A29C48A6-1426266318647-5-0-SUCCEEDED-default.jhist
2015-03-13 10:07:26,728 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:26,729 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0003-1426266303375-soberoi-%5BB229A65FB52F476791CA626E2F4F95DF%2F98FC3601A29C48A6-1426266318647-5-0-SUCCEEDED-default.jhist	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0003-1426266303375-soberoi-%5BB229A65FB52F476791CA626E2F4F95DF%2F98FC3601A29C48A6-1426266318647-5-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:26,729 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0002-1426266286369-soberoi-%5BB229A65FB52F476791CA626E2F4F95DF%2FB348F1FAB7B345A4-1426266302068-5-0-SUCCEEDED-default.jhist	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0002-1426266286369-soberoi-%5BB229A65FB52F476791CA626E2F4F95DF%2FB348F1FAB7B345A4-1426266302068-5-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:26,729 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0001-1426266268849-soberoi-%5B3CE1BF9BD7C747EDB1F8A6829F563276%2F1F14FA6CB9B54C3A-1426266284818-5-0-SUCCEEDED-default.jhist	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0001-1426266268849-soberoi-%5B3CE1BF9BD7C747EDB1F8A6829F563276%2F1F14FA6CB9B54C3A-1426266284818-5-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:26,730 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0003_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0003_conf.xml
2015-03-13 10:07:26,731 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0002_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0002_conf.xml
2015-03-13 10:07:26,731 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0001_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0001_conf.xml
2015-03-13 10:07:26,732 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0003_conf.xml	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0003_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:26,733 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0001_conf.xml	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0001_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:26,733 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0002_conf.xml	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0002_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:26,733 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0004.summary	dst=null	perm=null
2015-03-13 10:07:26,733 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0005.summary	dst=null	perm=null
2015-03-13 10:07:26,734 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0006.summary	dst=null	perm=null
2015-03-13 10:07:26,735 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61644, bytes: 437, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741879_1055, duration: 160000
2015-03-13 10:07:26,735 INFO  jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0004,submitTime=1426266320047,launchTime=1426266323734,firstMapTaskLaunchTime=1426266325900,firstReduceTaskLaunchTime=0,finishTime=1426266336413,resourcesPerMap=1024,resourcesPerReduce=0,numMaps=5,numReduces=0,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=49,reduceSlotSeconds=0,jobName=[DF98BEF6B79549DA8449852A7CBDC6EB/5EF25D47FD21419386DBBAEE8B2D20AA] tail/(1/1) ...ipesplatform/renamedpipes
2015-03-13 10:07:26,735 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0004.summary]
2015-03-13 10:07:26,736 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61646, bytes: 430, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741894_1070, duration: 181000
2015-03-13 10:07:26,736 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61647, bytes: 430, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741899_1075, duration: 147000
2015-03-13 10:07:26,736 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741879_1055 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60689 
2015-03-13 10:07:26,736 INFO  jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0006,submitTime=1426266337924,launchTime=1426266355981,firstMapTaskLaunchTime=1426266358186,firstReduceTaskLaunchTime=1426266371088,finishTime=1426266373769,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=5,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=53,reduceSlotSeconds=2,jobName=[FC83D3BF82BA4B999048416E4B0AF853/1744C2BC8C1542818B6974502505089D] lower*upper/(2/3)
2015-03-13 10:07:26,736 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0006.summary]
2015-03-13 10:07:26,736 INFO  jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0005,submitTime=1426266337896,launchTime=1426266341433,firstMapTaskLaunchTime=1426266343596,firstReduceTaskLaunchTime=1426266356557,finishTime=1426266363636,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=5,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=55,reduceSlotSeconds=7,jobName=[FC83D3BF82BA4B999048416E4B0AF853/1C978E7C0B2B420185FC2705C6894108] lower*upper/(1/3)
2015-03-13 10:07:26,736 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0005.summary]
2015-03-13 10:07:26,736 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0004.summary	dst=null	perm=null
2015-03-13 10:07:26,738 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741899_1075 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60689 
2015-03-13 10:07:26,738 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0006.summary	dst=null	perm=null
2015-03-13 10:07:26,738 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741894_1070 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60689 
2015-03-13 10:07:26,738 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0005.summary	dst=null	perm=null
2015-03-13 10:07:26,739 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000	dst=null	perm=null
2015-03-13 10:07:26,740 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000	dst=null	perm=null
2015-03-13 10:07:26,740 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0004-1426266320047-soberoi-%5BDF98BEF6B79549DA8449852A7CBDC6EB%2F5EF25D47FD214193-1426266336413-5-0-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0004-1426266320047-soberoi-%5BDF98BEF6B79549DA8449852A7CBDC6EB%2F5EF25D47FD214193-1426266336413-5-0-SUCCEEDED-default.jhist
2015-03-13 10:07:26,740 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000	dst=null	perm=null
2015-03-13 10:07:26,740 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0006-1426266337924-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F1744C2BC8C154281-1426266373769-5-1-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0006-1426266337924-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F1744C2BC8C154281-1426266373769-5-1-SUCCEEDED-default.jhist
2015-03-13 10:07:26,740 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0005-1426266337896-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F1C978E7C0B2B4201-1426266363636-5-1-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0005-1426266337896-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F1C978E7C0B2B4201-1426266363636-5-1-SUCCEEDED-default.jhist
2015-03-13 10:07:26,741 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0004-1426266320047-soberoi-%5BDF98BEF6B79549DA8449852A7CBDC6EB%2F5EF25D47FD214193-1426266336413-5-0-SUCCEEDED-default.jhist	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0004-1426266320047-soberoi-%5BDF98BEF6B79549DA8449852A7CBDC6EB%2F5EF25D47FD214193-1426266336413-5-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:26,741 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0006-1426266337924-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F1744C2BC8C154281-1426266373769-5-1-SUCCEEDED-default.jhist	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0006-1426266337924-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F1744C2BC8C154281-1426266373769-5-1-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:26,741 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0004_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0004_conf.xml
2015-03-13 10:07:26,741 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0006_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0006_conf.xml
2015-03-13 10:07:26,742 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0005-1426266337896-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F1C978E7C0B2B4201-1426266363636-5-1-SUCCEEDED-default.jhist	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0005-1426266337896-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F1C978E7C0B2B4201-1426266363636-5-1-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:26,742 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0005_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0005_conf.xml
2015-03-13 10:07:26,742 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0004_conf.xml	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0004_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:26,742 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0006_conf.xml	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0006_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:26,743 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0005_conf.xml	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0005_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:26,743 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0007.summary	dst=null	perm=null
2015-03-13 10:07:26,743 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0008.summary	dst=null	perm=null
2015-03-13 10:07:26,744 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0009.summary	dst=null	perm=null
2015-03-13 10:07:26,745 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61624, bytes: 443, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741909_1085, duration: 164000
2015-03-13 10:07:26,745 INFO  jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0007,submitTime=1426266375072,launchTime=1426266378909,firstMapTaskLaunchTime=1426266381055,firstReduceTaskLaunchTime=0,finishTime=1426266383818,resourcesPerMap=1024,resourcesPerReduce=0,numMaps=1,numReduces=0,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=2,reduceSlotSeconds=0,jobName=[FC83D3BF82BA4B999048416E4B0AF853/28CD4D9B5CB64D6CB627C92EC12090D1] lower*upper/(3/3) ...dpipesplatform/afterevery
2015-03-13 10:07:26,745 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0007.summary]
2015-03-13 10:07:26,745 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61644, bytes: 458, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741921_1097, duration: 194000
2015-03-13 10:07:26,745 INFO  jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0008,submitTime=1426266385192,launchTime=1426266388961,firstMapTaskLaunchTime=1426266391120,firstReduceTaskLaunchTime=1426266402057,finishTime=1426266404636,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=5,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=45,reduceSlotSeconds=2,jobName=[60C5B77597CA4154960349C96889F7F7/B3FE72BB40B045389F47AAE64AC74701] cogrouping/(1/1) ...intocogrouplhsswappedjoin
2015-03-13 10:07:26,746 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0008.summary]
2015-03-13 10:07:26,746 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61648, bytes: 414, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741935_1111, duration: 131000
2015-03-13 10:07:26,746 INFO  jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0009,submitTime=1426266405973,launchTime=1426266409237,firstMapTaskLaunchTime=1426266411406,firstReduceTaskLaunchTime=0,finishTime=1426266421982,resourcesPerMap=1024,resourcesPerReduce=0,numMaps=5,numReduces=0,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=47,reduceSlotSeconds=0,jobName=[E808F612428A4495876D015977ED92F6/A1D84621FEBB4086ADCD0292D5B55714] cogrouping/(2/2)
2015-03-13 10:07:26,746 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741909_1085 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60693 
2015-03-13 10:07:26,746 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0009.summary]
2015-03-13 10:07:26,747 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0007.summary	dst=null	perm=null
2015-03-13 10:07:26,748 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741921_1097 127.0.0.1:60689 127.0.0.1:60693 127.0.0.1:60686 
2015-03-13 10:07:26,748 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0008.summary	dst=null	perm=null
2015-03-13 10:07:26,748 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741935_1111 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60696 
2015-03-13 10:07:26,748 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0009.summary	dst=null	perm=null
2015-03-13 10:07:26,749 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000	dst=null	perm=null
2015-03-13 10:07:26,750 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0007-1426266375072-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F28CD4D9B5CB64D6C-1426266383818-1-0-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0007-1426266375072-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F28CD4D9B5CB64D6C-1426266383818-1-0-SUCCEEDED-default.jhist
2015-03-13 10:07:26,751 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000	dst=null	perm=null
2015-03-13 10:07:26,751 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0008-1426266385192-soberoi-%5B60C5B77597CA4154960349C96889F7F7%2FB3FE72BB40B04538-1426266404636-5-1-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0008-1426266385192-soberoi-%5B60C5B77597CA4154960349C96889F7F7%2FB3FE72BB40B04538-1426266404636-5-1-SUCCEEDED-default.jhist
2015-03-13 10:07:26,751 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000	dst=null	perm=null
2015-03-13 10:07:26,752 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0007-1426266375072-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F28CD4D9B5CB64D6C-1426266383818-1-0-SUCCEEDED-default.jhist	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0007-1426266375072-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F28CD4D9B5CB64D6C-1426266383818-1-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:26,752 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0009-1426266405973-soberoi-%5BE808F612428A4495876D015977ED92F6%2FA1D84621FEBB4086-1426266421982-5-0-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0009-1426266405973-soberoi-%5BE808F612428A4495876D015977ED92F6%2FA1D84621FEBB4086-1426266421982-5-0-SUCCEEDED-default.jhist
2015-03-13 10:07:26,752 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0007_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0007_conf.xml
2015-03-13 10:07:26,752 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0008-1426266385192-soberoi-%5B60C5B77597CA4154960349C96889F7F7%2FB3FE72BB40B04538-1426266404636-5-1-SUCCEEDED-default.jhist	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0008-1426266385192-soberoi-%5B60C5B77597CA4154960349C96889F7F7%2FB3FE72BB40B04538-1426266404636-5-1-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:26,753 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0008_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0008_conf.xml
2015-03-13 10:07:26,753 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0009-1426266405973-soberoi-%5BE808F612428A4495876D015977ED92F6%2FA1D84621FEBB4086-1426266421982-5-0-SUCCEEDED-default.jhist	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0009-1426266405973-soberoi-%5BE808F612428A4495876D015977ED92F6%2FA1D84621FEBB4086-1426266421982-5-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:26,753 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0007_conf.xml	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0007_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:26,754 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0008_conf.xml	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0008_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:26,754 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0009_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0009_conf.xml
2015-03-13 10:07:26,755 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0010.summary	dst=null	perm=null
2015-03-13 10:07:26,755 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0009_conf.xml	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0009_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:26,756 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61647, bytes: 458, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741945_1121, duration: 181000
2015-03-13 10:07:26,756 INFO  jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0010,submitTime=1426266423258,launchTime=1426266427025,firstMapTaskLaunchTime=1426266429214,firstReduceTaskLaunchTime=1426266441130,finishTime=1426266443763,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=5,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=46,reduceSlotSeconds=2,jobName=[E808F612428A4495876D015977ED92F6/40D364854F8D466086D1C701E449FB16] cogrouping/(1/2) ...tform/joinsintocogrouplhs
2015-03-13 10:07:26,757 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0010.summary]
2015-03-13 10:07:26,757 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741945_1121 127.0.0.1:60689 127.0.0.1:60693 127.0.0.1:60696 
2015-03-13 10:07:26,758 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0010.summary	dst=null	perm=null
2015-03-13 10:07:26,759 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000	dst=null	perm=null
2015-03-13 10:07:26,760 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0010-1426266423258-soberoi-%5BE808F612428A4495876D015977ED92F6%2F40D364854F8D4660-1426266443763-5-1-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0010-1426266423258-soberoi-%5BE808F612428A4495876D015977ED92F6%2F40D364854F8D4660-1426266443763-5-1-SUCCEEDED-default.jhist
2015-03-13 10:07:26,761 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0010-1426266423258-soberoi-%5BE808F612428A4495876D015977ED92F6%2F40D364854F8D4660-1426266443763-5-1-SUCCEEDED-default.jhist	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0010-1426266423258-soberoi-%5BE808F612428A4495876D015977ED92F6%2F40D364854F8D4660-1426266443763-5-1-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:26,761 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0010_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0010_conf.xml
2015-03-13 10:07:26,763 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0010_conf.xml	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0010_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:27,020 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741948_1124
2015-03-13 10:07:27,021 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741949_1125
2015-03-13 10:07:27,535 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:27,563 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:07:27,584 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/COMMIT_STARTED	dst=null	perm=null
2015-03-13 10:07:27,585 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/COMMIT_SUCCESS	dst=null	perm=null
2015-03-13 10:07:27,586 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/COMMIT_FAIL	dst=null	perm=null
2015-03-13 10:07:27,638 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011	dst=null	perm=null
2015-03-13 10:07:27,639 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:07:27,641 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:07:27,733 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:27,782 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60693 to replicate blk_1073741948_1124 to datanode(s) 127.0.0.1:60686
2015-03-13 10:07:27,782 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073741921_1097, blk_1073741894_1070, blk_1073741929_1105, blk_1073741866_1042, blk_1073741899_1075, blk_1073741932_1108, blk_1073741933_1109, blk_1073741934_1110, blk_1073741838_1014, blk_1073741935_1111, blk_1073741938_1114, blk_1073741939_1115, blk_1073741940_1116, blk_1073741909_1085, blk_1073741941_1117, blk_1073741942_1118, blk_1073741943_1119, blk_1073741853_1029]
2015-03-13 10:07:27,782 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073741921_1097, blk_1073741938_1114, blk_1073741939_1115, blk_1073741909_1085, blk_1073741941_1117, blk_1073741879_1055, blk_1073741945_1121, blk_1073741866_1042, blk_1073741930_1106, blk_1073741932_1108, blk_1073741933_1109, blk_1073741934_1110]
2015-03-13 10:07:27,920 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:07:27,927 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:07:27,982 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61650, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1644732514_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741950_1126, duration: 133000
2015-03-13 10:07:28,434 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741921_1097 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741921 for deletion
2015-03-13 10:07:28,434 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741894_1070 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741894 for deletion
2015-03-13 10:07:28,434 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741929_1105 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741929 for deletion
2015-03-13 10:07:28,434 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741921_1097 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741921
2015-03-13 10:07:28,434 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741866_1042 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741866 for deletion
2015-03-13 10:07:28,434 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741899_1075 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741899 for deletion
2015-03-13 10:07:28,434 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741929_1105 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741929
2015-03-13 10:07:28,434 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741932_1108 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741932 for deletion
2015-03-13 10:07:28,435 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741933_1109 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741933 for deletion
2015-03-13 10:07:28,435 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741934_1110 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741934 for deletion
2015-03-13 10:07:28,435 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741838_1014 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741838 for deletion
2015-03-13 10:07:28,435 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741935_1111 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741935 for deletion
2015-03-13 10:07:28,435 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741938_1114 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741938 for deletion
2015-03-13 10:07:28,435 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741939_1115 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741939 for deletion
2015-03-13 10:07:28,435 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741894_1070 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741894
2015-03-13 10:07:28,435 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741932_1108 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741932
2015-03-13 10:07:28,435 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741940_1116 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741940 for deletion
2015-03-13 10:07:28,436 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741934_1110 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741934
2015-03-13 10:07:28,435 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741866_1042 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741866
2015-03-13 10:07:28,436 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741838_1014 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741838
2015-03-13 10:07:28,436 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741899_1075 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741899
2015-03-13 10:07:28,436 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741938_1114 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741938
2015-03-13 10:07:28,436 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741941_1117 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741941 for deletion
2015-03-13 10:07:28,437 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741909_1085 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741909 for deletion
2015-03-13 10:07:28,437 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741940_1116 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741940
2015-03-13 10:07:28,437 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741909_1085 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741909
2015-03-13 10:07:28,437 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741942_1118 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741942 for deletion
2015-03-13 10:07:28,438 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741943_1119 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741943 for deletion
2015-03-13 10:07:28,438 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741853_1029 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741853 for deletion
2015-03-13 10:07:28,437 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741933_1109 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741933
2015-03-13 10:07:28,438 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741935_1111 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741935
2015-03-13 10:07:28,438 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741939_1115 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741939
2015-03-13 10:07:28,439 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741941_1117 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741941
2015-03-13 10:07:28,439 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741943_1119 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741943
2015-03-13 10:07:28,439 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741942_1118 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741942
2015-03-13 10:07:28,439 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741853_1029 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741853
2015-03-13 10:07:28,537 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:28,591 INFO  datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-1589780806-10.1.1.144-60693-1426266259390, infoPort=60694, ipcPort=60695, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073741948_1124 to 127.0.0.1:60686 
2015-03-13 10:07:28,591 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741921_1097 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741921 for deletion
2015-03-13 10:07:28,591 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741938_1114 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741938 for deletion
2015-03-13 10:07:28,592 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741939_1115 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741939 for deletion
2015-03-13 10:07:28,592 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741941_1117 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741941 for deletion
2015-03-13 10:07:28,592 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741909_1085 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741909 for deletion
2015-03-13 10:07:28,592 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741879_1055 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741879 for deletion
2015-03-13 10:07:28,592 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741921_1097 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741921
2015-03-13 10:07:28,592 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741938_1114 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741938
2015-03-13 10:07:28,592 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741941_1117 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741941
2015-03-13 10:07:28,592 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741945_1121 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741945 for deletion
2015-03-13 10:07:28,593 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741939_1115 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741939
2015-03-13 10:07:28,593 INFO  datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073741948_1124 (numBytes=254067) to /127.0.0.1:60686
2015-03-13 10:07:28,593 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741909_1085 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741909
2015-03-13 10:07:28,593 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741879_1055 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741879
2015-03-13 10:07:28,593 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741930_1106 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741930 for deletion
2015-03-13 10:07:28,593 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741948_1124 src: /127.0.0.1:61653 dest: /127.0.0.1:60686
2015-03-13 10:07:28,593 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741945_1121 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741945
2015-03-13 10:07:28,593 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741866_1042 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741866 for deletion
2015-03-13 10:07:28,594 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741932_1108 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741932 for deletion
2015-03-13 10:07:28,593 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741930_1106 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741930
2015-03-13 10:07:28,594 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741933_1109 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741933 for deletion
2015-03-13 10:07:28,594 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741934_1110 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741934 for deletion
2015-03-13 10:07:28,594 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741866_1042 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741866
2015-03-13 10:07:28,594 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741933_1109 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741933
2015-03-13 10:07:28,594 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741932_1108 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741932
2015-03-13 10:07:28,595 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741934_1110 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741934
2015-03-13 10:07:28,595 INFO  datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073741948_1124 src: /127.0.0.1:61653 dest: /127.0.0.1:60686 of size 254067
2015-03-13 10:07:28,595 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741948_1124 size 254067
2015-03-13 10:07:28,734 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:28,737 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0011_000001 (auth:SIMPLE)
2015-03-13 10:07:28,739 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0011_000001
2015-03-13 10:07:28,739 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi	IP=10.1.1.144	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1426266260362_0011	APPATTEMPTID=appattempt_1426266260362_0011_000001
2015-03-13 10:07:28,739 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0011_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:07:28,740 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0011 State change from ACCEPTED to RUNNING
2015-03-13 10:07:28,766 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job_1426266260362_0011_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:28,768 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:07:28,828 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job_1426266260362_0011_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:28,951 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job_1426266260362_0011_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073741952_1128{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:07:28,989 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741952_1128 src: /127.0.0.1:61657 dest: /127.0.0.1:60689
2015-03-13 10:07:28,990 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741952_1128 src: /127.0.0.1:61658 dest: /127.0.0.1:60693
2015-03-13 10:07:28,992 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741952_1128 src: /127.0.0.1:61659 dest: /127.0.0.1:60696
2015-03-13 10:07:28,999 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61659, dest: /127.0.0.1:60696, bytes: 90774, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1644732514_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741952_1128, duration: 6384000
2015-03-13 10:07:29,000 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741952_1128, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:29,000 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741952_1128{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:07:29,000 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61658, dest: /127.0.0.1:60693, bytes: 90774, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1644732514_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741952_1128, duration: 7118000
2015-03-13 10:07:29,001 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741952_1128, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:29,001 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741952_1128{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:07:29,001 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61657, dest: /127.0.0.1:60689, bytes: 90774, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1644732514_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741952_1128, duration: 8168000
2015-03-13 10:07:29,002 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741952_1128, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:29,002 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741952_1128{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:07:29,006 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job_1426266260362_0011_1_conf.xml is closed by DFSClient_NONMAPREDUCE_1644732514_1
2015-03-13 10:07:29,543 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:29,739 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:30,012 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0010_01_000001 succeeded 
2015-03-13 10:07:30,012 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:07:30,012 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0010_01_000001
2015-03-13 10:07:30,020 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000001
2015-03-13 10:07:30,020 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0010	CONTAINERID=container_1426266260362_0010_01_000001
2015-03-13 10:07:30,020 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000001
2015-03-13 10:07:30,021 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000001
2015-03-13 10:07:30,021 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:07:30,021 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0010_01_000001 from application application_1426266260362_0010
2015-03-13 10:07:30,022 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:30,020 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000001
2015-03-13 10:07:30,022 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0010
2015-03-13 10:07:30,061 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0011_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:07:30,061 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0011	CONTAINERID=container_1426266260362_0011_01_000002
2015-03-13 10:07:30,061 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0011_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:07:30,062 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0011 container=Container: [ContainerId: container_1426266260362_0011_01_000002, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0011_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:30,062 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:07:30,062 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:30,063 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0011_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:07:30,063 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0011	CONTAINERID=container_1426266260362_0011_01_000003
2015-03-13 10:07:30,063 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0011_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:07:30,063 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0011 container=Container: [ContainerId: container_1426266260362_0011_01_000003, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0011_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:30,063 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:07:30,064 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:30,064 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0011_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:07:30,064 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0011	CONTAINERID=container_1426266260362_0011_01_000004
2015-03-13 10:07:30,065 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0011_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:07:30,065 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0011 container=Container: [ContainerId: container_1426266260362_0011_01_000004, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0011_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:30,065 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:07:30,065 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:30,065 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0011_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:07:30,066 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0011	CONTAINERID=container_1426266260362_0011_01_000005
2015-03-13 10:07:30,066 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0011_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:07:30,066 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0011 container=Container: [ContainerId: container_1426266260362_0011_01_000005, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0011_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:30,066 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:07:30,066 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:30,547 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:30,547 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0011_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:07:30,548 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0011	CONTAINERID=container_1426266260362_0011_01_000006
2015-03-13 10:07:30,548 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0011_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:07:30,548 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0011 container=Container: [ContainerId: container_1426266260362_0011_01_000006, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0011_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:30,548 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7
2015-03-13 10:07:30,548 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:30,743 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:07:30,743 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0010_01_000001
2015-03-13 10:07:30,744 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0010_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:07:30,744 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0010_000001
2015-03-13 10:07:30,744 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0010_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:07:30,744 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0010_000001 State change from FINISHING to FINISHED
2015-03-13 10:07:30,744 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0010	CONTAINERID=container_1426266260362_0010_01_000001
2015-03-13 10:07:30,744 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0010 State change from FINISHING to FINISHED
2015-03-13 10:07:30,744 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0010_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60711, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:07:30,745 INFO  amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0010_000001
2015-03-13 10:07:30,745 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:7168, vCores:6> numContainers=6 user=soberoi user-resources=<memory:7168, vCores:6>
2015-03-13 10:07:30,745 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1426266260362_0010
2015-03-13 10:07:30,745 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0010_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:30,745 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:30,745 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0010,name=[E808F612428A4495876D015977ED92F6/40D364854F8D466086D1C701E449FB16] cogrouping/(1/2) ...tform/joinsintocogrouplhs,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0010/jobhistory/job/job_1426266260362_0010,appMasterHost=Edinburgh.local,startTime=1426266423258,finishTime=1426266443866,finalStatus=SUCCEEDED
2015-03-13 10:07:30,746 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6
2015-03-13 10:07:30,746 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0010_000001 released container container_1426266260362_0010_01_000001 on node: host: 10.1.1.144:60711 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:07:30,746 INFO  capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0010_000001 is done. finalState=FINISHED
2015-03-13 10:07:30,746 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0010 requests cleared
2015-03-13 10:07:30,746 INFO  capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0010 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:07:30,746 INFO  capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0010 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:07:30,748 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0010_000001 (auth:SIMPLE)
2015-03-13 10:07:30,749 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0010_01_000001
2015-03-13 10:07:30,778 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0011_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:07:30,778 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0011_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:07:30,778 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0011_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:07:30,778 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0011_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:07:30,779 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0011_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:07:30,783 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073741894_1070, blk_1073741929_1105, blk_1073741930_1106, blk_1073741899_1075, blk_1073741933_1109, blk_1073741838_1014, blk_1073741935_1111, blk_1073741938_1114, blk_1073741939_1115, blk_1073741940_1116, blk_1073741909_1085, blk_1073741942_1118, blk_1073741943_1119, blk_1073741879_1055, blk_1073741945_1121, blk_1073741853_1029]
2015-03-13 10:07:30,783 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073741921_1097, blk_1073741894_1070, blk_1073741929_1105, blk_1073741930_1106, blk_1073741866_1042, blk_1073741899_1075, blk_1073741932_1108, blk_1073741934_1110, blk_1073741838_1014, blk_1073741935_1111, blk_1073741938_1114, blk_1073741939_1115, blk_1073741940_1116, blk_1073741941_1117, blk_1073741942_1118, blk_1073741879_1055, blk_1073741943_1119, blk_1073741945_1121, blk_1073741853_1029]
2015-03-13 10:07:30,808 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.jar	dst=null	perm=null
2015-03-13 10:07:30,809 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.jar	dst=null	perm=null
2015-03-13 10:07:30,818 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.xml	dst=null	perm=null
2015-03-13 10:07:30,819 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.xml	dst=null	perm=null
2015-03-13 10:07:30,821 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:07:30,822 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:07:30,827 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:07:30,829 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:07:30,830 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:07:30,831 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:07:30,908 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0011_000001 (auth:SIMPLE)
2015-03-13 10:07:30,908 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0011_000001 (auth:SIMPLE)
2015-03-13 10:07:30,911 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0011_01_000004 by user soberoi
2015-03-13 10:07:30,912 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0011_01_000005 by user soberoi
2015-03-13 10:07:30,912 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0011_01_000002 by user soberoi
2015-03-13 10:07:30,912 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0011	CONTAINERID=container_1426266260362_0011_01_000005
2015-03-13 10:07:30,912 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0011_01_000006 by user soberoi
2015-03-13 10:07:30,912 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0011
2015-03-13 10:07:30,912 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0011_01_000003 by user soberoi
2015-03-13 10:07:30,912 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0011	CONTAINERID=container_1426266260362_0011_01_000004
2015-03-13 10:07:30,912 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0011_01_000005 to application application_1426266260362_0011
2015-03-13 10:07:30,912 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0011_01_000002 to application application_1426266260362_0011
2015-03-13 10:07:30,913 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0011 transitioned from NEW to INITING
2015-03-13 10:07:30,913 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0011_01_000004 to application application_1426266260362_0011
2015-03-13 10:07:30,913 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0011_01_000006 to application application_1426266260362_0011
2015-03-13 10:07:30,912 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0011	CONTAINERID=container_1426266260362_0011_01_000006
2015-03-13 10:07:30,913 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:07:30,913 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0011
2015-03-13 10:07:30,913 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0011
2015-03-13 10:07:30,913 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:07:30,913 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0011
2015-03-13 10:07:30,914 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:07:30,912 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0011	CONTAINERID=container_1426266260362_0011_01_000002
2015-03-13 10:07:30,913 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0011_01_000003 to application application_1426266260362_0011
2015-03-13 10:07:30,915 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0011 transitioned from INITING to RUNNING
2015-03-13 10:07:30,915 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:07:30,915 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:07:30,916 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:07:30,916 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:07:30,916 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0011
2015-03-13 10:07:30,916 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0011
2015-03-13 10:07:30,916 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:07:30,916 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0011
2015-03-13 10:07:30,916 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:07:30,916 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:07:30,916 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0011
2015-03-13 10:07:30,916 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0011
2015-03-13 10:07:30,916 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:07:30,917 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0011
2015-03-13 10:07:30,917 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0011
2015-03-13 10:07:30,917 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0011
2015-03-13 10:07:30,917 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:07:30,917 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0011
2015-03-13 10:07:30,917 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0011
2015-03-13 10:07:30,917 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0011
2015-03-13 10:07:30,917 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:07:30,917 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0011
2015-03-13 10:07:30,917 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0011_01_000004
2015-03-13 10:07:30,912 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0011	CONTAINERID=container_1426266260362_0011_01_000003
2015-03-13 10:07:30,921 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0011_01_000003
2015-03-13 10:07:30,921 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0011_01_000005
2015-03-13 10:07:30,922 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0011_01_000002
2015-03-13 10:07:30,941 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426266260362_0011_01_000004.tokens. Credentials list: 
2015-03-13 10:07:30,942 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426266260362_0011_01_000005.tokens. Credentials list: 
2015-03-13 10:07:30,943 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426266260362_0011_01_000003.tokens. Credentials list: 
2015-03-13 10:07:30,943 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1426266260362_0011_01_000002.tokens. Credentials list: 
2015-03-13 10:07:30,957 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:07:30,957 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:30,960 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:07:31,027 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000006/default_container_executor.sh]
2015-03-13 10:07:31,036 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426266260362_0011_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000004.tokens
2015-03-13 10:07:31,036 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0011 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0011
2015-03-13 10:07:31,061 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:31,062 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:31,062 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:31,062 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:31,062 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0011_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:07:31,063 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0011_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:07:31,063 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0011_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:07:31,063 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0011_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:07:31,099 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.jar	dst=null	perm=null
2015-03-13 10:07:31,100 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.jar	dst=null	perm=null
2015-03-13 10:07:31,101 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.jar	dst=null	perm=null
2015-03-13 10:07:31,107 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61665, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_842635670_6135, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741948_1124, duration: 429000
2015-03-13 10:07:31,127 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:07:31,145 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.xml	dst=null	perm=null
2015-03-13 10:07:31,146 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.xml	dst=null	perm=null
2015-03-13 10:07:31,146 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.xml	dst=null	perm=null
2015-03-13 10:07:31,153 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61666, bytes: 98610, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_842635670_6135, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741951_1127, duration: 204000
2015-03-13 10:07:31,167 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:07:31,167 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:07:31,167 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:07:31,167 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:07:31,167 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:07:31,223 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:07:31,223 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:07:31,223 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:31,223 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:31,224 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:07:31,224 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:31,229 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:07:31,230 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:31,348 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000003/default_container_executor.sh]
2015-03-13 10:07:31,356 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000004/default_container_executor.sh]
2015-03-13 10:07:31,365 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000002/default_container_executor.sh]
2015-03-13 10:07:31,367 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000005/default_container_executor.sh]
2015-03-13 10:07:31,435 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741921_1097 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741921 for deletion
2015-03-13 10:07:31,435 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741894_1070 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741894 for deletion
2015-03-13 10:07:31,435 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741929_1105 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741929 for deletion
2015-03-13 10:07:31,435 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741930_1106 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741930 for deletion
2015-03-13 10:07:31,436 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741921_1097 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741921
2015-03-13 10:07:31,436 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741866_1042 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741866 for deletion
2015-03-13 10:07:31,436 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741899_1075 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741899 for deletion
2015-03-13 10:07:31,436 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741932_1108 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741932 for deletion
2015-03-13 10:07:31,436 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741934_1110 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741934 for deletion
2015-03-13 10:07:31,436 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741838_1014 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741838 for deletion
2015-03-13 10:07:31,436 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741894_1070 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741894
2015-03-13 10:07:31,436 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741899_1075 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741899
2015-03-13 10:07:31,436 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741935_1111 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741935 for deletion
2015-03-13 10:07:31,437 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741938_1114 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741938 for deletion
2015-03-13 10:07:31,437 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741932_1108 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741932
2015-03-13 10:07:31,436 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741929_1105 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741929
2015-03-13 10:07:31,437 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741935_1111 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741935
2015-03-13 10:07:31,437 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741930_1106 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741930
2015-03-13 10:07:31,438 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741938_1114 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741938
2015-03-13 10:07:31,438 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741866_1042 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741866
2015-03-13 10:07:31,437 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741939_1115 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741939 for deletion
2015-03-13 10:07:31,438 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741940_1116 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741940 for deletion
2015-03-13 10:07:31,438 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741941_1117 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741941 for deletion
2015-03-13 10:07:31,438 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741942_1118 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741942 for deletion
2015-03-13 10:07:31,438 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741943_1119 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741943 for deletion
2015-03-13 10:07:31,438 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741940_1116 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741940
2015-03-13 10:07:31,438 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741879_1055 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741879 for deletion
2015-03-13 10:07:31,439 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741945_1121 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741945 for deletion
2015-03-13 10:07:31,439 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741942_1118 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741942
2015-03-13 10:07:31,438 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741934_1110 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741934
2015-03-13 10:07:31,439 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741853_1029 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741853 for deletion
2015-03-13 10:07:31,439 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741838_1014 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741838
2015-03-13 10:07:31,439 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741939_1115 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741939
2015-03-13 10:07:31,440 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741941_1117 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741941
2015-03-13 10:07:31,440 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741853_1029 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741853
2015-03-13 10:07:31,440 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741943_1119 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741943
2015-03-13 10:07:31,440 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741879_1055 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741879
2015-03-13 10:07:31,440 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741945_1121 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741945
2015-03-13 10:07:31,457 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741952_1128
2015-03-13 10:07:31,550 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:31,550 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:31,551 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0010 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:07:31,551 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0011_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:07:31,551 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0010
2015-03-13 10:07:31,551 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0010
2015-03-13 10:07:31,551 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0010
2015-03-13 10:07:31,551 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0010 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:07:31,551 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0010, with delay of 10800 seconds
2015-03-13 10:07:31,551 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0010
2015-03-13 10:07:31,551 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0010
2015-03-13 10:07:31,632 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0010 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:07:31,632 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0010
2015-03-13 10:07:31,632 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0010 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:07:31,633 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0010, with delay of 10800 seconds
2015-03-13 10:07:31,633 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0010
2015-03-13 10:07:31,634 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0010
2015-03-13 10:07:31,635 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0010
2015-03-13 10:07:31,636 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0010
2015-03-13 10:07:31,656 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741952_1128
2015-03-13 10:07:31,747 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0010 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:07:31,747 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0010
2015-03-13 10:07:31,747 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0010
2015-03-13 10:07:31,747 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0010
2015-03-13 10:07:31,747 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0010
2015-03-13 10:07:31,747 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0010
2015-03-13 10:07:31,748 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0010 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:07:31,748 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0010, with delay of 10800 seconds
2015-03-13 10:07:31,784 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741894_1070 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741894 for deletion
2015-03-13 10:07:31,784 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741929_1105 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741929 for deletion
2015-03-13 10:07:31,784 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741930_1106 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741930 for deletion
2015-03-13 10:07:31,784 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741894_1070 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741894
2015-03-13 10:07:31,785 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741899_1075 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741899 for deletion
2015-03-13 10:07:31,785 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741933_1109 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741933 for deletion
2015-03-13 10:07:31,785 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741929_1105 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741929
2015-03-13 10:07:31,785 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741930_1106 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741930
2015-03-13 10:07:31,785 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741838_1014 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741838 for deletion
2015-03-13 10:07:31,785 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741933_1109 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741933
2015-03-13 10:07:31,785 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741935_1111 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741935 for deletion
2015-03-13 10:07:31,785 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741899_1075 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741899
2015-03-13 10:07:31,785 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741938_1114 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741938 for deletion
2015-03-13 10:07:31,785 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741838_1014 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741838
2015-03-13 10:07:31,786 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741939_1115 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741939 for deletion
2015-03-13 10:07:31,786 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741935_1111 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741935
2015-03-13 10:07:31,786 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741940_1116 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741940 for deletion
2015-03-13 10:07:31,786 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741909_1085 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741909 for deletion
2015-03-13 10:07:31,786 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741942_1118 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741942 for deletion
2015-03-13 10:07:31,786 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741879_1055 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741879 for deletion
2015-03-13 10:07:31,786 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741943_1119 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741943 for deletion
2015-03-13 10:07:31,786 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741945_1121 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741945 for deletion
2015-03-13 10:07:31,786 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741853_1029 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741853 for deletion
2015-03-13 10:07:31,786 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741939_1115 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741939
2015-03-13 10:07:31,786 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741938_1114 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741938
2015-03-13 10:07:31,787 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741942_1118 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741942
2015-03-13 10:07:31,787 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741940_1116 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741940
2015-03-13 10:07:31,787 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741879_1055 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741879
2015-03-13 10:07:31,787 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741909_1085 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741909
2015-03-13 10:07:31,787 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741943_1119 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741943
2015-03-13 10:07:31,788 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741945_1121 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741945
2015-03-13 10:07:31,788 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741853_1029 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741853
2015-03-13 10:07:31,796 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:07:31,835 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741948_1124
2015-03-13 10:07:32,029 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741952_1128
2015-03-13 10:07:32,067 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:32,067 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:32,068 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:32,068 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:32,198 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:07:32,328 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426266260362_0011_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000003.tokens
2015-03-13 10:07:32,329 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0011 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0011
2015-03-13 10:07:32,442 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:07:32,551 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:32,551 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:32,578 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1426266260362_0011_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000002.tokens
2015-03-13 10:07:32,579 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0011 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0011
2015-03-13 10:07:32,685 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:07:32,830 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426266260362_0011_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000005.tokens
2015-03-13 10:07:32,830 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0011 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0011
2015-03-13 10:07:33,071 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:33,071 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:33,071 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:33,071 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:33,553 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:33,553 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:34,077 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:34,077 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:34,077 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:34,077 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:34,554 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:34,555 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:35,079 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:35,079 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:35,080 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:35,080 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:35,556 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:35,556 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:36,081 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:36,081 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:36,081 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:36,082 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:36,562 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:36,562 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:37,087 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:37,087 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:37,088 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:37,088 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:37,567 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:37,567 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:38,091 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:38,091 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:38,092 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:38,092 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:38,571 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:38,571 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:39,096 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:39,096 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:39,096 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:39,096 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:39,126 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.split	dst=null	perm=null
2015-03-13 10:07:39,313 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61676, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0011_m_000004_0_2145797473_1, offset: 1024, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741949_1125, duration: 160000
2015-03-13 10:07:39,400 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.split	dst=null	perm=null
2015-03-13 10:07:39,514 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.split	dst=null	perm=null
2015-03-13 10:07:39,542 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:07:39,547 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61679, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0011_m_000004_0_2145797473_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 155000
2015-03-13 10:07:39,568 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.split	dst=null	perm=null
2015-03-13 10:07:39,574 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.split	dst=null	perm=null
2015-03-13 10:07:39,576 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:39,576 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:39,599 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/_temporary/attempt_1426266260362_0011_m_000004_0/part-00004	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:39,627 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61682, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0011_m_000001_0_834909410_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741949_1125, duration: 168000
2015-03-13 10:07:39,692 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61683, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0011_m_000000_0_-712547705_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741949_1125, duration: 198000
2015-03-13 10:07:39,727 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61684, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0011_m_000003_0_-1611345778_1, offset: 1024, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741949_1125, duration: 160000
2015-03-13 10:07:39,741 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61685, bytes: 1282, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0011_m_000002_0_-2034072183_1, offset: 512, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741949_1125, duration: 171000
2015-03-13 10:07:39,769 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:07:39,773 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61682, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0011_m_000001_0_834909410_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 167000
2015-03-13 10:07:39,818 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/_temporary/attempt_1426266260362_0011_m_000001_0/part-00001	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:39,820 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:07:39,856 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:07:39,860 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61686, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0011_m_000003_0_-1611345778_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 147000
2015-03-13 10:07:39,880 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/_temporary/attempt_1426266260362_0011_m_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:39,880 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:07:39,884 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61687, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0011_m_000002_0_-2034072183_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 150000
2015-03-13 10:07:39,909 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/_temporary/attempt_1426266260362_0011_m_000003_0/part-00003	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:39,938 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/_temporary/attempt_1426266260362_0011_m_000002_0/part-00002	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:39,997 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:07:40,016 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:07:40,022 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:07:40,026 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61688, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0011_m_000004_0_2145797473_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 145000
2015-03-13 10:07:40,053 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/_temporary/attempt_1426266260362_0011_m_000004_0/part-00004. BP-1005356445-10.1.1.144-1426266257849 blk_1073741953_1129{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:07:40,097 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:40,098 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:40,098 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:40,098 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:40,120 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741953_1129 src: /127.0.0.1:61689 dest: /127.0.0.1:60696
2015-03-13 10:07:40,122 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741953_1129 src: /127.0.0.1:61690 dest: /127.0.0.1:60689
2015-03-13 10:07:40,123 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741953_1129 src: /127.0.0.1:61691 dest: /127.0.0.1:60686
2015-03-13 10:07:40,130 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61691, dest: /127.0.0.1:60686, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0011_m_000004_0_2145797473_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741953_1129, duration: 5825000
2015-03-13 10:07:40,131 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741953_1129, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:40,131 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741953_1129{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:07:40,131 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61690, dest: /127.0.0.1:60689, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0011_m_000004_0_2145797473_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741953_1129, duration: 6547000
2015-03-13 10:07:40,131 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741953_1129, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:40,132 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741953_1129{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:07:40,132 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61689, dest: /127.0.0.1:60696, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0011_m_000004_0_2145797473_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741953_1129, duration: 7651000
2015-03-13 10:07:40,132 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741953_1129, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:40,133 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741953_1129{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:07:40,141 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/_temporary/attempt_1426266260362_0011_m_000004_0/part-00004 is closed by DFSClient_attempt_1426266260362_0011_m_000004_0_2145797473_1
2015-03-13 10:07:40,150 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/_temporary/attempt_1426266260362_0011_m_000004_0	dst=null	perm=null
2015-03-13 10:07:40,155 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/_temporary/attempt_1426266260362_0011_m_000004_0	dst=null	perm=null
2015-03-13 10:07:40,157 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/task_1426266260362_0011_m_000004	dst=null	perm=null
2015-03-13 10:07:40,161 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/_temporary/attempt_1426266260362_0011_m_000004_0	dst=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/task_1426266260362_0011_m_000004	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:07:40,182 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0011_01_000006
2015-03-13 10:07:40,182 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0011	CONTAINERID=container_1426266260362_0011_01_000006
2015-03-13 10:07:40,182 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:07:40,182 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0011_01_000006
2015-03-13 10:07:40,182 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:40,182 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:07:40,195 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0011_01_000006 is : 143
2015-03-13 10:07:40,196 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job_1426266260362_0011_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073741954_1130{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:07:40,198 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741954_1130 src: /127.0.0.1:61692 dest: /127.0.0.1:60689
2015-03-13 10:07:40,199 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741954_1130 src: /127.0.0.1:61693 dest: /127.0.0.1:60696
2015-03-13 10:07:40,201 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741954_1130 src: /127.0.0.1:61694 dest: /127.0.0.1:60693
2015-03-13 10:07:40,205 INFO  hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job_1426266260362_0011_1.jhist for DFSClient_NONMAPREDUCE_1644732514_1
2015-03-13 10:07:40,207 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:07:40,207 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000006
2015-03-13 10:07:40,208 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0011	CONTAINERID=container_1426266260362_0011_01_000006
2015-03-13 10:07:40,208 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:07:40,208 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0011_01_000006 from application application_1426266260362_0011
2015-03-13 10:07:40,209 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:40,209 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0011
2015-03-13 10:07:40,209 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000006
2015-03-13 10:07:40,209 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000006
2015-03-13 10:07:40,208 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000006
2015-03-13 10:07:40,284 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:07:40,292 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:07:40,295 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:07:40,299 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61695, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0011_m_000001_0_834909410_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 164000
2015-03-13 10:07:40,325 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:07:40,330 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/_temporary/attempt_1426266260362_0011_m_000001_0/part-00001. BP-1005356445-10.1.1.144-1426266257849 blk_1073741955_1131{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:07:40,335 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:07:40,338 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:07:40,344 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61697, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0011_m_000000_0_-712547705_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 145000
2015-03-13 10:07:40,349 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61697, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0011_m_000000_0_-712547705_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 185000
2015-03-13 10:07:40,372 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:07:40,374 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741955_1131 src: /127.0.0.1:61696 dest: /127.0.0.1:60693
2015-03-13 10:07:40,376 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741955_1131 src: /127.0.0.1:61698 dest: /127.0.0.1:60696
2015-03-13 10:07:40,376 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/_temporary/attempt_1426266260362_0011_m_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073741956_1132{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:07:40,377 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741955_1131 src: /127.0.0.1:61699 dest: /127.0.0.1:60689
2015-03-13 10:07:40,388 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61699, dest: /127.0.0.1:60689, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0011_m_000001_0_834909410_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741955_1131, duration: 8954000
2015-03-13 10:07:40,388 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741955_1131, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:40,388 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741955_1131{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:40,389 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61698, dest: /127.0.0.1:60696, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0011_m_000001_0_834909410_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741955_1131, duration: 9620000
2015-03-13 10:07:40,389 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741955_1131, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:40,389 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741955_1131{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:40,389 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61696, dest: /127.0.0.1:60693, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0011_m_000001_0_834909410_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741955_1131, duration: 10327000
2015-03-13 10:07:40,390 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741955_1131, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:40,390 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741955_1131{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:40,427 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/_temporary/attempt_1426266260362_0011_m_000001_0/part-00001 is closed by DFSClient_attempt_1426266260362_0011_m_000001_0_834909410_1
2015-03-13 10:07:40,427 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741956_1132 src: /127.0.0.1:61700 dest: /127.0.0.1:60686
2015-03-13 10:07:40,429 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741956_1132 src: /127.0.0.1:61701 dest: /127.0.0.1:60693
2015-03-13 10:07:40,430 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741956_1132 src: /127.0.0.1:61702 dest: /127.0.0.1:60689
2015-03-13 10:07:40,438 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61702, dest: /127.0.0.1:60689, bytes: 138, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0011_m_000000_0_-712547705_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741956_1132, duration: 6166000
2015-03-13 10:07:40,438 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741956_1132, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:40,438 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741956_1132{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:40,439 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61701, dest: /127.0.0.1:60693, bytes: 138, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0011_m_000000_0_-712547705_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741956_1132, duration: 6761000
2015-03-13 10:07:40,439 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741956_1132, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:40,439 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741956_1132{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:40,439 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61700, dest: /127.0.0.1:60686, bytes: 138, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0011_m_000000_0_-712547705_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741956_1132, duration: 7565000
2015-03-13 10:07:40,440 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741956_1132, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:40,440 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741956_1132{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:40,445 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/_temporary/attempt_1426266260362_0011_m_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0011_m_000000_0_-712547705_1
2015-03-13 10:07:40,446 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/_temporary/attempt_1426266260362_0011_m_000001_0	dst=null	perm=null
2015-03-13 10:07:40,454 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/_temporary/attempt_1426266260362_0011_m_000001_0	dst=null	perm=null
2015-03-13 10:07:40,455 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/task_1426266260362_0011_m_000001	dst=null	perm=null
2015-03-13 10:07:40,458 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/_temporary/attempt_1426266260362_0011_m_000001_0	dst=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/task_1426266260362_0011_m_000001	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:07:40,470 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0011_01_000003
2015-03-13 10:07:40,470 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0011	CONTAINERID=container_1426266260362_0011_01_000003
2015-03-13 10:07:40,470 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:07:40,470 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0011_01_000003
2015-03-13 10:07:40,470 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:40,470 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:07:40,471 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:40,471 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:40,483 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0011_01_000003 is : 143
2015-03-13 10:07:40,494 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:07:40,494 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000003
2015-03-13 10:07:40,494 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000003
2015-03-13 10:07:40,495 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000003
2015-03-13 10:07:40,495 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000003
2015-03-13 10:07:40,495 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:07:40,495 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0011	CONTAINERID=container_1426266260362_0011_01_000003
2015-03-13 10:07:40,496 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:07:40,496 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0011_01_000003 from application application_1426266260362_0011
2015-03-13 10:07:40,497 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:40,497 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0011
2015-03-13 10:07:40,498 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:07:40,505 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:07:40,505 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:07:40,508 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:07:40,511 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61703, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0011_m_000003_0_-1611345778_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 166000
2015-03-13 10:07:40,512 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61704, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0011_m_000002_0_-2034072183_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 155000
2015-03-13 10:07:40,521 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/_temporary/attempt_1426266260362_0011_m_000000_0	dst=null	perm=null
2015-03-13 10:07:40,527 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/_temporary/attempt_1426266260362_0011_m_000000_0	dst=null	perm=null
2015-03-13 10:07:40,528 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/task_1426266260362_0011_m_000000	dst=null	perm=null
2015-03-13 10:07:40,538 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/_temporary/attempt_1426266260362_0011_m_000002_0/part-00002. BP-1005356445-10.1.1.144-1426266257849 blk_1073741957_1133{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:07:40,538 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/_temporary/attempt_1426266260362_0011_m_000000_0	dst=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/task_1426266260362_0011_m_000000	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:07:40,542 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/_temporary/attempt_1426266260362_0011_m_000003_0/part-00003. BP-1005356445-10.1.1.144-1426266257849 blk_1073741958_1134{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:07:40,549 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0011_01_000002
2015-03-13 10:07:40,549 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0011	CONTAINERID=container_1426266260362_0011_01_000002
2015-03-13 10:07:40,550 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:07:40,550 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:40,552 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:07:40,552 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0011_01_000003
2015-03-13 10:07:40,552 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:40,552 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:40,552 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0011_01_000002
2015-03-13 10:07:40,553 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0011_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:07:40,553 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0011_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:07:40,553 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0011	CONTAINERID=container_1426266260362_0011_01_000003
2015-03-13 10:07:40,553 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0011_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:07:40,553 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:07:40,553 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0011_01_000003, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:40,553 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:40,553 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:07:40,553 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0011_000001 released container container_1426266260362_0011_01_000003 on node: host: 10.1.1.144:60723 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:07:40,571 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0011_01_000002 is : 143
2015-03-13 10:07:40,584 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:07:40,585 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000002
2015-03-13 10:07:40,586 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000002
2015-03-13 10:07:40,586 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000002
2015-03-13 10:07:40,587 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000002
2015-03-13 10:07:40,588 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0011	CONTAINERID=container_1426266260362_0011_01_000002
2015-03-13 10:07:40,588 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:07:40,588 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0011_01_000002 from application application_1426266260362_0011
2015-03-13 10:07:40,588 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:40,588 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0011
2015-03-13 10:07:40,604 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741957_1133 src: /127.0.0.1:61705 dest: /127.0.0.1:60696
2015-03-13 10:07:40,605 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741957_1133 src: /127.0.0.1:61707 dest: /127.0.0.1:60686
2015-03-13 10:07:40,607 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741957_1133 src: /127.0.0.1:61708 dest: /127.0.0.1:60693
2015-03-13 10:07:40,609 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741958_1134 src: /127.0.0.1:61706 dest: /127.0.0.1:60689
2015-03-13 10:07:40,610 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741958_1134 src: /127.0.0.1:61709 dest: /127.0.0.1:60693
2015-03-13 10:07:40,612 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741958_1134 src: /127.0.0.1:61710 dest: /127.0.0.1:60696
2015-03-13 10:07:40,619 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61708, dest: /127.0.0.1:60693, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0011_m_000002_0_-2034072183_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741957_1133, duration: 10677000
2015-03-13 10:07:40,619 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741957_1133, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:40,619 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741957_1133{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:07:40,620 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61707, dest: /127.0.0.1:60686, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0011_m_000002_0_-2034072183_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741957_1133, duration: 11372000
2015-03-13 10:07:40,620 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741957_1133, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:40,620 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741957_1133{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:07:40,620 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61705, dest: /127.0.0.1:60696, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0011_m_000002_0_-2034072183_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741957_1133, duration: 12021000
2015-03-13 10:07:40,621 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741957_1133, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:40,621 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741957_1133{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:07:40,631 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61710, dest: /127.0.0.1:60696, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0011_m_000003_0_-1611345778_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741958_1134, duration: 17921000
2015-03-13 10:07:40,631 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741958_1134, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:40,632 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741958_1134{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:07:40,632 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61709, dest: /127.0.0.1:60693, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0011_m_000003_0_-1611345778_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741958_1134, duration: 18554000
2015-03-13 10:07:40,632 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741958_1134, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:40,633 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741958_1134{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:07:40,633 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61706, dest: /127.0.0.1:60689, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0011_m_000003_0_-1611345778_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741958_1134, duration: 19418000
2015-03-13 10:07:40,633 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741958_1134{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:07:40,633 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741958_1134, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:40,641 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/_temporary/attempt_1426266260362_0011_m_000002_0/part-00002 is closed by DFSClient_attempt_1426266260362_0011_m_000002_0_-2034072183_1
2015-03-13 10:07:40,648 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/_temporary/attempt_1426266260362_0011_m_000003_0/part-00003 is closed by DFSClient_attempt_1426266260362_0011_m_000003_0_-1611345778_1
2015-03-13 10:07:40,658 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/_temporary/attempt_1426266260362_0011_m_000003_0	dst=null	perm=null
2015-03-13 10:07:40,663 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/_temporary/attempt_1426266260362_0011_m_000003_0	dst=null	perm=null
2015-03-13 10:07:40,664 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/_temporary/attempt_1426266260362_0011_m_000002_0	dst=null	perm=null
2015-03-13 10:07:40,664 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/task_1426266260362_0011_m_000003	dst=null	perm=null
2015-03-13 10:07:40,667 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/_temporary/attempt_1426266260362_0011_m_000003_0	dst=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/task_1426266260362_0011_m_000003	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:07:40,670 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/_temporary/attempt_1426266260362_0011_m_000002_0	dst=null	perm=null
2015-03-13 10:07:40,671 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/task_1426266260362_0011_m_000002	dst=null	perm=null
2015-03-13 10:07:40,675 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/_temporary/attempt_1426266260362_0011_m_000002_0	dst=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/task_1426266260362_0011_m_000002	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:07:40,678 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0011_01_000005
2015-03-13 10:07:40,678 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0011	CONTAINERID=container_1426266260362_0011_01_000005
2015-03-13 10:07:40,678 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:07:40,678 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:07:40,678 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0011_01_000005
2015-03-13 10:07:40,678 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0011_01_000002
2015-03-13 10:07:40,679 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:40,679 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:07:40,679 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0011_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:07:40,679 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0011_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:07:40,679 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0011	CONTAINERID=container_1426266260362_0011_01_000002
2015-03-13 10:07:40,679 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0011_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:07:40,680 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:07:40,680 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0011_01_000002, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:40,680 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:40,680 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:07:40,680 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0011_000001 released container container_1426266260362_0011_01_000002 on node: host: 10.1.1.144:60723 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:07:40,691 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0011_01_000005 is : 143
2015-03-13 10:07:40,695 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0011_01_000004
2015-03-13 10:07:40,696 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0011	CONTAINERID=container_1426266260362_0011_01_000004
2015-03-13 10:07:40,696 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:40,696 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: -1000
2015-03-13 10:07:40,700 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:40,702 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_1644732514_1
2015-03-13 10:07:40,705 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1	dst=null	perm=null
2015-03-13 10:07:40,705 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:07:40,705 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:07:40,706 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000005
2015-03-13 10:07:40,706 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000005
2015-03-13 10:07:40,706 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000005
2015-03-13 10:07:40,707 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000005
2015-03-13 10:07:40,707 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0011_01_000004
2015-03-13 10:07:40,712 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4	dst=null	perm=null
2015-03-13 10:07:40,713 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4	dst=null	perm=null
2015-03-13 10:07:40,715 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/task_1426266260362_0011_m_000000	dst=null	perm=null
2015-03-13 10:07:40,716 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/part-00000	dst=null	perm=null
2015-03-13 10:07:40,720 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/task_1426266260362_0011_m_000000/part-00000	dst=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/part-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:40,720 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0011_01_000004 is : 143
2015-03-13 10:07:40,723 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4	dst=null	perm=null
2015-03-13 10:07:40,724 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4	dst=null	perm=null
2015-03-13 10:07:40,725 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/task_1426266260362_0011_m_000001	dst=null	perm=null
2015-03-13 10:07:40,726 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/part-00001	dst=null	perm=null
2015-03-13 10:07:40,728 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/task_1426266260362_0011_m_000001/part-00001	dst=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/part-00001	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:40,729 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4	dst=null	perm=null
2015-03-13 10:07:40,730 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4	dst=null	perm=null
2015-03-13 10:07:40,731 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/task_1426266260362_0011_m_000002	dst=null	perm=null
2015-03-13 10:07:40,732 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/part-00002	dst=null	perm=null
2015-03-13 10:07:40,733 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0011	CONTAINERID=container_1426266260362_0011_01_000005
2015-03-13 10:07:40,733 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:07:40,733 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:07:40,733 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0011_01_000005 from application application_1426266260362_0011
2015-03-13 10:07:40,734 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:40,734 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0011
2015-03-13 10:07:40,734 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000004
2015-03-13 10:07:40,734 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/task_1426266260362_0011_m_000002/part-00002	dst=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/part-00002	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:40,734 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000004
2015-03-13 10:07:40,735 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4	dst=null	perm=null
2015-03-13 10:07:40,736 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000004
2015-03-13 10:07:40,737 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4	dst=null	perm=null
2015-03-13 10:07:40,738 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/task_1426266260362_0011_m_000003	dst=null	perm=null
2015-03-13 10:07:40,739 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/part-00003	dst=null	perm=null
2015-03-13 10:07:40,741 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000004
2015-03-13 10:07:40,741 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/task_1426266260362_0011_m_000003/part-00003	dst=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/part-00003	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:40,741 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0011	CONTAINERID=container_1426266260362_0011_01_000004
2015-03-13 10:07:40,742 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:07:40,742 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0011_01_000004 from application application_1426266260362_0011
2015-03-13 10:07:40,742 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:40,742 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0011
2015-03-13 10:07:40,742 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4	dst=null	perm=null
2015-03-13 10:07:40,743 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4	dst=null	perm=null
2015-03-13 10:07:40,744 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/task_1426266260362_0011_m_000004	dst=null	perm=null
2015-03-13 10:07:40,745 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/part-00004	dst=null	perm=null
2015-03-13 10:07:40,751 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/task_1426266260362_0011_m_000004/part-00004	dst=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/part-00004	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:40,755 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary	dst=null	perm=null
2015-03-13 10:07:40,765 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:40,768 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_SUCCESS is closed by DFSClient_NONMAPREDUCE_1644732514_1
2015-03-13 10:07:40,771 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:40,775 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_1644732514_1
2015-03-13 10:07:40,789 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61694, dest: /127.0.0.1:60693, bytes: 53336, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1644732514_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741954_1130, duration: 587256000
2015-03-13 10:07:40,790 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741954_1130, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:40,790 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741954_1130{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:07:40,791 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61693, dest: /127.0.0.1:60696, bytes: 53336, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1644732514_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741954_1130, duration: 588469000
2015-03-13 10:07:40,791 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741954_1130, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:40,792 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61692, dest: /127.0.0.1:60689, bytes: 53336, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1644732514_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741954_1130, duration: 589886000
2015-03-13 10:07:40,792 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741954_1130, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:40,792 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741954_1130{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:07:40,793 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741954_1130{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:07:40,794 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job_1426266260362_0011_1.jhist is closed by DFSClient_NONMAPREDUCE_1644732514_1
2015-03-13 10:07:40,797 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0011.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:40,800 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0011.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741959_1135{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:07:40,801 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741959_1135 src: /127.0.0.1:61711 dest: /127.0.0.1:60686
2015-03-13 10:07:40,803 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741959_1135 src: /127.0.0.1:61712 dest: /127.0.0.1:60696
2015-03-13 10:07:40,804 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741959_1135 src: /127.0.0.1:61713 dest: /127.0.0.1:60693
2015-03-13 10:07:40,807 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61713, dest: /127.0.0.1:60693, bytes: 410, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1644732514_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741959_1135, duration: 1196000
2015-03-13 10:07:40,807 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741959_1135, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:40,808 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741959_1135{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:07:40,808 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61712, dest: /127.0.0.1:60696, bytes: 410, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1644732514_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741959_1135, duration: 1774000
2015-03-13 10:07:40,808 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741959_1135, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:40,808 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741959_1135{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:07:40,809 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61711, dest: /127.0.0.1:60686, bytes: 410, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1644732514_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741959_1135, duration: 2426000
2015-03-13 10:07:40,809 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741959_1135, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:40,810 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741959_1135{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:07:40,811 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0011.summary_tmp is closed by DFSClient_NONMAPREDUCE_1644732514_1
2015-03-13 10:07:40,815 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0011.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:40,820 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job_1426266260362_0011_1.jhist	dst=null	perm=null
2015-03-13 10:07:40,822 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0011-1426266445118-soberoi-%5B65C1F8B7B9BE47B0A23DAB67E3AF740D%2F3CA34A330FF64917-1426266460776-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:07:40,826 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job_1426266260362_0011_1.jhist	dst=null	perm=null
2015-03-13 10:07:40,827 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0011-1426266445118-soberoi-%5B65C1F8B7B9BE47B0A23DAB67E3AF740D%2F3CA34A330FF64917-1426266460776-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:07:40,829 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job_1426266260362_0011_1.jhist	dst=null	perm=null
2015-03-13 10:07:40,831 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0011-1426266445118-soberoi-%5B65C1F8B7B9BE47B0A23DAB67E3AF740D%2F3CA34A330FF64917-1426266460776-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:40,834 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61714, bytes: 53756, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1644732514_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741954_1130, duration: 186000
2015-03-13 10:07:40,836 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0011-1426266445118-soberoi-%5B65C1F8B7B9BE47B0A23DAB67E3AF740D%2F3CA34A330FF64917-1426266460776-5-0-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741960_1136{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:07:40,838 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741960_1136 src: /127.0.0.1:61715 dest: /127.0.0.1:60696
2015-03-13 10:07:40,839 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741960_1136 src: /127.0.0.1:61716 dest: /127.0.0.1:60689
2015-03-13 10:07:40,841 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741960_1136 src: /127.0.0.1:61717 dest: /127.0.0.1:60693
2015-03-13 10:07:40,843 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61717, dest: /127.0.0.1:60693, bytes: 53336, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1644732514_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741960_1136, duration: 1578000
2015-03-13 10:07:40,844 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741960_1136, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:40,844 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741960_1136{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:07:40,844 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61716, dest: /127.0.0.1:60689, bytes: 53336, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1644732514_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741960_1136, duration: 2175000
2015-03-13 10:07:40,844 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741960_1136, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:40,845 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61715, dest: /127.0.0.1:60696, bytes: 53336, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1644732514_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741960_1136, duration: 2884000
2015-03-13 10:07:40,845 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741960_1136, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:40,845 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741960_1136{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:07:40,846 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741960_1136{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:07:40,847 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0011-1426266445118-soberoi-%5B65C1F8B7B9BE47B0A23DAB67E3AF740D%2F3CA34A330FF64917-1426266460776-5-0-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_1644732514_1
2015-03-13 10:07:40,849 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0011-1426266445118-soberoi-%5B65C1F8B7B9BE47B0A23DAB67E3AF740D%2F3CA34A330FF64917-1426266460776-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:40,852 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job_1426266260362_0011_1_conf.xml	dst=null	perm=null
2015-03-13 10:07:40,853 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0011_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:07:40,855 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job_1426266260362_0011_1_conf.xml	dst=null	perm=null
2015-03-13 10:07:40,856 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0011_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:07:40,857 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job_1426266260362_0011_1_conf.xml	dst=null	perm=null
2015-03-13 10:07:40,860 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0011_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:40,862 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61718, bytes: 91486, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1644732514_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741952_1128, duration: 324000
2015-03-13 10:07:40,865 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0011_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741961_1137{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:07:40,867 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741961_1137 src: /127.0.0.1:61719 dest: /127.0.0.1:60696
2015-03-13 10:07:40,868 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741961_1137 src: /127.0.0.1:61720 dest: /127.0.0.1:60686
2015-03-13 10:07:40,870 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741961_1137 src: /127.0.0.1:61721 dest: /127.0.0.1:60689
2015-03-13 10:07:40,873 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61721, dest: /127.0.0.1:60689, bytes: 90774, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1644732514_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741961_1137, duration: 1805000
2015-03-13 10:07:40,873 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741961_1137, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:40,874 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741961_1137{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:40,874 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61720, dest: /127.0.0.1:60686, bytes: 90774, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1644732514_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741961_1137, duration: 2097000
2015-03-13 10:07:40,874 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741961_1137, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:40,874 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741961_1137{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:40,875 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61719, dest: /127.0.0.1:60696, bytes: 90774, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1644732514_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741961_1137, duration: 3167000
2015-03-13 10:07:40,875 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741961_1137, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:40,875 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741961_1137{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:40,877 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0011_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_1644732514_1
2015-03-13 10:07:40,879 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0011_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:40,880 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0011.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0011.summary	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:40,882 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0011_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0011_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:40,883 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0011-1426266445118-soberoi-%5B65C1F8B7B9BE47B0A23DAB67E3AF740D%2F3CA34A330FF64917-1426266460776-5-0-SUCCEEDED-default.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0011-1426266445118-soberoi-%5B65C1F8B7B9BE47B0A23DAB67E3AF740D%2F3CA34A330FF64917-1426266460776-5-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:40,889 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0011_000001 State change from RUNNING to FINISHING
2015-03-13 10:07:40,889 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0011
2015-03-13 10:07:40,889 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0011 State change from RUNNING to REMOVING
2015-03-13 10:07:40,889 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0011
2015-03-13 10:07:40,889 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0011 State change from REMOVING to FINISHING
2015-03-13 10:07:41,188 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:41,189 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:07:41,189 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0011_01_000006
2015-03-13 10:07:41,189 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0011_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:07:41,190 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0011_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:07:41,190 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0011	CONTAINERID=container_1426266260362_0011_01_000006
2015-03-13 10:07:41,190 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0011_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:07:41,190 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:07:41,190 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0011_01_000006, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:41,190 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:41,190 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:07:41,191 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0011_000001 released container container_1426266260362_0011_01_000006 on node: host: 10.1.1.144:60715 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:07:41,467 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741956_1132
2015-03-13 10:07:41,467 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741957_1133
2015-03-13 10:07:41,468 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741958_1134
2015-03-13 10:07:41,469 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741954_1130
2015-03-13 10:07:41,469 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741955_1131
2015-03-13 10:07:41,469 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741959_1135
2015-03-13 10:07:41,470 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741960_1136
2015-03-13 10:07:41,663 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741960_1136
2015-03-13 10:07:41,663 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741958_1134
2015-03-13 10:07:41,664 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741955_1131
2015-03-13 10:07:41,664 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741954_1130
2015-03-13 10:07:41,664 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741956_1132
2015-03-13 10:07:41,665 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741953_1129
2015-03-13 10:07:41,665 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741961_1137
2015-03-13 10:07:41,699 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:07:41,699 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0011_01_000004
2015-03-13 10:07:41,699 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:07:41,699 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0011_01_000005
2015-03-13 10:07:41,700 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0011_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:07:41,700 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0011_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:07:41,700 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0011	CONTAINERID=container_1426266260362_0011_01_000004
2015-03-13 10:07:41,700 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0011_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:07:41,700 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:07:41,700 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0011_01_000004, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:41,701 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:41,701 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:07:41,701 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0011_000001 released container container_1426266260362_0011_01_000004 on node: host: 10.1.1.144:60723 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:07:41,701 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0011_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:07:41,701 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0011_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:07:41,701 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0011	CONTAINERID=container_1426266260362_0011_01_000005
2015-03-13 10:07:41,701 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0011_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:07:41,701 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:07:41,702 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0011_01_000005, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:41,702 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:41,702 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:07:41,702 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0011_000001 released container container_1426266260362_0011_01_000005 on node: host: 10.1.1.144:60723 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:07:41,844 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741953_1129
2015-03-13 10:07:41,845 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741956_1132
2015-03-13 10:07:41,846 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741961_1137
2015-03-13 10:07:41,846 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741959_1135
2015-03-13 10:07:41,847 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741957_1133
2015-03-13 10:07:41,895 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741948_1124 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60693 127.0.0.1:60686 
2015-03-13 10:07:41,895 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741949_1125 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60686 127.0.0.1:60693 
2015-03-13 10:07:41,896 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741950_1126 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60693 
2015-03-13 10:07:41,896 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741951_1127 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60686 
2015-03-13 10:07:41,896 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741954_1130 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60693 
2015-03-13 10:07:41,897 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741952_1128 127.0.0.1:60689 127.0.0.1:60693 127.0.0.1:60696 
2015-03-13 10:07:41,897 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011	dst=null	perm=null
2015-03-13 10:07:41,922 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [cogrouping] starting step: (1/2) ...tform/joinsintocogrouprhs
2015-03-13 10:07:41,930 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:07:41,938 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:07:41,940 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs	dst=null	perm=null
2015-03-13 10:07:41,941 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:07:41,941 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:07:41,943 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 12
2015-03-13 10:07:41,944 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012	dst=null	perm=null
2015-03-13 10:07:41,945 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012	dst=null	perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:07:41,946 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012	dst=null	perm=soberoi:supergroup:rwx------
2015-03-13 10:07:41,947 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.jar	dst=null	perm=null
2015-03-13 10:07:41,948 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:07:41,950 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073741962_1138{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:07:41,951 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741962_1138 src: /127.0.0.1:61724 dest: /127.0.0.1:60696
2015-03-13 10:07:41,953 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741962_1138 src: /127.0.0.1:61725 dest: /127.0.0.1:60693
2015-03-13 10:07:41,954 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741962_1138 src: /127.0.0.1:61726 dest: /127.0.0.1:60686
2015-03-13 10:07:41,958 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61726, dest: /127.0.0.1:60686, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741962_1138, duration: 2931000
2015-03-13 10:07:41,958 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741962_1138, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:41,959 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741962_1138{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:07:41,959 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61725, dest: /127.0.0.1:60693, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741962_1138, duration: 2792000
2015-03-13 10:07:41,959 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741962_1138, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:41,959 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741962_1138{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:07:41,960 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61724, dest: /127.0.0.1:60696, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741962_1138, duration: 3993000
2015-03-13 10:07:41,960 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741962_1138, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:41,961 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741962_1138{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:07:41,962 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:07:41,963 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.jar
2015-03-13 10:07:41,963 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.jar	dst=null	perm=null
2015-03-13 10:07:41,964 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:07:41,965 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:07:41,966 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:07:41,967 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:07:41,968 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:07:41,968 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:07:41,969 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:07:41,970 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:07:41,970 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:07:41,971 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:07:41,972 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt	dst=null	perm=null
2015-03-13 10:07:41,973 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:07:41,973 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt	dst=null	perm=null
2015-03-13 10:07:41,974 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt	dst=null	perm=null
2015-03-13 10:07:41,974 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:07:41,975 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt	dst=null	perm=null
2015-03-13 10:07:41,976 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt	dst=null	perm=null
2015-03-13 10:07:41,976 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:07:41,977 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt	dst=null	perm=null
2015-03-13 10:07:41,978 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt	dst=null	perm=null
2015-03-13 10:07:41,978 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:07:41,978 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt	dst=null	perm=null
2015-03-13 10:07:41,980 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:07:41,981 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:07:41,981 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.split
2015-03-13 10:07:41,982 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.split	dst=null	perm=null
2015-03-13 10:07:41,983 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073741963_1139{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:07:41,984 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741963_1139 src: /127.0.0.1:61727 dest: /127.0.0.1:60696
2015-03-13 10:07:41,985 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741963_1139 src: /127.0.0.1:61728 dest: /127.0.0.1:60686
2015-03-13 10:07:41,986 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741963_1139 src: /127.0.0.1:61729 dest: /127.0.0.1:60693
2015-03-13 10:07:41,987 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741963_1139 src: /127.0.0.1:61730 dest: /127.0.0.1:60689
2015-03-13 10:07:41,989 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61730, dest: /127.0.0.1:60689, bytes: 1772, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741963_1139, duration: 1430000
2015-03-13 10:07:41,990 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741963_1139, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:41,990 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741963_1139{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:41,990 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61729, dest: /127.0.0.1:60693, bytes: 1772, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741963_1139, duration: 1730000
2015-03-13 10:07:41,990 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741963_1139, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:41,991 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741963_1139{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:41,991 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61728, dest: /127.0.0.1:60686, bytes: 1772, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741963_1139, duration: 2624000
2015-03-13 10:07:41,991 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741963_1139, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:41,991 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741963_1139{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:41,991 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61727, dest: /127.0.0.1:60696, bytes: 1772, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741963_1139, duration: 3042000
2015-03-13 10:07:41,992 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741963_1139, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:41,993 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741963_1139{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:41,994 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:07:41,995 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:07:41,996 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:07:41,997 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073741964_1140{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:07:41,999 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741964_1140 src: /127.0.0.1:61731 dest: /127.0.0.1:60686
2015-03-13 10:07:42,000 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741964_1140 src: /127.0.0.1:61732 dest: /127.0.0.1:60693
2015-03-13 10:07:42,001 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741964_1140 src: /127.0.0.1:61733 dest: /127.0.0.1:60689
2015-03-13 10:07:42,004 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61733, dest: /127.0.0.1:60689, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741964_1140, duration: 1039000
2015-03-13 10:07:42,004 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741964_1140, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:42,004 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741964_1140{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:42,004 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61732, dest: /127.0.0.1:60693, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741964_1140, duration: 1575000
2015-03-13 10:07:42,004 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741964_1140, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:42,005 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741964_1140{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:42,005 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61731, dest: /127.0.0.1:60686, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741964_1140, duration: 2386000
2015-03-13 10:07:42,005 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741964_1140, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:42,006 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741964_1140{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:42,007 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:07:42,007 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:07:42,009 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:07:42,010 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:07:42,012 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:07:42,012 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:07:42,012 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:07:42,017 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073741965_1141{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:07:42,019 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741965_1141 src: /127.0.0.1:61734 dest: /127.0.0.1:60689
2015-03-13 10:07:42,020 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741965_1141 src: /127.0.0.1:61735 dest: /127.0.0.1:60693
2015-03-13 10:07:42,022 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741965_1141 src: /127.0.0.1:61736 dest: /127.0.0.1:60696
2015-03-13 10:07:42,024 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61736, dest: /127.0.0.1:60696, bytes: 100399, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741965_1141, duration: 1486000
2015-03-13 10:07:42,025 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741965_1141, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:42,025 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741965_1141{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:07:42,025 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61735, dest: /127.0.0.1:60693, bytes: 100399, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741965_1141, duration: 1838000
2015-03-13 10:07:42,025 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741965_1141, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:42,025 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741965_1141{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:07:42,026 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61734, dest: /127.0.0.1:60689, bytes: 100399, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741965_1141, duration: 2531000
2015-03-13 10:07:42,026 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741965_1141, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:42,027 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741965_1141{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:07:42,028 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:07:42,028 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0012
2015-03-13 10:07:42,029 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012	dst=null	perm=null
2015-03-13 10:07:42,029 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.xml	dst=null	perm=null
2015-03-13 10:07:42,030 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.xml	dst=null	perm=null
2015-03-13 10:07:42,030 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.jar	dst=null	perm=null
2015-03-13 10:07:42,031 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.jar	dst=null	perm=null
2015-03-13 10:07:42,031 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.split	dst=null	perm=null
2015-03-13 10:07:42,032 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.split	dst=null	perm=null
2015-03-13 10:07:42,032 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:07:42,033 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:07:42,034 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:07:42,034 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:07:42,035 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:07:42,035 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:07:42,036 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:07:42,036 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741959_1135
2015-03-13 10:07:42,036 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:07:42,037 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 12 submitted by user soberoi
2015-03-13 10:07:42,037 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0012
2015-03-13 10:07:42,037 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	IP=10.1.1.144	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1426266260362_0012
2015-03-13 10:07:42,038 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0012
2015-03-13 10:07:42,037 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0012 State change from NEW to NEW_SAVING
2015-03-13 10:07:42,038 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741962_1138
2015-03-13 10:07:42,038 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0012 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:07:42,038 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0012_000001
2015-03-13 10:07:42,038 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741963_1139
2015-03-13 10:07:42,038 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0012_000001 State change from NEW to SUBMITTED
2015-03-13 10:07:42,038 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0012 from user: soberoi activated in queue: default
2015-03-13 10:07:42,039 INFO  capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0012 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:07:42,039 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0012 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:07:42,039 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0012 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:07:42,039 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0012_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:07:42,039 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0012_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:07:42,040 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0012 State change from SUBMITTED to ACCEPTED
2015-03-13 10:07:42,041 INFO  mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0012/
2015-03-13 10:07:42,041 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [cogrouping] submitted hadoop job: job_1426266260362_0012
2015-03-13 10:07:42,041 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [cogrouping] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0012/
2015-03-13 10:07:42,194 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:42,195 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0012_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:07:42,196 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0012	CONTAINERID=container_1426266260362_0012_01_000001
2015-03-13 10:07:42,196 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0012_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:4096, vCores:2> used and <memory:0, vCores:6> available
2015-03-13 10:07:42,196 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0012 container=Container: [ContainerId: container_1426266260362_0012_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0012_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:42,196 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:07:42,196 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0012_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:07:42,197 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:42,197 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0012 AttemptId: appattempt_1426266260362_0012_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0012_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ]
2015-03-13 10:07:42,198 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0012_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:07:42,198 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0012_000001
2015-03-13 10:07:42,198 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0012_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:07:42,198 INFO  amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0012_000001
2015-03-13 10:07:42,199 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0012_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] for AM appattempt_1426266260362_0012_000001
2015-03-13 10:07:42,199 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0012_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-03-13 10:07:42,201 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0012_000001 (auth:SIMPLE)
2015-03-13 10:07:42,202 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0012_01_000001 by user soberoi
2015-03-13 10:07:42,202 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0012
2015-03-13 10:07:42,202 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0012	CONTAINERID=container_1426266260362_0012_01_000001
2015-03-13 10:07:42,202 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0012 transitioned from NEW to INITING
2015-03-13 10:07:42,203 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0012_01_000001 to application application_1426266260362_0012
2015-03-13 10:07:42,203 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0012 transitioned from INITING to RUNNING
2015-03-13 10:07:42,203 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0012_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] for AM appattempt_1426266260362_0012_000001
2015-03-13 10:07:42,203 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0012_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:07:42,203 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:07:42,203 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0012
2015-03-13 10:07:42,203 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:07:42,203 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:07:42,204 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:07:42,204 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:07:42,204 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0012_01_000001
2015-03-13 10:07:42,213 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1426266260362_0012_01_000001.tokens. Credentials list: 
2015-03-13 10:07:42,228 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:07:42,241 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741960_1136
2015-03-13 10:07:42,242 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741957_1133
2015-03-13 10:07:42,243 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741954_1130
2015-03-13 10:07:42,244 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741965_1141
2015-03-13 10:07:42,244 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741953_1129
2015-03-13 10:07:42,244 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741958_1134
2015-03-13 10:07:42,245 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741955_1131
2015-03-13 10:07:42,304 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1426266260362_0012_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000001.tokens
2015-03-13 10:07:42,304 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0012 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0012
2015-03-13 10:07:42,362 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.jar	dst=null	perm=null
2015-03-13 10:07:42,362 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.jar	dst=null	perm=null
2015-03-13 10:07:42,363 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.jar	dst=null	perm=null
2015-03-13 10:07:42,369 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61740, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-250781862_6501, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741962_1138, duration: 481000
2015-03-13 10:07:42,387 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:07:42,404 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:07:42,404 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:07:42,405 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:07:42,411 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61741, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-250781862_6501, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741964_1140, duration: 158000
2015-03-13 10:07:42,424 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:07:42,439 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.split	dst=null	perm=null
2015-03-13 10:07:42,440 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.split	dst=null	perm=null
2015-03-13 10:07:42,440 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.split	dst=null	perm=null
2015-03-13 10:07:42,442 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741961_1137
2015-03-13 10:07:42,446 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61740, bytes: 1788, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-250781862_6501, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741963_1139, duration: 164000
2015-03-13 10:07:42,459 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:07:42,475 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.xml	dst=null	perm=null
2015-03-13 10:07:42,475 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.xml	dst=null	perm=null
2015-03-13 10:07:42,476 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.xml	dst=null	perm=null
2015-03-13 10:07:42,482 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61741, bytes: 101187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-250781862_6501, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741965_1141, duration: 267000
2015-03-13 10:07:42,494 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:07:42,494 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:07:42,519 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:07:42,519 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:42,587 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000001/default_container_executor.sh]
2015-03-13 10:07:42,798 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60696 to replicate blk_1073741962_1138 to datanode(s) 127.0.0.1:60689
2015-03-13 10:07:42,798 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073741948_1124, blk_1073741949_1125, blk_1073741950_1126, blk_1073741951_1127]
2015-03-13 10:07:42,798 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073741952_1128, blk_1073741954_1130, blk_1073741948_1124, blk_1073741949_1125, blk_1073741951_1127]
2015-03-13 10:07:43,196 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:43,196 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:43,196 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0012_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:07:43,436 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741948_1124 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741948 for deletion
2015-03-13 10:07:43,436 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741949_1125 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741949 for deletion
2015-03-13 10:07:43,436 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741950_1126 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741950 for deletion
2015-03-13 10:07:43,436 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741951_1127 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741951 for deletion
2015-03-13 10:07:43,437 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741948_1124 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741948
2015-03-13 10:07:43,437 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741950_1126 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741950
2015-03-13 10:07:43,438 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741949_1125 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741949
2015-03-13 10:07:43,438 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741951_1127 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741951
2015-03-13 10:07:43,439 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741952_1128 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741952 for deletion
2015-03-13 10:07:43,439 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741954_1130 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741954 for deletion
2015-03-13 10:07:43,439 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741948_1124 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741948 for deletion
2015-03-13 10:07:43,439 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741949_1125 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741949 for deletion
2015-03-13 10:07:43,439 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741951_1127 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741951 for deletion
2015-03-13 10:07:43,440 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741952_1128 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741952
2015-03-13 10:07:43,440 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741954_1130 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741954
2015-03-13 10:07:43,440 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741949_1125 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741949
2015-03-13 10:07:43,441 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741948_1124 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741948
2015-03-13 10:07:43,441 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741951_1127 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741951
2015-03-13 10:07:43,797 INFO  datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-318492837-10.1.1.144-60696-1426266259571, infoPort=60697, ipcPort=60698, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073741962_1138 to 127.0.0.1:60689 
2015-03-13 10:07:43,799 INFO  datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073741962_1138 (numBytes=254067) to /127.0.0.1:60689
2015-03-13 10:07:43,800 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741962_1138 src: /127.0.0.1:61742 dest: /127.0.0.1:60689
2015-03-13 10:07:43,802 INFO  datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073741962_1138 src: /127.0.0.1:61742 dest: /127.0.0.1:60689 of size 254067
2015-03-13 10:07:43,803 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741962_1138 size 254067
2015-03-13 10:07:44,129 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:07:44,151 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/COMMIT_STARTED	dst=null	perm=null
2015-03-13 10:07:44,152 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/COMMIT_SUCCESS	dst=null	perm=null
2015-03-13 10:07:44,153 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/COMMIT_FAIL	dst=null	perm=null
2015-03-13 10:07:44,201 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:44,202 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:44,208 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012	dst=null	perm=null
2015-03-13 10:07:44,209 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:07:44,210 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:07:44,497 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:07:44,504 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:07:44,561 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61744, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1275124369_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741964_1140, duration: 202000
2015-03-13 10:07:45,204 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:45,204 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:45,325 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0012_000001 (auth:SIMPLE)
2015-03-13 10:07:45,326 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0012_000001
2015-03-13 10:07:45,326 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi	IP=10.1.1.144	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1426266260362_0012	APPATTEMPTID=appattempt_1426266260362_0012_000001
2015-03-13 10:07:45,326 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0012_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:07:45,326 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0012 State change from ACCEPTED to RUNNING
2015-03-13 10:07:45,347 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job_1426266260362_0012_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:45,349 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:07:45,418 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job_1426266260362_0012_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:45,543 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job_1426266260362_0012_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073741966_1142{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:07:45,584 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741966_1142 src: /127.0.0.1:61750 dest: /127.0.0.1:60693
2015-03-13 10:07:45,586 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741966_1142 src: /127.0.0.1:61751 dest: /127.0.0.1:60686
2015-03-13 10:07:45,588 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741966_1142 src: /127.0.0.1:61752 dest: /127.0.0.1:60689
2015-03-13 10:07:45,595 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61752, dest: /127.0.0.1:60689, bytes: 92713, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1275124369_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741966_1142, duration: 5476000
2015-03-13 10:07:45,595 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741966_1142, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:45,596 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741966_1142{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:45,596 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61751, dest: /127.0.0.1:60686, bytes: 92713, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1275124369_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741966_1142, duration: 6035000
2015-03-13 10:07:45,596 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741966_1142, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:45,597 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741966_1142{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:45,597 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61750, dest: /127.0.0.1:60693, bytes: 92713, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1275124369_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741966_1142, duration: 6992000
2015-03-13 10:07:45,597 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741966_1142, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:45,597 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741966_1142{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:45,601 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job_1426266260362_0012_1_conf.xml is closed by DFSClient_NONMAPREDUCE_1275124369_1
2015-03-13 10:07:45,803 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073741952_1128, blk_1073741954_1130, blk_1073741948_1124, blk_1073741949_1125, blk_1073741950_1126]
2015-03-13 10:07:45,803 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073741952_1128, blk_1073741954_1130, blk_1073741948_1124, blk_1073741949_1125, blk_1073741950_1126, blk_1073741951_1127]
2015-03-13 10:07:46,207 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:46,207 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:46,607 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741952_1128 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741952 for deletion
2015-03-13 10:07:46,607 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741954_1130 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741954 for deletion
2015-03-13 10:07:46,608 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741948_1124 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741948 for deletion
2015-03-13 10:07:46,608 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741949_1125 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741949 for deletion
2015-03-13 10:07:46,608 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741950_1126 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741950 for deletion
2015-03-13 10:07:46,608 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741952_1128 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741952
2015-03-13 10:07:46,608 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741954_1130 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741954
2015-03-13 10:07:46,609 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741949_1125 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741949
2015-03-13 10:07:46,609 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741948_1124 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741948
2015-03-13 10:07:46,609 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741950_1126 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741950
2015-03-13 10:07:46,669 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0012_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:07:46,669 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0012	CONTAINERID=container_1426266260362_0012_01_000002
2015-03-13 10:07:46,669 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0012_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:07:46,670 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0012 container=Container: [ContainerId: container_1426266260362_0012_01_000002, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0012_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:46,670 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:07:46,670 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:46,671 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0012_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:07:46,671 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0012	CONTAINERID=container_1426266260362_0012_01_000003
2015-03-13 10:07:46,671 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0012_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:07:46,671 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0012 container=Container: [ContainerId: container_1426266260362_0012_01_000003, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0012_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:46,671 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:07:46,672 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:46,672 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0012_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:07:46,672 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0012	CONTAINERID=container_1426266260362_0012_01_000004
2015-03-13 10:07:46,672 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0012_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:07:46,673 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0012 container=Container: [ContainerId: container_1426266260362_0012_01_000004, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0012_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:46,673 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:07:46,673 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:46,673 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0012_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:07:46,673 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741962_1138
2015-03-13 10:07:46,673 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0012	CONTAINERID=container_1426266260362_0012_01_000005
2015-03-13 10:07:46,674 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0012_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:07:46,674 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0012 container=Container: [ContainerId: container_1426266260362_0012_01_000005, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0012_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:46,674 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:07:46,674 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:46,674 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741966_1142
2015-03-13 10:07:46,675 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741966_1142
2015-03-13 10:07:46,675 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741963_1139
2015-03-13 10:07:46,675 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741964_1140
2015-03-13 10:07:46,716 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0012_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:07:46,716 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0012	CONTAINERID=container_1426266260362_0012_01_000006
2015-03-13 10:07:46,717 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0012_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:07:46,717 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0012 container=Container: [ContainerId: container_1426266260362_0012_01_000006, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0012_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:46,717 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7
2015-03-13 10:07:46,717 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:46,803 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741952_1128 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741952 for deletion
2015-03-13 10:07:46,803 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741954_1130 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741954 for deletion
2015-03-13 10:07:46,803 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741948_1124 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741948 for deletion
2015-03-13 10:07:46,804 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741952_1128 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741952
2015-03-13 10:07:46,804 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741949_1125 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741949 for deletion
2015-03-13 10:07:46,804 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741950_1126 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741950 for deletion
2015-03-13 10:07:46,804 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741954_1130 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741954
2015-03-13 10:07:46,804 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741949_1125 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741949
2015-03-13 10:07:46,804 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741951_1127 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741951 for deletion
2015-03-13 10:07:46,805 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741948_1124 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741948
2015-03-13 10:07:46,805 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741951_1127 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741951
2015-03-13 10:07:46,805 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741950_1126 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741950
2015-03-13 10:07:46,850 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741966_1142
2015-03-13 10:07:46,850 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741964_1140
2015-03-13 10:07:46,851 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741963_1139
2015-03-13 10:07:46,879 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741965_1141
2015-03-13 10:07:46,879 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741962_1138
2015-03-13 10:07:47,027 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0011_01_000001 succeeded 
2015-03-13 10:07:47,027 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:07:47,027 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0011_01_000001
2015-03-13 10:07:47,037 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000001
2015-03-13 10:07:47,037 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000001
2015-03-13 10:07:47,037 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000001
2015-03-13 10:07:47,037 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0011	CONTAINERID=container_1426266260362_0011_01_000001
2015-03-13 10:07:47,037 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000001
2015-03-13 10:07:47,038 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:07:47,038 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0011_01_000001 from application application_1426266260362_0011
2015-03-13 10:07:47,038 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:47,038 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0011
2015-03-13 10:07:47,051 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741962_1138
2015-03-13 10:07:47,080 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741965_1141
2015-03-13 10:07:47,080 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741964_1140
2015-03-13 10:07:47,081 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741963_1139
2015-03-13 10:07:47,212 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:07:47,212 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0011_01_000001
2015-03-13 10:07:47,213 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:47,213 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0011_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:07:47,213 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0011_000001
2015-03-13 10:07:47,213 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0011_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:07:47,214 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0011_000001 State change from FINISHING to FINISHED
2015-03-13 10:07:47,214 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0011	CONTAINERID=container_1426266260362_0011_01_000001
2015-03-13 10:07:47,214 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0011 State change from FINISHING to FINISHED
2015-03-13 10:07:47,214 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0011_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:07:47,214 INFO  amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0011_000001
2015-03-13 10:07:47,214 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:7168, vCores:6> numContainers=6 user=soberoi user-resources=<memory:7168, vCores:6>
2015-03-13 10:07:47,214 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1426266260362_0011
2015-03-13 10:07:47,215 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0011_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:47,215 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0011,name=[65C1F8B7B9BE47B0A23DAB67E3AF740D/3CA34A330FF64917AFF7341793394779] cogrouping/(2/2),user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0011/jobhistory/job/job_1426266260362_0011,appMasterHost=Edinburgh.local,startTime=1426266445118,finishTime=1426266460889,finalStatus=SUCCEEDED
2015-03-13 10:07:47,215 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:47,215 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6
2015-03-13 10:07:47,215 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0011_000001 released container container_1426266260362_0011_01_000001 on node: host: 10.1.1.144:60715 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:07:47,216 INFO  capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0011_000001 is done. finalState=FINISHED
2015-03-13 10:07:47,216 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0011 requests cleared
2015-03-13 10:07:47,216 INFO  capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0011 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:07:47,216 INFO  capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0011 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:07:47,217 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0011_000001 (auth:SIMPLE)
2015-03-13 10:07:47,218 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0011_01_000001
2015-03-13 10:07:47,360 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0012_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:07:47,360 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0012_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:07:47,360 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0012_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:07:47,360 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0012_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:07:47,360 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0012_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:07:47,387 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.jar	dst=null	perm=null
2015-03-13 10:07:47,388 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.jar	dst=null	perm=null
2015-03-13 10:07:47,397 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.xml	dst=null	perm=null
2015-03-13 10:07:47,399 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.xml	dst=null	perm=null
2015-03-13 10:07:47,400 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:07:47,402 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:07:47,407 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:07:47,408 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:07:47,410 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:07:47,411 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:07:47,486 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0012_000001 (auth:SIMPLE)
2015-03-13 10:07:47,486 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0012_000001 (auth:SIMPLE)
2015-03-13 10:07:47,490 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0012_01_000006 by user soberoi
2015-03-13 10:07:47,490 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0012
2015-03-13 10:07:47,490 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0012	CONTAINERID=container_1426266260362_0012_01_000006
2015-03-13 10:07:47,491 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0012_01_000005 by user soberoi
2015-03-13 10:07:47,491 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0012 transitioned from NEW to INITING
2015-03-13 10:07:47,491 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0012_01_000006 to application application_1426266260362_0012
2015-03-13 10:07:47,491 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0012 transitioned from INITING to RUNNING
2015-03-13 10:07:47,490 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0012_01_000003 by user soberoi
2015-03-13 10:07:47,491 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:07:47,491 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0012	CONTAINERID=container_1426266260362_0012_01_000003
2015-03-13 10:07:47,490 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0012_01_000004 by user soberoi
2015-03-13 10:07:47,492 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0012_01_000003 to application application_1426266260362_0012
2015-03-13 10:07:47,492 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0012_01_000004 to application application_1426266260362_0012
2015-03-13 10:07:47,491 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0012
2015-03-13 10:07:47,492 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0012
2015-03-13 10:07:47,492 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:07:47,492 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0012
2015-03-13 10:07:47,493 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:07:47,493 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:07:47,493 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0012_01_000006
2015-03-13 10:07:47,491 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0012_01_000002 by user soberoi
2015-03-13 10:07:47,494 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0012	CONTAINERID=container_1426266260362_0012_01_000002
2015-03-13 10:07:47,491 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0012
2015-03-13 10:07:47,494 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0012	CONTAINERID=container_1426266260362_0012_01_000005
2015-03-13 10:07:47,492 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0012	CONTAINERID=container_1426266260362_0012_01_000004
2015-03-13 10:07:47,494 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0012_01_000002 to application application_1426266260362_0012
2015-03-13 10:07:47,495 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0012 transitioned from NEW to INITING
2015-03-13 10:07:47,495 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0012_01_000005 to application application_1426266260362_0012
2015-03-13 10:07:47,495 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0012 transitioned from INITING to RUNNING
2015-03-13 10:07:47,495 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:07:47,495 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:07:47,495 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:07:47,496 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:07:47,496 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0012
2015-03-13 10:07:47,496 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0012
2015-03-13 10:07:47,496 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:07:47,496 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0012
2015-03-13 10:07:47,496 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:07:47,496 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:07:47,496 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0012
2015-03-13 10:07:47,496 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0012
2015-03-13 10:07:47,496 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:07:47,496 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0012
2015-03-13 10:07:47,497 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0012
2015-03-13 10:07:47,497 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0012
2015-03-13 10:07:47,497 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:07:47,497 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0012
2015-03-13 10:07:47,497 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0012
2015-03-13 10:07:47,497 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0012
2015-03-13 10:07:47,497 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:07:47,497 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0012
2015-03-13 10:07:47,498 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0012_01_000004
2015-03-13 10:07:47,498 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0012_01_000005
2015-03-13 10:07:47,499 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0012_01_000002
2015-03-13 10:07:47,499 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0012_01_000003
2015-03-13 10:07:47,518 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426266260362_0012_01_000006.tokens. Credentials list: 
2015-03-13 10:07:47,518 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0012_01_000004.tokens. Credentials list: 
2015-03-13 10:07:47,521 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426266260362_0012_01_000005.tokens. Credentials list: 
2015-03-13 10:07:47,522 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1426266260362_0012_01_000002.tokens. Credentials list: 
2015-03-13 10:07:47,524 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426266260362_0012_01_000003.tokens. Credentials list: 
2015-03-13 10:07:47,537 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:07:47,537 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:07:47,614 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426266260362_0012_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000006.tokens
2015-03-13 10:07:47,614 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0012_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000004.tokens
2015-03-13 10:07:47,614 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0012 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0012
2015-03-13 10:07:47,614 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0012 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0012
2015-03-13 10:07:47,671 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:47,671 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:47,672 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:47,672 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:47,672 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0012_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:07:47,672 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0012_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:07:47,672 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0012_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:07:47,673 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0012_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:07:47,679 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.jar	dst=null	perm=null
2015-03-13 10:07:47,679 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.jar	dst=null	perm=null
2015-03-13 10:07:47,679 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.jar	dst=null	perm=null
2015-03-13 10:07:47,679 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.jar	dst=null	perm=null
2015-03-13 10:07:47,680 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.jar	dst=null	perm=null
2015-03-13 10:07:47,680 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.jar	dst=null	perm=null
2015-03-13 10:07:47,687 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61761, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_61318170_6649, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741962_1138, duration: 495000
2015-03-13 10:07:47,687 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61760, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1718762658_6648, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741962_1138, duration: 556000
2015-03-13 10:07:47,707 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:07:47,707 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:07:47,716 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:47,717 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0011 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:07:47,717 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0012_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:07:47,717 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0011
2015-03-13 10:07:47,717 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0011
2015-03-13 10:07:47,717 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0011 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:07:47,717 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0011, with delay of 10800 seconds
2015-03-13 10:07:47,717 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0011
2015-03-13 10:07:47,717 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0011
2015-03-13 10:07:47,718 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0011
2015-03-13 10:07:47,728 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.xml	dst=null	perm=null
2015-03-13 10:07:47,728 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.xml	dst=null	perm=null
2015-03-13 10:07:47,729 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.xml	dst=null	perm=null
2015-03-13 10:07:47,729 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.xml	dst=null	perm=null
2015-03-13 10:07:47,729 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.xml	dst=null	perm=null
2015-03-13 10:07:47,729 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.xml	dst=null	perm=null
2015-03-13 10:07:47,735 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61760, bytes: 101187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1718762658_6648, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741965_1141, duration: 263000
2015-03-13 10:07:47,736 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61762, bytes: 101187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_61318170_6649, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741965_1141, duration: 250000
2015-03-13 10:07:47,750 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:07:47,750 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:07:47,750 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:07:47,750 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:07:47,750 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:07:47,750 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:07:47,751 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:07:47,819 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:07:47,819 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:47,828 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:07:47,828 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:47,830 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:07:47,830 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:47,830 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:07:47,830 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:47,831 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:07:47,831 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:47,975 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000005/default_container_executor.sh]
2015-03-13 10:07:47,975 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000003/default_container_executor.sh]
2015-03-13 10:07:48,002 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000006/default_container_executor.sh]
2015-03-13 10:07:48,002 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000004/default_container_executor.sh]
2015-03-13 10:07:48,003 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000002/default_container_executor.sh]
2015-03-13 10:07:48,217 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:48,217 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0011 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:07:48,217 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0011
2015-03-13 10:07:48,217 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0011
2015-03-13 10:07:48,218 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0011
2015-03-13 10:07:48,218 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0011 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:07:48,218 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0011, with delay of 10800 seconds
2015-03-13 10:07:48,218 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0011
2015-03-13 10:07:48,218 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0011
2015-03-13 10:07:48,374 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:07:48,677 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:48,677 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:48,678 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:48,678 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:48,721 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:48,787 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:07:48,925 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426266260362_0012_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000003.tokens
2015-03-13 10:07:48,925 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0012 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0012
2015-03-13 10:07:49,031 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:07:49,180 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1426266260362_0012_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000002.tokens
2015-03-13 10:07:49,181 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0012 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0012
2015-03-13 10:07:49,221 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:49,279 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:07:49,401 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426266260362_0012_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000005.tokens
2015-03-13 10:07:49,401 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0012 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0012
2015-03-13 10:07:49,679 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:49,679 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:49,679 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:49,679 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:49,723 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:50,225 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:50,685 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:50,685 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:50,685 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:50,686 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:50,729 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:51,230 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:51,686 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:51,687 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:51,687 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:51,687 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:51,733 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:52,232 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:52,692 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:52,692 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:52,692 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:52,692 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:52,738 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:53,237 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:53,698 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:53,698 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:53,698 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:53,698 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:53,742 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:54,242 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:54,700 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:54,700 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:54,701 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:54,701 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:54,746 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:55,246 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:55,704 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:55,704 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:55,704 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:55,704 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:55,749 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:56,133 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.split	dst=null	perm=null
2015-03-13 10:07:56,246 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.split	dst=null	perm=null
2015-03-13 10:07:56,248 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:56,254 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.split	dst=null	perm=null
2015-03-13 10:07:56,281 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.split	dst=null	perm=null
2015-03-13 10:07:56,377 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.split	dst=null	perm=null
2015-03-13 10:07:56,388 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61775, bytes: 1788, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0012_m_000001_0_-1765952810_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741963_1139, duration: 219000
2015-03-13 10:07:56,441 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61777, bytes: 1272, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0012_m_000002_0_516492625_1, offset: 512, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741963_1139, duration: 160000
2015-03-13 10:07:56,454 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61778, bytes: 1788, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0012_m_000000_0_1886885524_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741963_1139, duration: 158000
2015-03-13 10:07:56,461 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61779, bytes: 756, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0012_m_000003_0_-1098418618_1, offset: 1024, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741963_1139, duration: 151000
2015-03-13 10:07:56,525 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt	dst=null	perm=null
2015-03-13 10:07:56,529 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61781, bytes: 56, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0012_m_000001_0_-1765952810_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741912_1088, duration: 163000
2015-03-13 10:07:56,546 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61780, bytes: 756, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0012_m_000004_0_-1581186145_1, offset: 1024, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741963_1139, duration: 156000
2015-03-13 10:07:56,565 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt	dst=null	perm=null
2015-03-13 10:07:56,576 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt	dst=null	perm=null
2015-03-13 10:07:56,588 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt	dst=null	perm=null
2015-03-13 10:07:56,592 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61782, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0012_m_000003_0_-1098418618_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741913_1089, duration: 146000
2015-03-13 10:07:56,646 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt	dst=null	perm=null
2015-03-13 10:07:56,653 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61783, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0012_m_000004_0_-1581186145_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741913_1089, duration: 188000
2015-03-13 10:07:56,709 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:56,709 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:56,709 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:56,709 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:56,750 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:57,043 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61784, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0012_m_000002_0_516492625_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741913_1089, duration: 156000
2015-03-13 10:07:57,047 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4	dst=null	perm=null
2015-03-13 10:07:57,058 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4	dst=null	perm=null
2015-03-13 10:07:57,061 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4	dst=null	perm=null
2015-03-13 10:07:57,072 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs/_temporary/1/_temporary/attempt_1426266260362_0012_m_000002_0	dst=null	perm=null
2015-03-13 10:07:57,097 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0012_01_000004
2015-03-13 10:07:57,097 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0012	CONTAINERID=container_1426266260362_0012_01_000004
2015-03-13 10:07:57,097 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:07:57,097 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0012_01_000004
2015-03-13 10:07:57,098 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:57,098 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:57,098 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:07:57,098 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:57,110 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0012_01_000004 is : 143
2015-03-13 10:07:57,112 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job_1426266260362_0012_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073741967_1143{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:07:57,114 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741967_1143 src: /127.0.0.1:61785 dest: /127.0.0.1:60686
2015-03-13 10:07:57,115 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741967_1143 src: /127.0.0.1:61786 dest: /127.0.0.1:60696
2015-03-13 10:07:57,117 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741967_1143 src: /127.0.0.1:61787 dest: /127.0.0.1:60693
2015-03-13 10:07:57,121 INFO  hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job_1426266260362_0012_1.jhist for DFSClient_NONMAPREDUCE_1275124369_1
2015-03-13 10:07:57,125 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:07:57,125 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000004
2015-03-13 10:07:57,126 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000004
2015-03-13 10:07:57,126 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000004
2015-03-13 10:07:57,126 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000004
2015-03-13 10:07:57,127 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0012	CONTAINERID=container_1426266260362_0012_01_000004
2015-03-13 10:07:57,127 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:07:57,127 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0012_01_000004 from application application_1426266260362_0012
2015-03-13 10:07:57,127 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:57,128 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0012
2015-03-13 10:07:57,136 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/part-00000	dst=null	perm=null
2015-03-13 10:07:57,137 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/part-00000	dst=null	perm=null
2015-03-13 10:07:57,140 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61788, bytes: 142, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0012_m_000001_0_-1765952810_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741956_1132, duration: 164000
2015-03-13 10:07:57,146 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4	dst=null	perm=null
2015-03-13 10:07:57,147 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs/_temporary/1/_temporary/attempt_1426266260362_0012_m_000003_0	dst=null	perm=null
2015-03-13 10:07:57,153 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/part-00001	dst=null	perm=null
2015-03-13 10:07:57,154 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/part-00001	dst=null	perm=null
2015-03-13 10:07:57,160 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61789, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0012_m_000001_0_-1765952810_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741955_1131, duration: 149000
2015-03-13 10:07:57,163 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/part-00002	dst=null	perm=null
2015-03-13 10:07:57,164 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/part-00002	dst=null	perm=null
2015-03-13 10:07:57,166 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0012_01_000005
2015-03-13 10:07:57,167 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0012	CONTAINERID=container_1426266260362_0012_01_000005
2015-03-13 10:07:57,167 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61790, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0012_m_000001_0_-1765952810_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741957_1133, duration: 161000
2015-03-13 10:07:57,167 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:57,167 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:07:57,167 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:57,167 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0012_01_000005
2015-03-13 10:07:57,167 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:07:57,167 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0012_01_000004
2015-03-13 10:07:57,168 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:07:57,168 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0012_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:07:57,168 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0012_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:07:57,168 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0012	CONTAINERID=container_1426266260362_0012_01_000004
2015-03-13 10:07:57,168 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0012_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:07:57,168 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:07:57,169 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0012_01_000004, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:57,169 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:57,169 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:07:57,169 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0012_000001 released container container_1426266260362_0012_01_000004 on node: host: 10.1.1.144:60719 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:07:57,172 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/part-00003	dst=null	perm=null
2015-03-13 10:07:57,174 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/part-00003	dst=null	perm=null
2015-03-13 10:07:57,177 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61790, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0012_m_000001_0_-1765952810_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741958_1134, duration: 147000
2015-03-13 10:07:57,179 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/part-00004	dst=null	perm=null
2015-03-13 10:07:57,179 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0012_01_000005 is : 143
2015-03-13 10:07:57,180 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/part-00004	dst=null	perm=null
2015-03-13 10:07:57,183 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61790, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0012_m_000001_0_-1765952810_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741953_1129, duration: 144000
2015-03-13 10:07:57,187 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4	dst=null	perm=null
2015-03-13 10:07:57,189 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4	dst=null	perm=null
2015-03-13 10:07:57,192 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:07:57,192 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000005
2015-03-13 10:07:57,192 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000005
2015-03-13 10:07:57,192 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000005
2015-03-13 10:07:57,193 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000005
2015-03-13 10:07:57,193 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0012	CONTAINERID=container_1426266260362_0012_01_000005
2015-03-13 10:07:57,193 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:07:57,193 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0012_01_000005 from application application_1426266260362_0012
2015-03-13 10:07:57,193 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:57,193 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0012
2015-03-13 10:07:57,216 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs/_temporary/1/_temporary/attempt_1426266260362_0012_m_000001_0	dst=null	perm=null
2015-03-13 10:07:57,226 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0012_01_000003
2015-03-13 10:07:57,226 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/part-00000	dst=null	perm=null
2015-03-13 10:07:57,226 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:07:57,226 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0012	CONTAINERID=container_1426266260362_0012_01_000003
2015-03-13 10:07:57,226 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0012_01_000003
2015-03-13 10:07:57,226 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:57,227 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:07:57,227 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:07:57,227 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0012_01_000005
2015-03-13 10:07:57,227 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0012_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:07:57,228 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0012_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:07:57,228 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0012	CONTAINERID=container_1426266260362_0012_01_000005
2015-03-13 10:07:57,228 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0012_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:07:57,228 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:07:57,228 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0012_01_000005, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:57,228 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:57,228 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:07:57,228 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0012_000001 released container container_1426266260362_0012_01_000005 on node: host: 10.1.1.144:60719 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:07:57,232 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/part-00000	dst=null	perm=null
2015-03-13 10:07:57,236 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61791, bytes: 142, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0012_m_000000_0_1886885524_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741956_1132, duration: 155000
2015-03-13 10:07:57,239 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0012_01_000003 is : 143
2015-03-13 10:07:57,247 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/part-00001	dst=null	perm=null
2015-03-13 10:07:57,249 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:57,249 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/part-00001	dst=null	perm=null
2015-03-13 10:07:57,252 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61778, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0012_m_000000_0_1886885524_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741955_1131, duration: 157000
2015-03-13 10:07:57,253 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:07:57,254 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000003
2015-03-13 10:07:57,255 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000003
2015-03-13 10:07:57,255 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000003
2015-03-13 10:07:57,256 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000003
2015-03-13 10:07:57,257 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0012	CONTAINERID=container_1426266260362_0012_01_000003
2015-03-13 10:07:57,257 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:07:57,257 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0012_01_000003 from application application_1426266260362_0012
2015-03-13 10:07:57,257 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:57,257 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0012
2015-03-13 10:07:57,258 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/part-00002	dst=null	perm=null
2015-03-13 10:07:57,260 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/part-00002	dst=null	perm=null
2015-03-13 10:07:57,261 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs/_temporary/1/_temporary/attempt_1426266260362_0012_m_000004_0	dst=null	perm=null
2015-03-13 10:07:57,262 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61792, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0012_m_000000_0_1886885524_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741957_1133, duration: 159000
2015-03-13 10:07:57,264 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/part-00003	dst=null	perm=null
2015-03-13 10:07:57,266 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/part-00003	dst=null	perm=null
2015-03-13 10:07:57,268 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61778, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0012_m_000000_0_1886885524_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741958_1134, duration: 164000
2015-03-13 10:07:57,270 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/part-00004	dst=null	perm=null
2015-03-13 10:07:57,272 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/part-00004	dst=null	perm=null
2015-03-13 10:07:57,274 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61778, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0012_m_000000_0_1886885524_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741953_1129, duration: 156000
2015-03-13 10:07:57,278 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61793, bytes: 56, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0012_m_000000_0_1886885524_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741912_1088, duration: 191000
2015-03-13 10:07:57,281 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0012_01_000006
2015-03-13 10:07:57,281 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0012	CONTAINERID=container_1426266260362_0012_01_000006
2015-03-13 10:07:57,281 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:07:57,281 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0012_01_000006
2015-03-13 10:07:57,282 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:07:57,295 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0012_01_000006 is : 143
2015-03-13 10:07:57,307 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:07:57,308 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000006
2015-03-13 10:07:57,308 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000006
2015-03-13 10:07:57,308 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000006
2015-03-13 10:07:57,308 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000006
2015-03-13 10:07:57,308 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0012	CONTAINERID=container_1426266260362_0012_01_000006
2015-03-13 10:07:57,309 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:07:57,309 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0012_01_000006 from application application_1426266260362_0012
2015-03-13 10:07:57,309 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:57,309 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0012
2015-03-13 10:07:57,316 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs/_temporary/1/_temporary/attempt_1426266260362_0012_m_000000_0	dst=null	perm=null
2015-03-13 10:07:57,324 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0012_01_000002
2015-03-13 10:07:57,325 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0012	CONTAINERID=container_1426266260362_0012_01_000002
2015-03-13 10:07:57,325 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:07:57,325 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:57,326 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:07:57,326 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0012_01_000003
2015-03-13 10:07:57,326 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0012_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:07:57,326 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0012_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:07:57,326 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0012	CONTAINERID=container_1426266260362_0012_01_000003
2015-03-13 10:07:57,326 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0012_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:07:57,327 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:07:57,327 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0012_01_000003, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:57,327 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:57,327 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:07:57,327 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0012_000001 released container container_1426266260362_0012_01_000003 on node: host: 10.1.1.144:60719 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:07:57,327 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0012_01_000002
2015-03-13 10:07:57,339 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0012_01_000002 is : 143
2015-03-13 10:07:57,351 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:07:57,351 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000002
2015-03-13 10:07:57,351 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000002
2015-03-13 10:07:57,352 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000002
2015-03-13 10:07:57,353 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000002
2015-03-13 10:07:57,353 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0012	CONTAINERID=container_1426266260362_0012_01_000002
2015-03-13 10:07:57,353 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:07:57,354 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0012_01_000002 from application application_1426266260362_0012
2015-03-13 10:07:57,354 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:57,354 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0012
2015-03-13 10:07:58,249 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:58,286 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:07:58,286 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0012_01_000006
2015-03-13 10:07:58,287 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0012_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:07:58,287 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0012_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:07:58,287 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0012	CONTAINERID=container_1426266260362_0012_01_000006
2015-03-13 10:07:58,287 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0012_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:07:58,287 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:07:58,288 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0012_01_000006, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:58,288 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:58,288 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:07:58,288 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0012_000001 released container container_1426266260362_0012_01_000006 on node: host: 10.1.1.144:60723 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:07:58,327 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:07:58,327 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0012_01_000002
2015-03-13 10:07:58,328 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0012_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:07:58,328 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0012_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:07:58,328 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0012	CONTAINERID=container_1426266260362_0012_01_000002
2015-03-13 10:07:58,328 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0012_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:07:58,328 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:07:58,328 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0012_01_000002, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:58,329 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:58,329 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:07:58,329 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0012_000001 released container container_1426266260362_0012_01_000002 on node: host: 10.1.1.144:60719 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:07:58,832 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0012_01_000007 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:07:58,832 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0012	CONTAINERID=container_1426266260362_0012_01_000007
2015-03-13 10:07:58,832 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0012_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:07:58,832 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0012 container=Container: [ContainerId: container_1426266260362_0012_01_000007, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0012_01_000007 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:58,833 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:07:58,833 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:59,251 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:59,423 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0012_01_000007 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:07:59,433 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0012_000001 (auth:SIMPLE)
2015-03-13 10:07:59,435 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0012_01_000007 by user soberoi
2015-03-13 10:07:59,435 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0012
2015-03-13 10:07:59,435 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0012	CONTAINERID=container_1426266260362_0012_01_000007
2015-03-13 10:07:59,436 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0012 transitioned from NEW to INITING
2015-03-13 10:07:59,436 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0012_01_000007 to application application_1426266260362_0012
2015-03-13 10:07:59,436 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0012 transitioned from INITING to RUNNING
2015-03-13 10:07:59,436 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000007 transitioned from NEW to LOCALIZING
2015-03-13 10:07:59,436 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0012
2015-03-13 10:07:59,436 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0012
2015-03-13 10:07:59,436 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:07:59,436 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0012
2015-03-13 10:07:59,437 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:07:59,437 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:07:59,437 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0012_01_000007
2015-03-13 10:07:59,446 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0012_01_000007.tokens. Credentials list: 
2015-03-13 10:07:59,461 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:07:59,525 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0012_01_000007.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000007.tokens
2015-03-13 10:07:59,526 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0012 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0012
2015-03-13 10:07:59,582 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.jar	dst=null	perm=null
2015-03-13 10:07:59,582 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.jar	dst=null	perm=null
2015-03-13 10:07:59,583 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.jar	dst=null	perm=null
2015-03-13 10:07:59,590 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61797, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_275684363_6969, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741962_1138, duration: 502000
2015-03-13 10:07:59,609 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:07:59,625 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.xml	dst=null	perm=null
2015-03-13 10:07:59,625 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.xml	dst=null	perm=null
2015-03-13 10:07:59,626 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.xml	dst=null	perm=null
2015-03-13 10:07:59,632 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61798, bytes: 101187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_275684363_6969, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741965_1141, duration: 293000
2015-03-13 10:07:59,644 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:07:59,645 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000007 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:07:59,670 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000007 transitioned from LOCALIZED to RUNNING
2015-03-13 10:07:59,670 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:59,735 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000007/default_container_executor.sh]
2015-03-13 10:07:59,831 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:59,832 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0012_01_000007 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:08:00,253 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:00,431 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:08:00,833 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:01,254 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:01,834 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:02,164 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs/_temporary/1/_temporary/attempt_1426266260362_0012_r_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:02,215 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs/_temporary/1/_temporary/attempt_1426266260362_0012_r_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073741968_1144{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:08:02,259 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:02,275 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741968_1144 src: /127.0.0.1:61804 dest: /127.0.0.1:60689
2015-03-13 10:08:02,276 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741968_1144 src: /127.0.0.1:61805 dest: /127.0.0.1:60693
2015-03-13 10:08:02,278 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741968_1144 src: /127.0.0.1:61806 dest: /127.0.0.1:60696
2015-03-13 10:08:02,291 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61806, dest: /127.0.0.1:60696, bytes: 592, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0012_r_000000_0_867343697_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741968_1144, duration: 12192000
2015-03-13 10:08:02,291 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741968_1144, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:02,292 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741968_1144{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:02,292 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61805, dest: /127.0.0.1:60693, bytes: 592, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0012_r_000000_0_867343697_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741968_1144, duration: 12772000
2015-03-13 10:08:02,292 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741968_1144, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:02,293 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741968_1144{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:02,293 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61804, dest: /127.0.0.1:60689, bytes: 592, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0012_r_000000_0_867343697_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741968_1144, duration: 13635000
2015-03-13 10:08:02,293 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741968_1144, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:02,293 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741968_1144{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:02,297 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs/_temporary/1/_temporary/attempt_1426266260362_0012_r_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0012_r_000000_0_867343697_1
2015-03-13 10:08:02,306 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs/_temporary/1/_temporary/attempt_1426266260362_0012_r_000000_0	dst=null	perm=null
2015-03-13 10:08:02,311 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs/_temporary/1/_temporary/attempt_1426266260362_0012_r_000000_0	dst=null	perm=null
2015-03-13 10:08:02,313 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs/_temporary/1/task_1426266260362_0012_r_000000	dst=null	perm=null
2015-03-13 10:08:02,315 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs/_temporary/1/_temporary/attempt_1426266260362_0012_r_000000_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs/_temporary/1/task_1426266260362_0012_r_000000	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:08:02,329 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0012_01_000007
2015-03-13 10:08:02,330 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0012	CONTAINERID=container_1426266260362_0012_01_000007
2015-03-13 10:08:02,330 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000007 transitioned from RUNNING to KILLING
2015-03-13 10:08:02,330 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0012_01_000007
2015-03-13 10:08:02,330 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:08:02,335 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:02,337 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_1275124369_1
2015-03-13 10:08:02,342 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0012_01_000007 is : 143
2015-03-13 10:08:02,343 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs/_temporary/1	dst=null	perm=null
2015-03-13 10:08:02,349 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs	dst=null	perm=null
2015-03-13 10:08:02,351 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs	dst=null	perm=null
2015-03-13 10:08:02,353 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs/_temporary/1/task_1426266260362_0012_r_000000	dst=null	perm=null
2015-03-13 10:08:02,354 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000007 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:08:02,354 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0012	CONTAINERID=container_1426266260362_0012_01_000007
2015-03-13 10:08:02,354 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000007 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:08:02,355 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0012_01_000007 from application application_1426266260362_0012
2015-03-13 10:08:02,355 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:02,355 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0012
2015-03-13 10:08:02,355 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000007
2015-03-13 10:08:02,355 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000007
2015-03-13 10:08:02,355 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000007
2015-03-13 10:08:02,356 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000007
2015-03-13 10:08:02,356 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs/part-00000	dst=null	perm=null
2015-03-13 10:08:02,360 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs/_temporary/1/task_1426266260362_0012_r_000000/part-00000	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs/part-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:02,366 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs/_temporary	dst=null	perm=null
2015-03-13 10:08:02,370 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:02,374 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs/_SUCCESS is closed by DFSClient_NONMAPREDUCE_1275124369_1
2015-03-13 10:08:02,375 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:02,377 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_1275124369_1
2015-03-13 10:08:02,391 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61787, dest: /127.0.0.1:60693, bytes: 67674, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1275124369_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741967_1143, duration: 5272618000
2015-03-13 10:08:02,391 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741967_1143, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:02,392 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741967_1143{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:02,392 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61786, dest: /127.0.0.1:60696, bytes: 67674, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1275124369_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741967_1143, duration: 5273782000
2015-03-13 10:08:02,392 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741967_1143, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:02,393 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741967_1143{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:02,393 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61785, dest: /127.0.0.1:60686, bytes: 67674, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1275124369_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741967_1143, duration: 5275236000
2015-03-13 10:08:02,394 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741967_1143, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:02,394 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741967_1143{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:02,395 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job_1426266260362_0012_1.jhist is closed by DFSClient_NONMAPREDUCE_1275124369_1
2015-03-13 10:08:02,397 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0012.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:02,399 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0012.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741969_1145{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:08:02,401 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741969_1145 src: /127.0.0.1:61807 dest: /127.0.0.1:60696
2015-03-13 10:08:02,403 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741969_1145 src: /127.0.0.1:61808 dest: /127.0.0.1:60693
2015-03-13 10:08:02,404 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741969_1145 src: /127.0.0.1:61809 dest: /127.0.0.1:60689
2015-03-13 10:08:02,407 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61809, dest: /127.0.0.1:60689, bytes: 454, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1275124369_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741969_1145, duration: 1252000
2015-03-13 10:08:02,407 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741969_1145, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:02,407 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741969_1145{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:08:02,408 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61808, dest: /127.0.0.1:60693, bytes: 454, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1275124369_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741969_1145, duration: 1924000
2015-03-13 10:08:02,408 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741969_1145, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:02,408 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61807, dest: /127.0.0.1:60696, bytes: 454, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1275124369_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741969_1145, duration: 2868000
2015-03-13 10:08:02,409 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741969_1145{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:08:02,409 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741969_1145, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:02,410 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741969_1145{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:08:02,412 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0012.summary_tmp is closed by DFSClient_NONMAPREDUCE_1275124369_1
2015-03-13 10:08:02,416 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0012.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:08:02,421 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job_1426266260362_0012_1.jhist	dst=null	perm=null
2015-03-13 10:08:02,422 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0012-1426266462037-soberoi-%5B65C1F8B7B9BE47B0A23DAB67E3AF740D%2F2BC7D8F0414F4AAC-1426266482378-5-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:08:02,425 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job_1426266260362_0012_1.jhist	dst=null	perm=null
2015-03-13 10:08:02,426 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0012-1426266462037-soberoi-%5B65C1F8B7B9BE47B0A23DAB67E3AF740D%2F2BC7D8F0414F4AAC-1426266482378-5-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:08:02,427 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job_1426266260362_0012_1.jhist	dst=null	perm=null
2015-03-13 10:08:02,429 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0012-1426266462037-soberoi-%5B65C1F8B7B9BE47B0A23DAB67E3AF740D%2F2BC7D8F0414F4AAC-1426266482378-5-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:02,431 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61810, bytes: 68206, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1275124369_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741967_1143, duration: 287000
2015-03-13 10:08:02,434 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0012-1426266462037-soberoi-%5B65C1F8B7B9BE47B0A23DAB67E3AF740D%2F2BC7D8F0414F4AAC-1426266482378-5-1-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741970_1146{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:08:02,436 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741970_1146 src: /127.0.0.1:61811 dest: /127.0.0.1:60689
2015-03-13 10:08:02,437 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741970_1146 src: /127.0.0.1:61812 dest: /127.0.0.1:60686
2015-03-13 10:08:02,438 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741970_1146 src: /127.0.0.1:61813 dest: /127.0.0.1:60693
2015-03-13 10:08:02,441 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61813, dest: /127.0.0.1:60693, bytes: 67674, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1275124369_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741970_1146, duration: 1613000
2015-03-13 10:08:02,442 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741970_1146, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:02,442 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741970_1146{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:02,442 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61812, dest: /127.0.0.1:60686, bytes: 67674, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1275124369_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741970_1146, duration: 2245000
2015-03-13 10:08:02,442 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741970_1146, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:02,443 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741970_1146{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:02,443 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61811, dest: /127.0.0.1:60689, bytes: 67674, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1275124369_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741970_1146, duration: 3345000
2015-03-13 10:08:02,443 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741970_1146, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:02,444 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741970_1146{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:02,445 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0012-1426266462037-soberoi-%5B65C1F8B7B9BE47B0A23DAB67E3AF740D%2F2BC7D8F0414F4AAC-1426266482378-5-1-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_1275124369_1
2015-03-13 10:08:02,447 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0012-1426266462037-soberoi-%5B65C1F8B7B9BE47B0A23DAB67E3AF740D%2F2BC7D8F0414F4AAC-1426266482378-5-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:08:02,448 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job_1426266260362_0012_1_conf.xml	dst=null	perm=null
2015-03-13 10:08:02,450 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0012_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:08:02,451 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741968_1144
2015-03-13 10:08:02,452 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741969_1145
2015-03-13 10:08:02,452 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job_1426266260362_0012_1_conf.xml	dst=null	perm=null
2015-03-13 10:08:02,452 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741967_1143
2015-03-13 10:08:02,453 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0012_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:08:02,454 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job_1426266260362_0012_1_conf.xml	dst=null	perm=null
2015-03-13 10:08:02,457 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0012_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:02,459 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61814, bytes: 93441, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1275124369_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741966_1142, duration: 356000
2015-03-13 10:08:02,462 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0012_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741971_1147{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:08:02,464 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741971_1147 src: /127.0.0.1:61815 dest: /127.0.0.1:60696
2015-03-13 10:08:02,466 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741971_1147 src: /127.0.0.1:61816 dest: /127.0.0.1:60693
2015-03-13 10:08:02,467 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741971_1147 src: /127.0.0.1:61817 dest: /127.0.0.1:60686
2015-03-13 10:08:02,471 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61817, dest: /127.0.0.1:60686, bytes: 92713, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1275124369_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741971_1147, duration: 2552000
2015-03-13 10:08:02,472 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741971_1147, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:02,472 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61816, dest: /127.0.0.1:60693, bytes: 92713, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1275124369_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741971_1147, duration: 3287000
2015-03-13 10:08:02,473 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741971_1147, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:02,473 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741971_1147{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:08:02,474 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61815, dest: /127.0.0.1:60696, bytes: 92713, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1275124369_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741971_1147, duration: 4837000
2015-03-13 10:08:02,474 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741971_1147, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:02,474 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741971_1147{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:08:02,475 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741971_1147{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:08:02,476 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0012_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_1275124369_1
2015-03-13 10:08:02,478 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0012_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:08:02,479 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0012.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0012.summary	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:08:02,480 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0012_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0012_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:08:02,482 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0012-1426266462037-soberoi-%5B65C1F8B7B9BE47B0A23DAB67E3AF740D%2F2BC7D8F0414F4AAC-1426266482378-5-1-SUCCEEDED-default.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0012-1426266462037-soberoi-%5B65C1F8B7B9BE47B0A23DAB67E3AF740D%2F2BC7D8F0414F4AAC-1426266482378-5-1-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:08:02,489 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0012_000001 State change from RUNNING to FINISHING
2015-03-13 10:08:02,489 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0012
2015-03-13 10:08:02,489 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0012 State change from RUNNING to REMOVING
2015-03-13 10:08:02,490 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0012
2015-03-13 10:08:02,490 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0012 State change from REMOVING to FINISHING
2015-03-13 10:08:03,262 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:03,336 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:08:03,336 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0012_01_000007
2015-03-13 10:08:03,337 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0012_01_000007 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:08:03,337 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0012_01_000007 in state: COMPLETED event:FINISHED
2015-03-13 10:08:03,337 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0012	CONTAINERID=container_1426266260362_0012_01_000007
2015-03-13 10:08:03,337 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0012_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:08:03,337 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:08:03,337 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0012_01_000007, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:03,337 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:03,338 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:08:03,338 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0012_000001 released container container_1426266260362_0012_01_000007 on node: host: 10.1.1.144:60711 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:08:03,497 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741962_1138 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60689 
2015-03-13 10:08:03,497 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741963_1139 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60693 127.0.0.1:60689 
2015-03-13 10:08:03,497 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741964_1140 127.0.0.1:60686 127.0.0.1:60693 127.0.0.1:60689 
2015-03-13 10:08:03,497 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741965_1141 127.0.0.1:60689 127.0.0.1:60693 127.0.0.1:60696 
2015-03-13 10:08:03,497 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741967_1143 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60693 
2015-03-13 10:08:03,498 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741966_1142 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60689 
2015-03-13 10:08:03,498 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012	dst=null	perm=null
2015-03-13 10:08:03,529 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741956_1132 127.0.0.1:60686 127.0.0.1:60693 127.0.0.1:60689 
2015-03-13 10:08:03,529 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741955_1131 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60689 
2015-03-13 10:08:03,529 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741957_1133 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60693 
2015-03-13 10:08:03,529 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741958_1134 127.0.0.1:60689 127.0.0.1:60693 127.0.0.1:60696 
2015-03-13 10:08:03,529 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741953_1129 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60686 
2015-03-13 10:08:03,530 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4	dst=null	perm=null
2015-03-13 10:08:03,530 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs	dst=null	perm=null
2015-03-13 10:08:03,531 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs/_temporary
2015-03-13 10:08:03,531 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs/_temporary	dst=null	perm=null
2015-03-13 10:08:03,538 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:08:03,538 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:08:03,539 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:08:03,540 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs	dst=null	perm=null
2015-03-13 10:08:03,540 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs	dst=null	perm=null
2015-03-13 10:08:03,541 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs	dst=null	perm=null
2015-03-13 10:08:03,541 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:08:03,542 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs/part-00000	dst=null	perm=null
2015-03-13 10:08:03,544 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61819, bytes: 600, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741968_1144, duration: 164000
2015-03-13 10:08:03,552 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:08:03,552 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:08:03,553 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:08:03,554 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs	dst=null	perm=null
2015-03-13 10:08:03,554 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs	dst=null	perm=null
2015-03-13 10:08:03,555 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs	dst=null	perm=null
2015-03-13 10:08:03,556 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:08:03,557 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs/part-00000	dst=null	perm=null
2015-03-13 10:08:03,558 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61819, bytes: 600, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741968_1144, duration: 162000
2015-03-13 10:08:03,559 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs
2015-03-13 10:08:03,559 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs	dst=null	perm=null
2015-03-13 10:08:03,560 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs	dst=null	perm=null
2015-03-13 10:08:03,560 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs	dst=null	perm=null
2015-03-13 10:08:03,561 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs	dst=null	perm=null
2015-03-13 10:08:03,562 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs/part-00000	dst=null	perm=null
2015-03-13 10:08:03,562 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs/part-00000	dst=null	perm=null
2015-03-13 10:08:03,564 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61820, bytes: 600, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741968_1144, duration: 123000
2015-03-13 10:08:03,565 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:08:03,566 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:08:03,664 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:08:03,665 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:08:03,665 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:08:03,685 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher	dst=null	perm=null
2015-03-13 10:08:03,687 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting
2015-03-13 10:08:03,687 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt"]
2015-03-13 10:08:03,687 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-03-13 10:08:03,687 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher"]
2015-03-13 10:08:03,687 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  parallel execution is enabled: true
2015-03-13 10:08:03,687 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  starting jobs: 1
2015-03-13 10:08:03,687 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  allocating threads: 1
2015-03-13 10:08:03,688 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (1/1) ...dpipesplatform/joinhasher
2015-03-13 10:08:03,697 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:08:03,706 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:08:03,708 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher	dst=null	perm=null
2015-03-13 10:08:03,708 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:08:03,709 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:08:03,711 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 13
2015-03-13 10:08:03,712 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013	dst=null	perm=null
2015-03-13 10:08:03,713 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013	dst=null	perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:08:03,715 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013	dst=null	perm=soberoi:supergroup:rwx------
2015-03-13 10:08:03,715 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.jar	dst=null	perm=null
2015-03-13 10:08:03,716 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:03,718 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073741972_1148{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:08:03,719 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741972_1148 src: /127.0.0.1:61822 dest: /127.0.0.1:60686
2015-03-13 10:08:03,720 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741972_1148 src: /127.0.0.1:61823 dest: /127.0.0.1:60693
2015-03-13 10:08:03,721 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741972_1148 src: /127.0.0.1:61824 dest: /127.0.0.1:60696
2015-03-13 10:08:03,725 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61824, dest: /127.0.0.1:60696, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741972_1148, duration: 2596000
2015-03-13 10:08:03,725 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741972_1148, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:03,726 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741972_1148{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:03,726 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61823, dest: /127.0.0.1:60693, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741972_1148, duration: 2628000
2015-03-13 10:08:03,726 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741972_1148, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:03,726 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741972_1148{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:03,727 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61822, dest: /127.0.0.1:60686, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741972_1148, duration: 3468000
2015-03-13 10:08:03,727 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741972_1148, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:03,728 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741972_1148{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:03,729 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:08:03,729 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.jar
2015-03-13 10:08:03,730 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.jar	dst=null	perm=null
2015-03-13 10:08:03,731 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:03,731 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:08:03,732 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:08:03,733 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:08:03,733 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:08:03,734 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:08:03,734 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:08:03,735 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:08:03,735 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:08:03,735 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:08:03,737 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:08:03,737 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:08:03,737 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:08:03,739 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:03,740 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:03,741 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.split
2015-03-13 10:08:03,741 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.split	dst=null	perm=null
2015-03-13 10:08:03,742 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073741973_1149{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:08:03,744 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741973_1149 src: /127.0.0.1:61825 dest: /127.0.0.1:60693
2015-03-13 10:08:03,745 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741973_1149 src: /127.0.0.1:61826 dest: /127.0.0.1:60689
2015-03-13 10:08:03,746 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741973_1149 src: /127.0.0.1:61827 dest: /127.0.0.1:60686
2015-03-13 10:08:03,747 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741973_1149 src: /127.0.0.1:61828 dest: /127.0.0.1:60696
2015-03-13 10:08:03,750 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61828, dest: /127.0.0.1:60696, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741973_1149, duration: 1861000
2015-03-13 10:08:03,751 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741973_1149, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:03,751 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741973_1149{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:03,751 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61827, dest: /127.0.0.1:60686, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741973_1149, duration: 2333000
2015-03-13 10:08:03,751 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741973_1149, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:03,752 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61826, dest: /127.0.0.1:60689, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741973_1149, duration: 3223000
2015-03-13 10:08:03,752 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741973_1149, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:03,752 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741973_1149{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:03,753 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741973_1149{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:03,753 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61825, dest: /127.0.0.1:60693, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741973_1149, duration: 4168000
2015-03-13 10:08:03,753 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741973_1149, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:03,755 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741973_1149 size 1782
2015-03-13 10:08:03,755 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:08:03,757 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:03,758 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:03,760 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073741974_1150{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:08:03,761 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741974_1150 src: /127.0.0.1:61829 dest: /127.0.0.1:60693
2015-03-13 10:08:03,762 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741974_1150 src: /127.0.0.1:61830 dest: /127.0.0.1:60696
2015-03-13 10:08:03,764 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741974_1150 src: /127.0.0.1:61831 dest: /127.0.0.1:60686
2015-03-13 10:08:03,766 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61831, dest: /127.0.0.1:60686, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741974_1150, duration: 1059000
2015-03-13 10:08:03,766 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741974_1150, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:03,767 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741974_1150{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:08:03,767 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61830, dest: /127.0.0.1:60696, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741974_1150, duration: 1553000
2015-03-13 10:08:03,767 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741974_1150, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:03,768 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741974_1150{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:08:03,768 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61829, dest: /127.0.0.1:60693, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741974_1150, duration: 2307000
2015-03-13 10:08:03,768 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741974_1150, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:03,770 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741974_1150{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:08:03,772 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:08:03,772 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:08:03,773 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:03,775 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:03,776 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:08:03,776 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:08:03,776 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:08:03,779 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073741975_1151{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:08:03,781 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741975_1151 src: /127.0.0.1:61832 dest: /127.0.0.1:60693
2015-03-13 10:08:03,782 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741975_1151 src: /127.0.0.1:61833 dest: /127.0.0.1:60696
2015-03-13 10:08:03,783 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741975_1151 src: /127.0.0.1:61834 dest: /127.0.0.1:60686
2015-03-13 10:08:03,785 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61834, dest: /127.0.0.1:60686, bytes: 98112, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741975_1151, duration: 1561000
2015-03-13 10:08:03,786 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741975_1151, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:03,786 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741975_1151{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:08:03,786 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61833, dest: /127.0.0.1:60696, bytes: 98112, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741975_1151, duration: 1903000
2015-03-13 10:08:03,786 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741975_1151, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:03,786 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741975_1151{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:08:03,787 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61832, dest: /127.0.0.1:60693, bytes: 98112, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741975_1151, duration: 2765000
2015-03-13 10:08:03,787 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741975_1151, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:03,788 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741975_1151{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:08:03,789 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:08:03,789 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0013
2015-03-13 10:08:03,790 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013	dst=null	perm=null
2015-03-13 10:08:03,790 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.xml	dst=null	perm=null
2015-03-13 10:08:03,791 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.xml	dst=null	perm=null
2015-03-13 10:08:03,791 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.jar	dst=null	perm=null
2015-03-13 10:08:03,792 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.jar	dst=null	perm=null
2015-03-13 10:08:03,792 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.split	dst=null	perm=null
2015-03-13 10:08:03,793 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.split	dst=null	perm=null
2015-03-13 10:08:03,793 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:08:03,794 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:08:03,795 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:08:03,796 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:08:03,796 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:08:03,797 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:08:03,797 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:08:03,798 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:08:03,799 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 13 submitted by user soberoi
2015-03-13 10:08:03,799 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0013
2015-03-13 10:08:03,800 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	IP=10.1.1.144	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1426266260362_0013
2015-03-13 10:08:03,800 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0013
2015-03-13 10:08:03,800 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0013 State change from NEW to NEW_SAVING
2015-03-13 10:08:03,800 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0013 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:08:03,800 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0013_000001
2015-03-13 10:08:03,800 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0013_000001 State change from NEW to SUBMITTED
2015-03-13 10:08:03,801 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0013 from user: soberoi activated in queue: default
2015-03-13 10:08:03,801 INFO  capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0013 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:08:03,801 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0013 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:08:03,801 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0013 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:08:03,801 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0013_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:08:03,801 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0013_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:08:03,802 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0013 State change from SUBMITTED to ACCEPTED
2015-03-13 10:08:03,803 INFO  mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0013/
2015-03-13 10:08:03,804 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1426266260362_0013
2015-03-13 10:08:03,804 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0013/
2015-03-13 10:08:03,812 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60696 to replicate blk_1073741972_1148 to datanode(s) 127.0.0.1:60689
2015-03-13 10:08:03,813 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073741953_1129, blk_1073741955_1131, blk_1073741957_1133, blk_1073741958_1134, blk_1073741962_1138, blk_1073741963_1139, blk_1073741965_1141, blk_1073741967_1143]
2015-03-13 10:08:03,813 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073741953_1129, blk_1073741955_1131, blk_1073741956_1132, blk_1073741958_1134, blk_1073741962_1138, blk_1073741963_1139, blk_1073741964_1140, blk_1073741965_1141, blk_1073741966_1142]
2015-03-13 10:08:04,263 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:04,264 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0013_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:08:04,264 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0013	CONTAINERID=container_1426266260362_0013_01_000001
2015-03-13 10:08:04,264 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0013_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:4096, vCores:2> used and <memory:0, vCores:6> available
2015-03-13 10:08:04,264 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0013 container=Container: [ContainerId: container_1426266260362_0013_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0013_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:04,264 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:08:04,264 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0013_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:08:04,265 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:04,266 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0013 AttemptId: appattempt_1426266260362_0013_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0013_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ]
2015-03-13 10:08:04,266 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0013_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:08:04,266 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0013_000001
2015-03-13 10:08:04,266 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0013_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:08:04,266 INFO  amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0013_000001
2015-03-13 10:08:04,267 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0013_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] for AM appattempt_1426266260362_0013_000001
2015-03-13 10:08:04,267 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0013_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-03-13 10:08:04,269 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0013_000001 (auth:SIMPLE)
2015-03-13 10:08:04,270 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0013_01_000001 by user soberoi
2015-03-13 10:08:04,270 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0013
2015-03-13 10:08:04,270 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0013	CONTAINERID=container_1426266260362_0013_01_000001
2015-03-13 10:08:04,271 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0013 transitioned from NEW to INITING
2015-03-13 10:08:04,271 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0013_01_000001 to application application_1426266260362_0013
2015-03-13 10:08:04,271 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0013_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] for AM appattempt_1426266260362_0013_000001
2015-03-13 10:08:04,271 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0013 transitioned from INITING to RUNNING
2015-03-13 10:08:04,271 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0013_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:08:04,271 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:08:04,271 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0013
2015-03-13 10:08:04,272 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:08:04,272 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:08:04,272 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:08:04,272 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:08:04,272 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0013_01_000001
2015-03-13 10:08:04,281 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426266260362_0013_01_000001.tokens. Credentials list: 
2015-03-13 10:08:04,296 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:08:04,370 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426266260362_0013_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000001.tokens
2015-03-13 10:08:04,370 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0013 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0013
2015-03-13 10:08:04,429 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.jar	dst=null	perm=null
2015-03-13 10:08:04,430 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.jar	dst=null	perm=null
2015-03-13 10:08:04,431 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.jar	dst=null	perm=null
2015-03-13 10:08:04,436 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61820, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1529710652_7117, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741972_1148, duration: 474000
2015-03-13 10:08:04,452 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741953_1129 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741953 for deletion
2015-03-13 10:08:04,452 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741955_1131 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741955 for deletion
2015-03-13 10:08:04,452 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741956_1132 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741956 for deletion
2015-03-13 10:08:04,453 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741958_1134 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741958 for deletion
2015-03-13 10:08:04,453 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741962_1138 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741962 for deletion
2015-03-13 10:08:04,453 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741963_1139 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741963 for deletion
2015-03-13 10:08:04,453 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741964_1140 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741964 for deletion
2015-03-13 10:08:04,453 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741965_1141 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741965 for deletion
2015-03-13 10:08:04,453 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741966_1142 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741966 for deletion
2015-03-13 10:08:04,453 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741953_1129 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741953
2015-03-13 10:08:04,453 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741956_1132 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741956
2015-03-13 10:08:04,454 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741955_1131 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741955
2015-03-13 10:08:04,454 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741963_1139 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741963
2015-03-13 10:08:04,454 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741958_1134 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741958
2015-03-13 10:08:04,454 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741965_1141 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741965
2015-03-13 10:08:04,454 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741962_1138 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741962
2015-03-13 10:08:04,454 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741966_1142 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741966
2015-03-13 10:08:04,454 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741964_1140 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741964
2015-03-13 10:08:04,457 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:08:04,473 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:08:04,473 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:08:04,474 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:08:04,480 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61838, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1529710652_7117, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741974_1150, duration: 164000
2015-03-13 10:08:04,492 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:08:04,508 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.split	dst=null	perm=null
2015-03-13 10:08:04,509 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.split	dst=null	perm=null
2015-03-13 10:08:04,509 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.split	dst=null	perm=null
2015-03-13 10:08:04,515 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61820, bytes: 1798, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1529710652_7117, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741973_1149, duration: 169000
2015-03-13 10:08:04,526 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:08:04,542 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.xml	dst=null	perm=null
2015-03-13 10:08:04,542 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.xml	dst=null	perm=null
2015-03-13 10:08:04,543 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.xml	dst=null	perm=null
2015-03-13 10:08:04,549 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61820, bytes: 98880, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1529710652_7117, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741975_1151, duration: 270000
2015-03-13 10:08:04,562 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:08:04,562 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:08:04,585 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:08:04,585 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:04,651 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000001/default_container_executor.sh]
2015-03-13 10:08:04,814 INFO  datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-318492837-10.1.1.144-60696-1426266259571, infoPort=60697, ipcPort=60698, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073741972_1148 to 127.0.0.1:60689 
2015-03-13 10:08:04,815 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741953_1129 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741953 for deletion
2015-03-13 10:08:04,815 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741955_1131 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741955 for deletion
2015-03-13 10:08:04,815 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741957_1133 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741957 for deletion
2015-03-13 10:08:04,816 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741958_1134 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741958 for deletion
2015-03-13 10:08:04,816 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741962_1138 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741962 for deletion
2015-03-13 10:08:04,816 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741963_1139 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741963 for deletion
2015-03-13 10:08:04,816 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741965_1141 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741965 for deletion
2015-03-13 10:08:04,816 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741967_1143 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741967 for deletion
2015-03-13 10:08:04,816 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741957_1133 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741957
2015-03-13 10:08:04,815 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741953_1129 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741953
2015-03-13 10:08:04,817 INFO  datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073741972_1148 (numBytes=254067) to /127.0.0.1:60689
2015-03-13 10:08:04,817 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741955_1131 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741955
2015-03-13 10:08:04,817 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741963_1139 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741963
2015-03-13 10:08:04,817 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741972_1148 src: /127.0.0.1:61839 dest: /127.0.0.1:60689
2015-03-13 10:08:04,817 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741967_1143 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741967
2015-03-13 10:08:04,817 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741958_1134 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741958
2015-03-13 10:08:04,817 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741962_1138 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741962
2015-03-13 10:08:04,818 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741965_1141 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741965
2015-03-13 10:08:04,819 INFO  datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073741972_1148 src: /127.0.0.1:61839 dest: /127.0.0.1:60689 of size 254067
2015-03-13 10:08:04,820 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741972_1148 size 254067
2015-03-13 10:08:05,268 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:05,268 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:05,269 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0013_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:08:06,189 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:08:06,211 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/COMMIT_STARTED	dst=null	perm=null
2015-03-13 10:08:06,212 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/COMMIT_SUCCESS	dst=null	perm=null
2015-03-13 10:08:06,212 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/COMMIT_FAIL	dst=null	perm=null
2015-03-13 10:08:06,264 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013	dst=null	perm=null
2015-03-13 10:08:06,265 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:08:06,266 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:08:06,272 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:06,272 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:06,553 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:08:06,561 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:08:06,616 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61841, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1928401530_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741974_1150, duration: 197000
2015-03-13 10:08:06,817 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073741955_1131, blk_1073741956_1132, blk_1073741957_1133, blk_1073741958_1134, blk_1073741962_1138, blk_1073741963_1139, blk_1073741964_1140, blk_1073741965_1141, blk_1073741966_1142, blk_1073741967_1143]
2015-03-13 10:08:06,817 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073741953_1129, blk_1073741956_1132, blk_1073741957_1133, blk_1073741962_1138, blk_1073741963_1139, blk_1073741964_1140, blk_1073741966_1142, blk_1073741967_1143]
2015-03-13 10:08:06,889 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741969_1145
2015-03-13 10:08:06,891 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741972_1148
2015-03-13 10:08:06,891 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741975_1151
2015-03-13 10:08:07,062 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741973_1149
2015-03-13 10:08:07,063 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741970_1146
2015-03-13 10:08:07,064 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741971_1147
2015-03-13 10:08:07,065 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741975_1151
2015-03-13 10:08:07,065 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741967_1143
2015-03-13 10:08:07,094 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741967_1143
2015-03-13 10:08:07,094 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741968_1144
2015-03-13 10:08:07,095 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741973_1149
2015-03-13 10:08:07,096 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741971_1147
2015-03-13 10:08:07,096 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741970_1146
2015-03-13 10:08:07,097 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741974_1150
2015-03-13 10:08:07,099 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741972_1148
2015-03-13 10:08:07,100 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741973_1149
2015-03-13 10:08:07,100 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741968_1144
2015-03-13 10:08:07,101 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741970_1146
2015-03-13 10:08:07,101 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741969_1145
2015-03-13 10:08:07,277 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:07,278 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:07,383 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0013_000001 (auth:SIMPLE)
2015-03-13 10:08:07,385 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0013_000001
2015-03-13 10:08:07,385 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi	IP=10.1.1.144	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1426266260362_0013	APPATTEMPTID=appattempt_1426266260362_0013_000001
2015-03-13 10:08:07,385 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0013_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:08:07,386 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0013 State change from ACCEPTED to RUNNING
2015-03-13 10:08:07,408 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job_1426266260362_0013_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:07,410 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:08:07,454 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741953_1129 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741953 for deletion
2015-03-13 10:08:07,454 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741956_1132 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741956 for deletion
2015-03-13 10:08:07,454 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741957_1133 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741957 for deletion
2015-03-13 10:08:07,454 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741962_1138 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741962 for deletion
2015-03-13 10:08:07,454 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741953_1129 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741953
2015-03-13 10:08:07,455 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741957_1133 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741957
2015-03-13 10:08:07,455 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741956_1132 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741956
2015-03-13 10:08:07,454 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741963_1139 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741963 for deletion
2015-03-13 10:08:07,455 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741964_1140 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741964 for deletion
2015-03-13 10:08:07,455 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741962_1138 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741962
2015-03-13 10:08:07,455 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741966_1142 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741966 for deletion
2015-03-13 10:08:07,455 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741967_1143 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741967 for deletion
2015-03-13 10:08:07,455 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741964_1140 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741964
2015-03-13 10:08:07,456 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741967_1143 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741967
2015-03-13 10:08:07,456 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741963_1139 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741963
2015-03-13 10:08:07,456 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741966_1142 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741966
2015-03-13 10:08:07,458 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741972_1148
2015-03-13 10:08:07,466 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741972_1148
2015-03-13 10:08:07,466 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741974_1150
2015-03-13 10:08:07,477 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job_1426266260362_0013_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:07,616 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741955_1131 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741955 for deletion
2015-03-13 10:08:07,616 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741956_1132 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741956 for deletion
2015-03-13 10:08:07,616 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741957_1133 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741957 for deletion
2015-03-13 10:08:07,616 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741958_1134 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741958 for deletion
2015-03-13 10:08:07,616 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741962_1138 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741962 for deletion
2015-03-13 10:08:07,616 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741963_1139 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741963 for deletion
2015-03-13 10:08:07,617 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741964_1140 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741964 for deletion
2015-03-13 10:08:07,616 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741955_1131 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741955
2015-03-13 10:08:07,617 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741965_1141 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741965 for deletion
2015-03-13 10:08:07,617 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741956_1132 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741956
2015-03-13 10:08:07,617 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741957_1133 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741957
2015-03-13 10:08:07,617 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741966_1142 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741966 for deletion
2015-03-13 10:08:07,617 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741958_1134 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741958
2015-03-13 10:08:07,617 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741962_1138 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741962
2015-03-13 10:08:07,617 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741967_1143 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741967 for deletion
2015-03-13 10:08:07,617 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741963_1139 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741963
2015-03-13 10:08:07,617 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741964_1140 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741964
2015-03-13 10:08:07,618 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741966_1142 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741966
2015-03-13 10:08:07,618 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741965_1141 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741965
2015-03-13 10:08:07,618 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741967_1143 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741967
2015-03-13 10:08:07,620 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job_1426266260362_0013_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073741976_1152{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:08:07,657 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741975_1151
2015-03-13 10:08:07,658 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741974_1150
2015-03-13 10:08:07,658 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741976_1152 src: /127.0.0.1:61847 dest: /127.0.0.1:60686
2015-03-13 10:08:07,659 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741971_1147
2015-03-13 10:08:07,659 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741973_1149
2015-03-13 10:08:07,660 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741976_1152 src: /127.0.0.1:61848 dest: /127.0.0.1:60689
2015-03-13 10:08:07,661 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741976_1152 src: /127.0.0.1:61849 dest: /127.0.0.1:60693
2015-03-13 10:08:07,668 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61849, dest: /127.0.0.1:60693, bytes: 90922, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1928401530_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741976_1152, duration: 5168000
2015-03-13 10:08:07,668 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741976_1152, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:07,668 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741976_1152{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:07,669 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61848, dest: /127.0.0.1:60689, bytes: 90922, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1928401530_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741976_1152, duration: 5836000
2015-03-13 10:08:07,669 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741976_1152, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:07,669 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741976_1152{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:07,669 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61847, dest: /127.0.0.1:60686, bytes: 90922, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1928401530_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741976_1152, duration: 6805000
2015-03-13 10:08:07,669 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741976_1152, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:07,670 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741976_1152{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:07,680 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job_1426266260362_0013_1_conf.xml is closed by DFSClient_NONMAPREDUCE_1928401530_1
2015-03-13 10:08:08,284 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:08,284 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:08,626 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0012_01_000001 succeeded 
2015-03-13 10:08:08,626 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:08:08,626 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0012_01_000001
2015-03-13 10:08:08,634 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000001
2015-03-13 10:08:08,634 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000001
2015-03-13 10:08:08,634 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0012	CONTAINERID=container_1426266260362_0012_01_000001
2015-03-13 10:08:08,635 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000001
2015-03-13 10:08:08,635 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000001
2015-03-13 10:08:08,635 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:08:08,635 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0012_01_000001 from application application_1426266260362_0012
2015-03-13 10:08:08,635 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:08,635 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0012
2015-03-13 10:08:09,289 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:08:09,289 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0012_01_000001
2015-03-13 10:08:09,289 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:09,290 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0012_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:08:09,290 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0012_000001
2015-03-13 10:08:09,290 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0012_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:08:09,290 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0012_000001 State change from FINISHING to FINISHED
2015-03-13 10:08:09,291 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0012	CONTAINERID=container_1426266260362_0012_01_000001
2015-03-13 10:08:09,291 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0012 State change from FINISHING to FINISHED
2015-03-13 10:08:09,291 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0012_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:08:09,291 INFO  amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0012_000001
2015-03-13 10:08:09,291 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:08:09,291 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1426266260362_0012
2015-03-13 10:08:09,291 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0012_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:09,292 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0012,name=[65C1F8B7B9BE47B0A23DAB67E3AF740D/2BC7D8F0414F4AAC967872FE1A0F4420] cogrouping/(1/2) ...tform/joinsintocogrouprhs,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0012/jobhistory/job/job_1426266260362_0012,appMasterHost=Edinburgh.local,startTime=1426266462037,finishTime=1426266482490,finalStatus=SUCCEEDED
2015-03-13 10:08:09,292 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:09,292 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1
2015-03-13 10:08:09,292 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0012_000001 released container container_1426266260362_0012_01_000001 on node: host: 10.1.1.144:60715 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:08:09,293 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0013_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:08:09,293 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0013	CONTAINERID=container_1426266260362_0013_01_000002
2015-03-13 10:08:09,293 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0013_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:08:09,293 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0013 container=Container: [ContainerId: container_1426266260362_0013_01_000002, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0013_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:09,293 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=2, numContainers=2
2015-03-13 10:08:09,293 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:09,294 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0013_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:08:09,294 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0013	CONTAINERID=container_1426266260362_0013_01_000003
2015-03-13 10:08:09,294 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0013_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available
2015-03-13 10:08:09,294 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0013 container=Container: [ContainerId: container_1426266260362_0013_01_000003, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0013_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=2, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:09,294 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0012_000001 (auth:SIMPLE)
2015-03-13 10:08:09,294 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=3
2015-03-13 10:08:09,295 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:09,295 INFO  capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0012_000001 is done. finalState=FINISHED
2015-03-13 10:08:09,295 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0012 requests cleared
2015-03-13 10:08:09,295 INFO  capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0012 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:08:09,295 INFO  capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0012 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:08:09,295 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0012_01_000001
2015-03-13 10:08:09,322 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0012 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:08:09,323 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0013_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:08:09,323 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0012
2015-03-13 10:08:09,323 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0012
2015-03-13 10:08:09,323 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0012
2015-03-13 10:08:09,323 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0012 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:08:09,323 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0012, with delay of 10800 seconds
2015-03-13 10:08:09,324 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0012
2015-03-13 10:08:09,323 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0012
2015-03-13 10:08:09,323 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0013	CONTAINERID=container_1426266260362_0013_01_000004
2015-03-13 10:08:09,325 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0013_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:08:09,325 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0013 container=Container: [ContainerId: container_1426266260362_0013_01_000004, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0013_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:09,326 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:08:09,326 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:09,326 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0013_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:08:09,326 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0013	CONTAINERID=container_1426266260362_0013_01_000005
2015-03-13 10:08:09,326 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0013_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:08:09,327 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0013 container=Container: [ContainerId: container_1426266260362_0013_01_000005, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0013_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:09,327 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:08:09,327 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:09,327 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0013_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:08:09,327 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0013	CONTAINERID=container_1426266260362_0013_01_000006
2015-03-13 10:08:09,327 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0013_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:08:09,328 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0013 container=Container: [ContainerId: container_1426266260362_0013_01_000006, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0013_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:09,328 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=1, numContainers=6
2015-03-13 10:08:09,328 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:09,355 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0012 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:08:09,356 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0012 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:08:09,356 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0012
2015-03-13 10:08:09,356 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0012
2015-03-13 10:08:09,356 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0012 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:08:09,356 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0012, with delay of 10800 seconds
2015-03-13 10:08:09,356 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0012
2015-03-13 10:08:09,356 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0012
2015-03-13 10:08:09,357 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0012
2015-03-13 10:08:09,357 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0012
2015-03-13 10:08:09,356 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0012
2015-03-13 10:08:09,358 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0012
2015-03-13 10:08:09,358 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0012
2015-03-13 10:08:09,358 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0012
2015-03-13 10:08:09,356 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0012 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:08:09,359 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0012, with delay of 10800 seconds
2015-03-13 10:08:09,423 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0013_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:08:09,423 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0013_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:08:09,424 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0013_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:08:09,424 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0013_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:08:09,424 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0013_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:08:09,454 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.jar	dst=null	perm=null
2015-03-13 10:08:09,455 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.jar	dst=null	perm=null
2015-03-13 10:08:09,463 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.xml	dst=null	perm=null
2015-03-13 10:08:09,464 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.xml	dst=null	perm=null
2015-03-13 10:08:09,467 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:08:09,468 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:08:09,473 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:08:09,474 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:08:09,475 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:08:09,476 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:08:09,551 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0013_000001 (auth:SIMPLE)
2015-03-13 10:08:09,551 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0013_000001 (auth:SIMPLE)
2015-03-13 10:08:09,555 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0013_01_000002 by user soberoi
2015-03-13 10:08:09,555 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0013_01_000005 by user soberoi
2015-03-13 10:08:09,555 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0013	CONTAINERID=container_1426266260362_0013_01_000002
2015-03-13 10:08:09,555 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0013_01_000002 to application application_1426266260362_0013
2015-03-13 10:08:09,555 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0013
2015-03-13 10:08:09,556 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:08:09,556 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0013
2015-03-13 10:08:09,556 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0013
2015-03-13 10:08:09,556 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:08:09,556 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0013
2015-03-13 10:08:09,557 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:08:09,557 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0013 transitioned from NEW to INITING
2015-03-13 10:08:09,557 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0013_01_000005 to application application_1426266260362_0013
2015-03-13 10:08:09,557 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0013 transitioned from INITING to RUNNING
2015-03-13 10:08:09,556 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0013	CONTAINERID=container_1426266260362_0013_01_000005
2015-03-13 10:08:09,558 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0013_01_000003 by user soberoi
2015-03-13 10:08:09,558 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0013	CONTAINERID=container_1426266260362_0013_01_000003
2015-03-13 10:08:09,559 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0013_01_000006 by user soberoi
2015-03-13 10:08:09,559 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0013	CONTAINERID=container_1426266260362_0013_01_000006
2015-03-13 10:08:09,559 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0013_01_000003 to application application_1426266260362_0013
2015-03-13 10:08:09,559 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:08:09,560 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0013
2015-03-13 10:08:09,560 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0013
2015-03-13 10:08:09,560 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:08:09,560 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0013
2015-03-13 10:08:09,557 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:08:09,560 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0013
2015-03-13 10:08:09,560 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0013
2015-03-13 10:08:09,560 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:08:09,558 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0013_01_000004 by user soberoi
2015-03-13 10:08:09,560 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:08:09,561 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0013	CONTAINERID=container_1426266260362_0013_01_000004
2015-03-13 10:08:09,561 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0013
2015-03-13 10:08:09,561 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:08:09,561 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:08:09,561 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0013_01_000006 to application application_1426266260362_0013
2015-03-13 10:08:09,561 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0013_01_000004 to application application_1426266260362_0013
2015-03-13 10:08:09,561 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0013_01_000005
2015-03-13 10:08:09,562 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:08:09,562 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:08:09,562 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0013
2015-03-13 10:08:09,562 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0013
2015-03-13 10:08:09,562 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:08:09,562 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0013
2015-03-13 10:08:09,563 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0013
2015-03-13 10:08:09,563 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0013
2015-03-13 10:08:09,563 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:08:09,563 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0013
2015-03-13 10:08:09,563 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0013_01_000006
2015-03-13 10:08:09,564 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0013_01_000004
2015-03-13 10:08:09,581 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426266260362_0013_01_000006.tokens. Credentials list: 
2015-03-13 10:08:09,582 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426266260362_0013_01_000005.tokens. Credentials list: 
2015-03-13 10:08:09,585 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426266260362_0013_01_000004.tokens. Credentials list: 
2015-03-13 10:08:09,602 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:08:09,603 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:09,609 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:08:09,610 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:08:09,610 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:09,690 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000003/default_container_executor.sh]
2015-03-13 10:08:09,701 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000002/default_container_executor.sh]
2015-03-13 10:08:09,703 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426266260362_0013_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000006.tokens
2015-03-13 10:08:09,704 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0013 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0013
2015-03-13 10:08:09,785 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.jar	dst=null	perm=null
2015-03-13 10:08:09,786 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.jar	dst=null	perm=null
2015-03-13 10:08:09,787 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.jar	dst=null	perm=null
2015-03-13 10:08:09,795 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61855, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1415027228_7271, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741972_1148, duration: 472000
2015-03-13 10:08:09,821 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:08:09,843 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.xml	dst=null	perm=null
2015-03-13 10:08:09,843 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.xml	dst=null	perm=null
2015-03-13 10:08:09,844 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.xml	dst=null	perm=null
2015-03-13 10:08:09,853 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61856, bytes: 98880, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1415027228_7271, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741975_1151, duration: 264000
2015-03-13 10:08:09,873 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:08:09,873 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:08:09,874 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:08:09,874 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:08:09,916 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:08:09,916 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:08:09,916 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:09,916 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:08:09,916 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:09,916 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:10,050 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000005/default_container_executor.sh]
2015-03-13 10:08:10,050 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000006/default_container_executor.sh]
2015-03-13 10:08:10,050 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000004/default_container_executor.sh]
2015-03-13 10:08:10,293 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:10,293 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:10,293 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:10,293 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0012 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:08:10,293 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0013_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:08:10,294 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0013_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:08:10,294 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0012
2015-03-13 10:08:10,294 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0012
2015-03-13 10:08:10,294 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0012
2015-03-13 10:08:10,294 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0012
2015-03-13 10:08:10,294 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0012 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:08:10,294 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0012, with delay of 10800 seconds
2015-03-13 10:08:10,294 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0012
2015-03-13 10:08:10,327 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:10,328 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:10,328 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:10,328 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0013_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:08:10,328 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0013_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:08:10,328 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0013_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:08:10,443 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:08:10,903 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:08:11,032 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426266260362_0013_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000004.tokens
2015-03-13 10:08:11,032 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0013 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0013
2015-03-13 10:08:11,134 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:08:11,258 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426266260362_0013_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000005.tokens
2015-03-13 10:08:11,258 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0013 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0013
2015-03-13 10:08:11,297 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:11,297 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:11,297 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:11,329 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:11,330 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:11,330 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:12,105 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741976_1152
2015-03-13 10:08:12,108 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741976_1152
2015-03-13 10:08:12,301 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:12,301 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:12,302 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:12,332 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:12,332 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:12,333 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:12,472 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741976_1152
2015-03-13 10:08:13,303 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:13,303 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:13,303 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:13,336 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:13,336 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:13,336 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:14,304 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:14,305 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:14,305 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:14,338 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:14,338 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:14,338 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:15,310 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:15,310 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:15,310 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:15,343 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:15,343 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:15,343 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:16,315 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:16,316 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:16,316 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:16,347 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:16,347 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:16,348 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:17,321 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:17,322 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:17,322 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:17,351 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:17,351 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:17,351 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:17,568 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.split	dst=null	perm=null
2015-03-13 10:08:17,631 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.split	dst=null	perm=null
2015-03-13 10:08:17,705 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.split	dst=null	perm=null
2015-03-13 10:08:17,854 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61867, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0013_m_000000_0_-1839122723_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741973_1149, duration: 121000
2015-03-13 10:08:17,878 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61868, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0013_m_000003_0_-8042734_1, offset: 1024, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741973_1149, duration: 153000
2015-03-13 10:08:17,886 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.split	dst=null	perm=null
2015-03-13 10:08:17,897 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.split	dst=null	perm=null
2015-03-13 10:08:17,914 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61869, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0013_m_000001_0_-775877612_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741973_1149, duration: 158000
2015-03-13 10:08:18,000 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:08:18,016 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:08:18,020 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/_temporary/attempt_1426266260362_0013_m_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:18,023 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61874, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0013_m_000003_0_-8042734_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 175000
2015-03-13 10:08:18,024 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61872, bytes: 1282, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0013_m_000002_0_656198417_1, offset: 512, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741973_1149, duration: 152000
2015-03-13 10:08:18,029 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61873, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0013_m_000004_0_168147244_1, offset: 1024, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741973_1149, duration: 191000
2015-03-13 10:08:18,039 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/_temporary/attempt_1426266260362_0013_m_000003_0/part-00003	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:18,054 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:08:18,058 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61875, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0013_m_000001_0_-775877612_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 162000
2015-03-13 10:08:18,077 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/_temporary/attempt_1426266260362_0013_m_000001_0/part-00001	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:18,159 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:08:18,175 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61876, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0013_m_000004_0_168147244_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 157000
2015-03-13 10:08:18,184 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:08:18,189 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61877, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0013_m_000002_0_656198417_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 151000
2015-03-13 10:08:18,191 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/_temporary/attempt_1426266260362_0013_m_000004_0/part-00004	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:18,227 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/_temporary/attempt_1426266260362_0013_m_000002_0/part-00002	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:18,323 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:18,323 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:18,323 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:18,352 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:18,352 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:18,352 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:18,978 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:08:18,989 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:08:18,992 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:08:18,996 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61878, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0013_m_000000_0_-1839122723_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 160000
2015-03-13 10:08:19,001 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61879, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0013_m_000000_0_-1839122723_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 158000
2015-03-13 10:08:19,003 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:08:19,026 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/_temporary/attempt_1426266260362_0013_m_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073741977_1153{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:08:19,029 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:08:19,037 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:08:19,043 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61881, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0013_m_000003_0_-8042734_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 163000
2015-03-13 10:08:19,067 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741977_1153 src: /127.0.0.1:61880 dest: /127.0.0.1:60693
2015-03-13 10:08:19,068 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/_temporary/attempt_1426266260362_0013_m_000003_0/part-00003. BP-1005356445-10.1.1.144-1426266257849 blk_1073741978_1154{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:08:19,069 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741977_1153 src: /127.0.0.1:61882 dest: /127.0.0.1:60689
2015-03-13 10:08:19,070 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741977_1153 src: /127.0.0.1:61883 dest: /127.0.0.1:60696
2015-03-13 10:08:19,078 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61883, dest: /127.0.0.1:60696, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0013_m_000000_0_-1839122723_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741977_1153, duration: 6284000
2015-03-13 10:08:19,078 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741977_1153, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:19,079 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741977_1153{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:19,079 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61882, dest: /127.0.0.1:60689, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0013_m_000000_0_-1839122723_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741977_1153, duration: 7132000
2015-03-13 10:08:19,079 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741977_1153, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:19,080 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61880, dest: /127.0.0.1:60693, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0013_m_000000_0_-1839122723_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741977_1153, duration: 8065000
2015-03-13 10:08:19,080 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741977_1153{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:19,080 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741977_1153, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:19,081 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741977_1153{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:19,090 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/_temporary/attempt_1426266260362_0013_m_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0013_m_000000_0_-1839122723_1
2015-03-13 10:08:19,095 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:08:19,098 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/_temporary/attempt_1426266260362_0013_m_000000_0	dst=null	perm=null
2015-03-13 10:08:19,104 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/_temporary/attempt_1426266260362_0013_m_000000_0	dst=null	perm=null
2015-03-13 10:08:19,106 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/task_1426266260362_0013_m_000000	dst=null	perm=null
2015-03-13 10:08:19,108 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:08:19,111 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/_temporary/attempt_1426266260362_0013_m_000000_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/task_1426266260362_0013_m_000000	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:08:19,112 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741978_1154 src: /127.0.0.1:61884 dest: /127.0.0.1:60686
2015-03-13 10:08:19,113 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741978_1154 src: /127.0.0.1:61885 dest: /127.0.0.1:60689
2015-03-13 10:08:19,115 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741978_1154 src: /127.0.0.1:61886 dest: /127.0.0.1:60696
2015-03-13 10:08:19,115 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:08:19,120 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61887, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0013_m_000001_0_-775877612_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 160000
2015-03-13 10:08:19,122 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61886, dest: /127.0.0.1:60696, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0013_m_000003_0_-8042734_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741978_1154, duration: 6097000
2015-03-13 10:08:19,122 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741978_1154, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:19,123 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741978_1154{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:19,123 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61885, dest: /127.0.0.1:60689, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0013_m_000003_0_-8042734_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741978_1154, duration: 7027000
2015-03-13 10:08:19,123 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741978_1154, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:19,124 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61884, dest: /127.0.0.1:60686, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0013_m_000003_0_-8042734_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741978_1154, duration: 8233000
2015-03-13 10:08:19,125 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741978_1154, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:19,124 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741978_1154{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:19,125 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741978_1154{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:19,129 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/_temporary/attempt_1426266260362_0013_m_000003_0/part-00003 is closed by DFSClient_attempt_1426266260362_0013_m_000003_0_-8042734_1
2015-03-13 10:08:19,136 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0013_01_000002
2015-03-13 10:08:19,136 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0013	CONTAINERID=container_1426266260362_0013_01_000002
2015-03-13 10:08:19,136 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:08:19,136 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0013_01_000002
2015-03-13 10:08:19,136 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:19,136 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:08:19,136 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:19,139 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/_temporary/attempt_1426266260362_0013_m_000003_0	dst=null	perm=null
2015-03-13 10:08:19,149 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0013_01_000002 is : 143
2015-03-13 10:08:19,152 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job_1426266260362_0013_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073741979_1155{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:08:19,154 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741979_1155 src: /127.0.0.1:61888 dest: /127.0.0.1:60686
2015-03-13 10:08:19,156 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741979_1155 src: /127.0.0.1:61889 dest: /127.0.0.1:60696
2015-03-13 10:08:19,157 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741979_1155 src: /127.0.0.1:61890 dest: /127.0.0.1:60693
2015-03-13 10:08:19,161 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:08:19,161 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000002
2015-03-13 10:08:19,161 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000002
2015-03-13 10:08:19,161 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000002
2015-03-13 10:08:19,161 INFO  hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job_1426266260362_0013_1.jhist for DFSClient_NONMAPREDUCE_1928401530_1
2015-03-13 10:08:19,162 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000002
2015-03-13 10:08:19,161 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0013	CONTAINERID=container_1426266260362_0013_01_000002
2015-03-13 10:08:19,162 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:08:19,163 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0013_01_000002 from application application_1426266260362_0013
2015-03-13 10:08:19,163 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:19,163 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0013
2015-03-13 10:08:19,181 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/_temporary/attempt_1426266260362_0013_m_000001_0/part-00001. BP-1005356445-10.1.1.144-1426266257849 blk_1073741980_1156{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:08:19,214 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:08:19,215 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:08:19,223 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741980_1156 src: /127.0.0.1:61891 dest: /127.0.0.1:60689
2015-03-13 10:08:19,225 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741980_1156 src: /127.0.0.1:61892 dest: /127.0.0.1:60686
2015-03-13 10:08:19,226 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741980_1156 src: /127.0.0.1:61893 dest: /127.0.0.1:60696
2015-03-13 10:08:19,232 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:08:19,239 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61893, dest: /127.0.0.1:60696, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0013_m_000001_0_-775877612_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741980_1156, duration: 11171000
2015-03-13 10:08:19,239 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741980_1156, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:19,239 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741980_1156{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:19,239 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61892, dest: /127.0.0.1:60686, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0013_m_000001_0_-775877612_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741980_1156, duration: 11838000
2015-03-13 10:08:19,240 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741980_1156, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:19,240 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741980_1156{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:19,240 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61891, dest: /127.0.0.1:60689, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0013_m_000001_0_-775877612_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741980_1156, duration: 12589000
2015-03-13 10:08:19,240 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741980_1156, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:19,241 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741980_1156{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:19,242 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:08:19,245 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/_temporary/attempt_1426266260362_0013_m_000001_0/part-00001 is closed by DFSClient_attempt_1426266260362_0013_m_000001_0_-775877612_1
2015-03-13 10:08:19,246 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:08:19,246 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:08:19,254 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61894, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0013_m_000004_0_168147244_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 161000
2015-03-13 10:08:19,259 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/_temporary/attempt_1426266260362_0013_m_000001_0	dst=null	perm=null
2015-03-13 10:08:19,266 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/_temporary/attempt_1426266260362_0013_m_000001_0	dst=null	perm=null
2015-03-13 10:08:19,267 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/task_1426266260362_0013_m_000001	dst=null	perm=null
2015-03-13 10:08:19,270 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61895, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0013_m_000002_0_656198417_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 164000
2015-03-13 10:08:19,271 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/_temporary/attempt_1426266260362_0013_m_000001_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/task_1426266260362_0013_m_000001	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:08:19,271 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/_temporary/attempt_1426266260362_0013_m_000004_0/part-00004 is closed by DFSClient_attempt_1426266260362_0013_m_000004_0_168147244_1
2015-03-13 10:08:19,282 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0013_01_000003
2015-03-13 10:08:19,282 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0013	CONTAINERID=container_1426266260362_0013_01_000003
2015-03-13 10:08:19,282 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/_temporary/attempt_1426266260362_0013_m_000004_0	dst=null	perm=null
2015-03-13 10:08:19,282 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:08:19,282 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:19,283 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0013_01_000003
2015-03-13 10:08:19,283 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:08:19,283 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0013_01_000002
2015-03-13 10:08:19,283 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:08:19,284 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0013_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:08:19,284 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0013_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:08:19,284 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0013	CONTAINERID=container_1426266260362_0013_01_000002
2015-03-13 10:08:19,284 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0013_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available, release resources=true
2015-03-13 10:08:19,284 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:08:19,284 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0013_01_000002, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:19,284 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:19,284 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:08:19,284 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0013_000001 released container container_1426266260362_0013_01_000002 on node: host: 10.1.1.144:60715 #containers=2 available=1024 used=3072 with event: FINISHED
2015-03-13 10:08:19,295 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0013_01_000003 is : 143
2015-03-13 10:08:19,307 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:08:19,307 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/_temporary/attempt_1426266260362_0013_m_000002_0/part-00002. BP-1005356445-10.1.1.144-1426266257849 blk_1073741981_1157{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:08:19,307 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000003
2015-03-13 10:08:19,308 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000003
2015-03-13 10:08:19,308 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000003
2015-03-13 10:08:19,308 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000003
2015-03-13 10:08:19,308 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0013	CONTAINERID=container_1426266260362_0013_01_000003
2015-03-13 10:08:19,308 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:08:19,309 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0013_01_000003 from application application_1426266260362_0013
2015-03-13 10:08:19,309 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:19,309 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0013
2015-03-13 10:08:19,344 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741981_1157 src: /127.0.0.1:61896 dest: /127.0.0.1:60689
2015-03-13 10:08:19,345 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741981_1157 src: /127.0.0.1:61897 dest: /127.0.0.1:60693
2015-03-13 10:08:19,347 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741981_1157 src: /127.0.0.1:61898 dest: /127.0.0.1:60686
2015-03-13 10:08:19,355 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:19,355 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:19,355 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:19,357 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61898, dest: /127.0.0.1:60686, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0013_m_000002_0_656198417_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741981_1157, duration: 8455000
2015-03-13 10:08:19,357 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741981_1157, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:19,358 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741981_1157{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:08:19,358 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61897, dest: /127.0.0.1:60693, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0013_m_000002_0_656198417_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741981_1157, duration: 9138000
2015-03-13 10:08:19,358 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741981_1157, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:19,359 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741981_1157{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:08:19,359 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61896, dest: /127.0.0.1:60689, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0013_m_000002_0_656198417_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741981_1157, duration: 10132000
2015-03-13 10:08:19,359 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741981_1157, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:19,359 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741981_1157{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:08:19,365 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/_temporary/attempt_1426266260362_0013_m_000002_0/part-00002 is closed by DFSClient_attempt_1426266260362_0013_m_000002_0_656198417_1
2015-03-13 10:08:19,374 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/_temporary/attempt_1426266260362_0013_m_000002_0	dst=null	perm=null
2015-03-13 10:08:19,379 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/_temporary/attempt_1426266260362_0013_m_000002_0	dst=null	perm=null
2015-03-13 10:08:19,380 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/task_1426266260362_0013_m_000002	dst=null	perm=null
2015-03-13 10:08:19,384 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/_temporary/attempt_1426266260362_0013_m_000002_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/task_1426266260362_0013_m_000002	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:08:19,400 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0013_01_000004
2015-03-13 10:08:19,400 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0013	CONTAINERID=container_1426266260362_0013_01_000004
2015-03-13 10:08:19,400 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:08:19,401 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0013_01_000004
2015-03-13 10:08:19,401 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:08:19,401 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:19,401 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:19,412 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0013_01_000004 is : 143
2015-03-13 10:08:19,423 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:08:19,424 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000004
2015-03-13 10:08:19,424 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000004
2015-03-13 10:08:19,424 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000004
2015-03-13 10:08:19,425 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000004
2015-03-13 10:08:19,425 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0013	CONTAINERID=container_1426266260362_0013_01_000004
2015-03-13 10:08:19,425 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:08:19,425 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0013_01_000004 from application application_1426266260362_0013
2015-03-13 10:08:19,426 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:19,426 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0013
2015-03-13 10:08:20,151 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/_temporary/attempt_1426266260362_0013_m_000003_0	dst=null	perm=null
2015-03-13 10:08:20,152 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/task_1426266260362_0013_m_000003	dst=null	perm=null
2015-03-13 10:08:20,156 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/_temporary/attempt_1426266260362_0013_m_000003_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/task_1426266260362_0013_m_000003	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:08:20,164 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0013_01_000005
2015-03-13 10:08:20,164 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0013	CONTAINERID=container_1426266260362_0013_01_000005
2015-03-13 10:08:20,164 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:08:20,164 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0013_01_000005
2015-03-13 10:08:20,164 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:08:20,164 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0013_01_000004
2015-03-13 10:08:20,165 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:08:20,165 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:20,165 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0013_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:08:20,165 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0013_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:08:20,165 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0013	CONTAINERID=container_1426266260362_0013_01_000004
2015-03-13 10:08:20,166 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0013_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:08:20,166 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:08:20,166 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0013_01_000004, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:20,166 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:20,166 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:08:20,166 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0013_000001 released container container_1426266260362_0013_01_000004 on node: host: 10.1.1.144:60723 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:08:20,173 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0013_01_000005 is : 143
2015-03-13 10:08:20,180 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:08:20,180 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000005
2015-03-13 10:08:20,180 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0013	CONTAINERID=container_1426266260362_0013_01_000005
2015-03-13 10:08:20,180 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:08:20,180 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0013_01_000005 from application application_1426266260362_0013
2015-03-13 10:08:20,180 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:20,180 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0013
2015-03-13 10:08:20,180 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000005
2015-03-13 10:08:20,181 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000005
2015-03-13 10:08:20,180 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000005
2015-03-13 10:08:20,287 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:20,287 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:08:20,287 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0013_01_000003
2015-03-13 10:08:20,288 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0013_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:08:20,288 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0013_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:08:20,288 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0013	CONTAINERID=container_1426266260362_0013_01_000003
2015-03-13 10:08:20,288 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0013_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:08:20,288 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:08:20,289 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0013_01_000003, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:20,289 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:20,289 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:08:20,289 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0013_000001 released container container_1426266260362_0013_01_000003 on node: host: 10.1.1.144:60715 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:08:20,297 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/_temporary/attempt_1426266260362_0013_m_000004_0	dst=null	perm=null
2015-03-13 10:08:20,298 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/task_1426266260362_0013_m_000004	dst=null	perm=null
2015-03-13 10:08:20,301 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/_temporary/attempt_1426266260362_0013_m_000004_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/task_1426266260362_0013_m_000004	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:08:20,309 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0013_01_000006
2015-03-13 10:08:20,309 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0013	CONTAINERID=container_1426266260362_0013_01_000006
2015-03-13 10:08:20,309 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:08:20,310 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0013_01_000006
2015-03-13 10:08:20,310 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:08:20,310 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0013_01_000005
2015-03-13 10:08:20,310 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:08:20,310 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0013_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:08:20,311 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0013_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:08:20,311 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0013	CONTAINERID=container_1426266260362_0013_01_000005
2015-03-13 10:08:20,311 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0013_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:08:20,311 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:08:20,311 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0013_01_000005, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:20,311 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:20,311 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:08:20,311 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0013_000001 released container container_1426266260362_0013_01_000005 on node: host: 10.1.1.144:60723 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:08:20,314 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:20,316 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_1928401530_1
2015-03-13 10:08:20,320 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1	dst=null	perm=null
2015-03-13 10:08:20,323 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0013_01_000006 is : 143
2015-03-13 10:08:20,327 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher	dst=null	perm=null
2015-03-13 10:08:20,328 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher	dst=null	perm=null
2015-03-13 10:08:20,329 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/task_1426266260362_0013_m_000000	dst=null	perm=null
2015-03-13 10:08:20,330 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/part-00000	dst=null	perm=null
2015-03-13 10:08:20,332 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:08:20,332 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/task_1426266260362_0013_m_000000/part-00000	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/part-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:20,332 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000006
2015-03-13 10:08:20,333 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0013	CONTAINERID=container_1426266260362_0013_01_000006
2015-03-13 10:08:20,333 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:08:20,333 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0013_01_000006 from application application_1426266260362_0013
2015-03-13 10:08:20,333 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:20,333 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0013
2015-03-13 10:08:20,333 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000006
2015-03-13 10:08:20,333 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000006
2015-03-13 10:08:20,333 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000006
2015-03-13 10:08:20,335 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher	dst=null	perm=null
2015-03-13 10:08:20,336 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher	dst=null	perm=null
2015-03-13 10:08:20,337 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/task_1426266260362_0013_m_000001	dst=null	perm=null
2015-03-13 10:08:20,338 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/part-00001	dst=null	perm=null
2015-03-13 10:08:20,339 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/task_1426266260362_0013_m_000001/part-00001	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/part-00001	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:20,340 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher	dst=null	perm=null
2015-03-13 10:08:20,340 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher	dst=null	perm=null
2015-03-13 10:08:20,341 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/task_1426266260362_0013_m_000002	dst=null	perm=null
2015-03-13 10:08:20,342 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/part-00002	dst=null	perm=null
2015-03-13 10:08:20,345 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/task_1426266260362_0013_m_000002/part-00002	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/part-00002	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:20,346 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher	dst=null	perm=null
2015-03-13 10:08:20,347 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher	dst=null	perm=null
2015-03-13 10:08:20,348 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/task_1426266260362_0013_m_000003	dst=null	perm=null
2015-03-13 10:08:20,349 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/part-00003	dst=null	perm=null
2015-03-13 10:08:20,351 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/task_1426266260362_0013_m_000003/part-00003	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/part-00003	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:20,352 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher	dst=null	perm=null
2015-03-13 10:08:20,353 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher	dst=null	perm=null
2015-03-13 10:08:20,354 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/task_1426266260362_0013_m_000004	dst=null	perm=null
2015-03-13 10:08:20,354 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/part-00004	dst=null	perm=null
2015-03-13 10:08:20,356 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/task_1426266260362_0013_m_000004/part-00004	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/part-00004	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:20,358 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary	dst=null	perm=null
2015-03-13 10:08:20,362 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:20,364 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_SUCCESS is closed by DFSClient_NONMAPREDUCE_1928401530_1
2015-03-13 10:08:20,366 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:20,367 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_1928401530_1
2015-03-13 10:08:20,379 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61890, dest: /127.0.0.1:60693, bytes: 53309, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1928401530_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741979_1155, duration: 1220712000
2015-03-13 10:08:20,379 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741979_1155, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:20,381 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741979_1155{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:20,381 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61889, dest: /127.0.0.1:60696, bytes: 53309, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1928401530_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741979_1155, duration: 1221869000
2015-03-13 10:08:20,381 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741979_1155, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:20,382 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741979_1155{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:20,382 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61888, dest: /127.0.0.1:60686, bytes: 53309, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1928401530_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741979_1155, duration: 1223555000
2015-03-13 10:08:20,382 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741979_1155, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:20,384 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741979_1155{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:20,385 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job_1426266260362_0013_1.jhist is closed by DFSClient_NONMAPREDUCE_1928401530_1
2015-03-13 10:08:20,387 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0013.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:20,389 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0013.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741982_1158{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:08:20,390 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741982_1158 src: /127.0.0.1:61899 dest: /127.0.0.1:60689
2015-03-13 10:08:20,391 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741982_1158 src: /127.0.0.1:61900 dest: /127.0.0.1:60693
2015-03-13 10:08:20,392 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741982_1158 src: /127.0.0.1:61901 dest: /127.0.0.1:60696
2015-03-13 10:08:20,395 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61901, dest: /127.0.0.1:60696, bytes: 440, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1928401530_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741982_1158, duration: 1336000
2015-03-13 10:08:20,395 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741982_1158, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:20,395 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741982_1158{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:20,396 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61900, dest: /127.0.0.1:60693, bytes: 440, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1928401530_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741982_1158, duration: 1833000
2015-03-13 10:08:20,396 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741982_1158, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:20,396 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741982_1158{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:20,396 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61899, dest: /127.0.0.1:60689, bytes: 440, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1928401530_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741982_1158, duration: 2731000
2015-03-13 10:08:20,397 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741982_1158, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:20,397 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741982_1158{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:20,398 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0013.summary_tmp is closed by DFSClient_NONMAPREDUCE_1928401530_1
2015-03-13 10:08:20,402 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0013.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:08:20,407 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job_1426266260362_0013_1.jhist	dst=null	perm=null
2015-03-13 10:08:20,409 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0013-1426266483799-soberoi-%5B66292338870B4E96BCA2C279F2316D18%2F1DA395B3D9054135-1426266500368-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:08:20,413 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job_1426266260362_0013_1.jhist	dst=null	perm=null
2015-03-13 10:08:20,415 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0013-1426266483799-soberoi-%5B66292338870B4E96BCA2C279F2316D18%2F1DA395B3D9054135-1426266500368-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:08:20,416 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job_1426266260362_0013_1.jhist	dst=null	perm=null
2015-03-13 10:08:20,418 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0013-1426266483799-soberoi-%5B66292338870B4E96BCA2C279F2316D18%2F1DA395B3D9054135-1426266500368-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:20,424 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61902, bytes: 53729, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1928401530_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741979_1155, duration: 180000
2015-03-13 10:08:20,426 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0013-1426266483799-soberoi-%5B66292338870B4E96BCA2C279F2316D18%2F1DA395B3D9054135-1426266500368-5-0-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741983_1159{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:08:20,428 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741983_1159 src: /127.0.0.1:61903 dest: /127.0.0.1:60696
2015-03-13 10:08:20,429 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741983_1159 src: /127.0.0.1:61904 dest: /127.0.0.1:60689
2015-03-13 10:08:20,430 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741983_1159 src: /127.0.0.1:61905 dest: /127.0.0.1:60693
2015-03-13 10:08:20,433 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61905, dest: /127.0.0.1:60693, bytes: 53309, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1928401530_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741983_1159, duration: 1554000
2015-03-13 10:08:20,433 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741983_1159, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:20,433 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741983_1159{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:20,433 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61904, dest: /127.0.0.1:60689, bytes: 53309, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1928401530_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741983_1159, duration: 1990000
2015-03-13 10:08:20,434 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741983_1159, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:20,434 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741983_1159{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:20,434 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61903, dest: /127.0.0.1:60696, bytes: 53309, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1928401530_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741983_1159, duration: 2702000
2015-03-13 10:08:20,434 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741983_1159, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:20,435 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741983_1159{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:20,436 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0013-1426266483799-soberoi-%5B66292338870B4E96BCA2C279F2316D18%2F1DA395B3D9054135-1426266500368-5-0-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_1928401530_1
2015-03-13 10:08:20,438 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0013-1426266483799-soberoi-%5B66292338870B4E96BCA2C279F2316D18%2F1DA395B3D9054135-1426266500368-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:08:20,439 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job_1426266260362_0013_1_conf.xml	dst=null	perm=null
2015-03-13 10:08:20,440 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0013_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:08:20,440 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job_1426266260362_0013_1_conf.xml	dst=null	perm=null
2015-03-13 10:08:20,441 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0013_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:08:20,442 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job_1426266260362_0013_1_conf.xml	dst=null	perm=null
2015-03-13 10:08:20,444 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0013_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:20,446 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61906, bytes: 91634, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1928401530_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741976_1152, duration: 211000
2015-03-13 10:08:20,448 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0013_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741984_1160{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:08:20,449 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741984_1160 src: /127.0.0.1:61907 dest: /127.0.0.1:60693
2015-03-13 10:08:20,451 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741984_1160 src: /127.0.0.1:61908 dest: /127.0.0.1:60696
2015-03-13 10:08:20,452 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741984_1160 src: /127.0.0.1:61909 dest: /127.0.0.1:60689
2015-03-13 10:08:20,455 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61909, dest: /127.0.0.1:60689, bytes: 90922, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1928401530_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741984_1160, duration: 1741000
2015-03-13 10:08:20,455 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741984_1160, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:20,456 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741984_1160{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:08:20,456 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61908, dest: /127.0.0.1:60696, bytes: 90922, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1928401530_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741984_1160, duration: 2377000
2015-03-13 10:08:20,456 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741984_1160, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:20,457 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741984_1160{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:08:20,457 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61907, dest: /127.0.0.1:60693, bytes: 90922, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1928401530_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741984_1160, duration: 3162000
2015-03-13 10:08:20,457 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741984_1160, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:20,457 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741984_1160{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:08:20,459 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0013_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_1928401530_1
2015-03-13 10:08:20,461 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0013_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:08:20,462 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0013.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0013.summary	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:08:20,464 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0013_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0013_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:08:20,467 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0013-1426266483799-soberoi-%5B66292338870B4E96BCA2C279F2316D18%2F1DA395B3D9054135-1426266500368-5-0-SUCCEEDED-default.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0013-1426266483799-soberoi-%5B66292338870B4E96BCA2C279F2316D18%2F1DA395B3D9054135-1426266500368-5-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:08:20,474 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0013_000001 State change from RUNNING to FINISHING
2015-03-13 10:08:20,474 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0013
2015-03-13 10:08:20,474 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0013 State change from RUNNING to REMOVING
2015-03-13 10:08:20,474 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0013
2015-03-13 10:08:20,474 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0013 State change from REMOVING to FINISHING
2015-03-13 10:08:21,293 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:21,311 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:08:21,312 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0013_01_000006
2015-03-13 10:08:21,312 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0013_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:08:21,312 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0013_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:08:21,313 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0013	CONTAINERID=container_1426266260362_0013_01_000006
2015-03-13 10:08:21,313 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0013_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:08:21,313 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:08:21,314 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0013_01_000006, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:21,314 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:21,314 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:08:21,314 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0013_000001 released container container_1426266260362_0013_01_000006 on node: host: 10.1.1.144:60723 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:08:21,485 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741972_1148 127.0.0.1:60686 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60689 
2015-03-13 10:08:21,485 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741973_1149 127.0.0.1:60689 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60693 
2015-03-13 10:08:21,485 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741974_1150 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60686 
2015-03-13 10:08:21,486 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741975_1151 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60686 
2015-03-13 10:08:21,486 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741979_1155 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60693 
2015-03-13 10:08:21,486 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741976_1152 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60693 
2015-03-13 10:08:21,486 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013	dst=null	perm=null
2015-03-13 10:08:21,513 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher	dst=null	perm=null
2015-03-13 10:08:21,513 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary
2015-03-13 10:08:21,514 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary	dst=null	perm=null
2015-03-13 10:08:21,520 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:08:21,521 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:08:21,521 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:08:21,522 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher	dst=null	perm=null
2015-03-13 10:08:21,523 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher	dst=null	perm=null
2015-03-13 10:08:21,523 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher	dst=null	perm=null
2015-03-13 10:08:21,525 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:08:21,525 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/part-00000	dst=null	perm=null
2015-03-13 10:08:21,527 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61911, bytes: 20, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741977_1153, duration: 183000
2015-03-13 10:08:21,528 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/part-00001	dst=null	perm=null
2015-03-13 10:08:21,529 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61911, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741980_1156, duration: 139000
2015-03-13 10:08:21,530 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/part-00002	dst=null	perm=null
2015-03-13 10:08:21,531 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61912, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741981_1157, duration: 172000
2015-03-13 10:08:21,532 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/part-00003	dst=null	perm=null
2015-03-13 10:08:21,534 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61913, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741978_1154, duration: 157000
2015-03-13 10:08:21,534 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/part-00004	dst=null	perm=null
2015-03-13 10:08:21,541 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:08:21,541 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:08:21,542 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:08:21,543 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher	dst=null	perm=null
2015-03-13 10:08:21,543 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher	dst=null	perm=null
2015-03-13 10:08:21,544 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher	dst=null	perm=null
2015-03-13 10:08:21,545 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:08:21,546 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/part-00000	dst=null	perm=null
2015-03-13 10:08:21,547 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61912, bytes: 20, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741977_1153, duration: 167000
2015-03-13 10:08:21,548 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/part-00001	dst=null	perm=null
2015-03-13 10:08:21,550 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61914, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741980_1156, duration: 160000
2015-03-13 10:08:21,550 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/part-00002	dst=null	perm=null
2015-03-13 10:08:21,551 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61912, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741981_1157, duration: 154000
2015-03-13 10:08:21,552 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/part-00003	dst=null	perm=null
2015-03-13 10:08:21,553 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61913, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741978_1154, duration: 107000
2015-03-13 10:08:21,554 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/part-00004	dst=null	perm=null
2015-03-13 10:08:21,554 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/joinhasher
2015-03-13 10:08:21,554 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher	dst=null	perm=null
2015-03-13 10:08:21,555 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher	dst=null	perm=null
2015-03-13 10:08:21,555 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher	dst=null	perm=null
2015-03-13 10:08:21,556 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher	dst=null	perm=null
2015-03-13 10:08:21,557 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/part-00000	dst=null	perm=null
2015-03-13 10:08:21,557 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/part-00000	dst=null	perm=null
2015-03-13 10:08:21,558 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61912, bytes: 20, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741977_1153, duration: 163000
2015-03-13 10:08:21,559 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/part-00001	dst=null	perm=null
2015-03-13 10:08:21,559 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/part-00001	dst=null	perm=null
2015-03-13 10:08:21,561 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61911, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741980_1156, duration: 157000
2015-03-13 10:08:21,561 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/part-00002	dst=null	perm=null
2015-03-13 10:08:21,562 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/part-00002	dst=null	perm=null
2015-03-13 10:08:21,563 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61913, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741981_1157, duration: 158000
2015-03-13 10:08:21,563 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/part-00003	dst=null	perm=null
2015-03-13 10:08:21,564 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/part-00003	dst=null	perm=null
2015-03-13 10:08:21,565 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61914, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741978_1154, duration: 159000
2015-03-13 10:08:21,566 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/part-00004	dst=null	perm=null
2015-03-13 10:08:21,566 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/part-00004	dst=null	perm=null
2015-03-13 10:08:21,568 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:08:21,568 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:08:21,569 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower+upper.txt	dst=null	perm=null
2015-03-13 10:08:21,570 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower+upper.txt	dst=null	perm=null
2015-03-13 10:08:21,571 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower+upper.txt	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:21,573 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower+upper.txt. BP-1005356445-10.1.1.144-1426266257849 blk_1073741985_1161{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:08:21,574 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741985_1161 src: /127.0.0.1:61915 dest: /127.0.0.1:60696
2015-03-13 10:08:21,575 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741985_1161 src: /127.0.0.1:61916 dest: /127.0.0.1:60693
2015-03-13 10:08:21,576 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741985_1161 src: /127.0.0.1:61917 dest: /127.0.0.1:60686
2015-03-13 10:08:21,579 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61917, dest: /127.0.0.1:60686, bytes: 30, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741985_1161, duration: 1072000
2015-03-13 10:08:21,579 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741985_1161, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:21,579 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741985_1161{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:08:21,579 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61916, dest: /127.0.0.1:60693, bytes: 30, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741985_1161, duration: 1382000
2015-03-13 10:08:21,579 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741985_1161, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:21,580 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741985_1161{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:08:21,580 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61915, dest: /127.0.0.1:60696, bytes: 30, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741985_1161, duration: 2133000
2015-03-13 10:08:21,580 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741985_1161, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:21,581 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741985_1161{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:08:21,582 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower+upper.txt is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:08:21,594 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:08:21,595 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:08:21,595 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:08:21,622 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin	dst=null	perm=null
2015-03-13 10:08:21,623 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper*joined] starting
2015-03-13 10:08:21,623 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper*joined]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt"]
2015-03-13 10:08:21,624 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper*joined]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower+upper.txt"]
2015-03-13 10:08:21,624 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper*joined]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-03-13 10:08:21,624 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper*joined]  sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin"]
2015-03-13 10:08:21,624 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper*joined]  parallel execution is enabled: true
2015-03-13 10:08:21,624 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper*joined]  starting jobs: 2
2015-03-13 10:08:21,624 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper*joined]  allocating threads: 2
2015-03-13 10:08:21,625 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper*joined] starting step: (2/2)
2015-03-13 10:08:21,633 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:08:21,643 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:08:21,644 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2463283610_lower_upper_7CE7EFE8013A4AD39F74615BC414DB0A	dst=null	perm=null
2015-03-13 10:08:21,645 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:08:21,645 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:08:21,647 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 14
2015-03-13 10:08:21,648 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014	dst=null	perm=null
2015-03-13 10:08:21,651 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014	dst=null	perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:08:21,652 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014	dst=null	perm=soberoi:supergroup:rwx------
2015-03-13 10:08:21,653 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.jar	dst=null	perm=null
2015-03-13 10:08:21,654 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:21,656 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073741986_1162{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:08:21,658 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741986_1162 src: /127.0.0.1:61919 dest: /127.0.0.1:60689
2015-03-13 10:08:21,659 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741986_1162 src: /127.0.0.1:61920 dest: /127.0.0.1:60696
2015-03-13 10:08:21,660 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741986_1162 src: /127.0.0.1:61921 dest: /127.0.0.1:60693
2015-03-13 10:08:21,665 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61921, dest: /127.0.0.1:60693, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741986_1162, duration: 2652000
2015-03-13 10:08:21,665 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741986_1162, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:21,665 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741986_1162{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:21,666 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61920, dest: /127.0.0.1:60696, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741986_1162, duration: 2666000
2015-03-13 10:08:21,666 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741986_1162, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:21,666 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741986_1162{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:21,666 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61919, dest: /127.0.0.1:60689, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741986_1162, duration: 4181000
2015-03-13 10:08:21,667 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741986_1162, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:21,668 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741986_1162{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:21,669 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:08:21,670 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.jar
2015-03-13 10:08:21,671 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.jar	dst=null	perm=null
2015-03-13 10:08:21,672 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:21,673 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:08:21,673 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:08:21,674 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:08:21,675 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:08:21,675 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:08:21,676 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:08:21,676 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:08:21,677 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:08:21,677 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:08:21,678 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:08:21,679 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:08:21,679 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:08:21,681 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:21,682 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:21,683 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.split
2015-03-13 10:08:21,683 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.split	dst=null	perm=null
2015-03-13 10:08:21,684 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073741987_1163{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:08:21,685 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741987_1163 src: /127.0.0.1:61922 dest: /127.0.0.1:60689
2015-03-13 10:08:21,686 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741987_1163 src: /127.0.0.1:61923 dest: /127.0.0.1:60696
2015-03-13 10:08:21,687 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741987_1163 src: /127.0.0.1:61924 dest: /127.0.0.1:60686
2015-03-13 10:08:21,688 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741987_1163 src: /127.0.0.1:61925 dest: /127.0.0.1:60693
2015-03-13 10:08:21,691 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61925, dest: /127.0.0.1:60693, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741987_1163, duration: 1658000
2015-03-13 10:08:21,691 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741987_1163, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:21,692 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741987_1163{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:21,692 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61924, dest: /127.0.0.1:60686, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741987_1163, duration: 2053000
2015-03-13 10:08:21,692 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741987_1163, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:21,692 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741987_1163{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:21,693 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61923, dest: /127.0.0.1:60696, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741987_1163, duration: 2787000
2015-03-13 10:08:21,693 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741987_1163, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:21,693 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741987_1163{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:21,693 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61922, dest: /127.0.0.1:60689, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741987_1163, duration: 3717000
2015-03-13 10:08:21,694 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741987_1163, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:21,694 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741987_1163{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:21,696 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:08:21,697 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:21,699 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:21,700 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073741988_1164{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:08:21,702 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741988_1164 src: /127.0.0.1:61926 dest: /127.0.0.1:60689
2015-03-13 10:08:21,703 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741988_1164 src: /127.0.0.1:61927 dest: /127.0.0.1:60696
2015-03-13 10:08:21,705 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741988_1164 src: /127.0.0.1:61928 dest: /127.0.0.1:60693
2015-03-13 10:08:21,708 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61928, dest: /127.0.0.1:60693, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741988_1164, duration: 1252000
2015-03-13 10:08:21,708 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741988_1164, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:21,708 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741988_1164{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:21,708 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61927, dest: /127.0.0.1:60696, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741988_1164, duration: 1685000
2015-03-13 10:08:21,709 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741988_1164, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:21,709 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741988_1164{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:21,709 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61926, dest: /127.0.0.1:60689, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741988_1164, duration: 2506000
2015-03-13 10:08:21,709 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741988_1164, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:21,711 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741988_1164{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:21,712 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:08:21,712 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:08:21,713 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:21,715 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:21,716 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:08:21,716 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:08:21,717 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:08:21,721 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073741989_1165{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:08:21,722 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741989_1165 src: /127.0.0.1:61929 dest: /127.0.0.1:60696
2015-03-13 10:08:21,724 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741989_1165 src: /127.0.0.1:61930 dest: /127.0.0.1:60689
2015-03-13 10:08:21,725 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741989_1165 src: /127.0.0.1:61931 dest: /127.0.0.1:60693
2015-03-13 10:08:21,727 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61931, dest: /127.0.0.1:60693, bytes: 98697, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741989_1165, duration: 1474000
2015-03-13 10:08:21,727 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741989_1165, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:21,728 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741989_1165{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:21,728 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61930, dest: /127.0.0.1:60689, bytes: 98697, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741989_1165, duration: 2004000
2015-03-13 10:08:21,728 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741989_1165, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:21,728 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741989_1165{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:21,729 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61929, dest: /127.0.0.1:60696, bytes: 98697, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741989_1165, duration: 2797000
2015-03-13 10:08:21,729 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741989_1165, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:21,730 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741989_1165{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:21,731 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:08:21,731 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0014
2015-03-13 10:08:21,732 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014	dst=null	perm=null
2015-03-13 10:08:21,732 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.xml	dst=null	perm=null
2015-03-13 10:08:21,733 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.xml	dst=null	perm=null
2015-03-13 10:08:21,733 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.jar	dst=null	perm=null
2015-03-13 10:08:21,734 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.jar	dst=null	perm=null
2015-03-13 10:08:21,734 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.split	dst=null	perm=null
2015-03-13 10:08:21,735 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.split	dst=null	perm=null
2015-03-13 10:08:21,735 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:08:21,735 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:08:21,737 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:08:21,737 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:08:21,738 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:08:21,738 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:08:21,739 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:08:21,739 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:08:21,740 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 14 submitted by user soberoi
2015-03-13 10:08:21,740 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0014
2015-03-13 10:08:21,741 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	IP=10.1.1.144	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1426266260362_0014
2015-03-13 10:08:21,741 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0014
2015-03-13 10:08:21,741 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0014 State change from NEW to NEW_SAVING
2015-03-13 10:08:21,741 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0014 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:08:21,741 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0014_000001
2015-03-13 10:08:21,741 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0014_000001 State change from NEW to SUBMITTED
2015-03-13 10:08:21,742 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0014 from user: soberoi activated in queue: default
2015-03-13 10:08:21,742 INFO  capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0014 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:08:21,742 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0014 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:08:21,742 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0014_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:08:21,742 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0014 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:08:21,742 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0014_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:08:21,742 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0014 State change from SUBMITTED to ACCEPTED
2015-03-13 10:08:21,744 INFO  mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0014/
2015-03-13 10:08:21,744 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper*joined] submitted hadoop job: job_1426266260362_0014
2015-03-13 10:08:21,744 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper*joined] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0014/
2015-03-13 10:08:21,835 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60693 to replicate blk_1073741986_1162 to datanode(s) 127.0.0.1:60686
2015-03-13 10:08:21,835 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073741972_1148, blk_1073741973_1149, blk_1073741974_1150, blk_1073741975_1151, blk_1073741976_1152, blk_1073741979_1155]
2015-03-13 10:08:21,835 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073741972_1148, blk_1073741973_1149, blk_1073741974_1150, blk_1073741975_1151, blk_1073741979_1155]
2015-03-13 10:08:22,115 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741987_1163
2015-03-13 10:08:22,116 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741977_1153
2015-03-13 10:08:22,116 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741978_1154
2015-03-13 10:08:22,117 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741980_1156
2015-03-13 10:08:22,117 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741986_1162
2015-03-13 10:08:22,117 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741983_1159
2015-03-13 10:08:22,118 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741984_1160
2015-03-13 10:08:22,118 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741981_1157
2015-03-13 10:08:22,119 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741982_1158
2015-03-13 10:08:22,119 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741988_1164
2015-03-13 10:08:22,120 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741989_1165
2015-03-13 10:08:22,298 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:22,298 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0014_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:08:22,299 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0014	CONTAINERID=container_1426266260362_0014_01_000001
2015-03-13 10:08:22,299 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0014_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:4096, vCores:2> used and <memory:0, vCores:6> available
2015-03-13 10:08:22,299 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0014 container=Container: [ContainerId: container_1426266260362_0014_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0014_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:22,299 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:08:22,299 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0014_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:08:22,299 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:22,300 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0014 AttemptId: appattempt_1426266260362_0014_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0014_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ]
2015-03-13 10:08:22,300 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0014_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:08:22,300 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0014_000001
2015-03-13 10:08:22,300 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0014_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:08:22,301 INFO  amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0014_000001
2015-03-13 10:08:22,301 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0014_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] for AM appattempt_1426266260362_0014_000001
2015-03-13 10:08:22,301 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0014_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-03-13 10:08:22,303 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0014_000001 (auth:SIMPLE)
2015-03-13 10:08:22,304 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0014_01_000001 by user soberoi
2015-03-13 10:08:22,304 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0014
2015-03-13 10:08:22,304 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0014	CONTAINERID=container_1426266260362_0014_01_000001
2015-03-13 10:08:22,305 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0014 transitioned from NEW to INITING
2015-03-13 10:08:22,305 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0014_01_000001 to application application_1426266260362_0014
2015-03-13 10:08:22,305 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0014 transitioned from INITING to RUNNING
2015-03-13 10:08:22,305 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0014_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] for AM appattempt_1426266260362_0014_000001
2015-03-13 10:08:22,305 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0014_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:08:22,305 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:08:22,305 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0014
2015-03-13 10:08:22,305 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:08:22,305 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:08:22,306 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:08:22,306 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:08:22,306 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0014_01_000001
2015-03-13 10:08:22,315 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0014_01_000001.tokens. Credentials list: 
2015-03-13 10:08:22,318 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741984_1160
2015-03-13 10:08:22,318 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741985_1161
2015-03-13 10:08:22,319 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741981_1157
2015-03-13 10:08:22,319 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741982_1158
2015-03-13 10:08:22,320 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741983_1159
2015-03-13 10:08:22,320 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741977_1153
2015-03-13 10:08:22,320 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741987_1163
2015-03-13 10:08:22,320 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741988_1164
2015-03-13 10:08:22,321 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741979_1155
2015-03-13 10:08:22,323 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741986_1162
2015-03-13 10:08:22,342 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:08:22,421 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0014_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000001.tokens
2015-03-13 10:08:22,422 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0014 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0014
2015-03-13 10:08:22,477 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741985_1161
2015-03-13 10:08:22,478 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741980_1156
2015-03-13 10:08:22,478 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741981_1157
2015-03-13 10:08:22,478 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741978_1154
2015-03-13 10:08:22,479 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741987_1163
2015-03-13 10:08:22,479 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741979_1155
2015-03-13 10:08:22,488 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.jar	dst=null	perm=null
2015-03-13 10:08:22,489 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.jar	dst=null	perm=null
2015-03-13 10:08:22,489 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.jar	dst=null	perm=null
2015-03-13 10:08:22,495 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61911, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-809864123_7591, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741986_1162, duration: 507000
2015-03-13 10:08:22,514 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:08:22,518 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741989_1165
2015-03-13 10:08:22,532 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:08:22,533 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:08:22,534 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:08:22,540 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61912, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-809864123_7591, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741988_1164, duration: 134000
2015-03-13 10:08:22,554 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:08:22,571 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.split	dst=null	perm=null
2015-03-13 10:08:22,572 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.split	dst=null	perm=null
2015-03-13 10:08:22,573 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.split	dst=null	perm=null
2015-03-13 10:08:22,580 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61935, bytes: 1798, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-809864123_7591, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741987_1163, duration: 169000
2015-03-13 10:08:22,595 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:08:22,616 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.xml	dst=null	perm=null
2015-03-13 10:08:22,617 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.xml	dst=null	perm=null
2015-03-13 10:08:22,618 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.xml	dst=null	perm=null
2015-03-13 10:08:22,625 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61936, bytes: 99469, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-809864123_7591, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741989_1165, duration: 319000
2015-03-13 10:08:22,631 INFO  datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-1589780806-10.1.1.144-60693-1426266259390, infoPort=60694, ipcPort=60695, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073741986_1162 to 127.0.0.1:60686 
2015-03-13 10:08:22,631 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741972_1148 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741972 for deletion
2015-03-13 10:08:22,631 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741973_1149 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741973 for deletion
2015-03-13 10:08:22,632 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741974_1150 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741974 for deletion
2015-03-13 10:08:22,632 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741975_1151 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741975 for deletion
2015-03-13 10:08:22,633 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741976_1152 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741976 for deletion
2015-03-13 10:08:22,632 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741973_1149 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741973
2015-03-13 10:08:22,633 INFO  datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073741986_1162 (numBytes=254067) to /127.0.0.1:60686
2015-03-13 10:08:22,632 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741972_1148 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741972
2015-03-13 10:08:22,633 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741986_1162 src: /127.0.0.1:61937 dest: /127.0.0.1:60686
2015-03-13 10:08:22,634 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741974_1150 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741974
2015-03-13 10:08:22,633 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741975_1151 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741975
2015-03-13 10:08:22,633 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741979_1155 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741979 for deletion
2015-03-13 10:08:22,634 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741976_1152 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741976
2015-03-13 10:08:22,634 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741979_1155 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741979
2015-03-13 10:08:22,635 INFO  datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073741986_1162 src: /127.0.0.1:61937 dest: /127.0.0.1:60686 of size 254067
2015-03-13 10:08:22,636 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741986_1162 size 254067
2015-03-13 10:08:22,642 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:08:22,643 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:08:22,672 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:08:22,672 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:22,739 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000001/default_container_executor.sh]
2015-03-13 10:08:22,826 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741972_1148 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741972 for deletion
2015-03-13 10:08:22,826 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741973_1149 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741973 for deletion
2015-03-13 10:08:22,827 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741974_1150 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741974 for deletion
2015-03-13 10:08:22,827 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741975_1151 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741975 for deletion
2015-03-13 10:08:22,827 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741979_1155 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741979 for deletion
2015-03-13 10:08:22,827 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741972_1148 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741972
2015-03-13 10:08:22,827 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741973_1149 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741973
2015-03-13 10:08:22,827 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741974_1150 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741974
2015-03-13 10:08:22,827 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741975_1151 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741975
2015-03-13 10:08:22,828 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741979_1155 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741979
2015-03-13 10:08:22,873 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741986_1162
2015-03-13 10:08:22,874 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741983_1159
2015-03-13 10:08:22,874 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741977_1153
2015-03-13 10:08:22,874 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741988_1164
2015-03-13 10:08:22,875 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741984_1160
2015-03-13 10:08:23,073 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741989_1165
2015-03-13 10:08:23,073 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741982_1158
2015-03-13 10:08:23,074 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741978_1154
2015-03-13 10:08:23,074 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741980_1156
2015-03-13 10:08:23,074 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741987_1163
2015-03-13 10:08:23,074 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741985_1161
2015-03-13 10:08:23,299 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:23,299 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:23,299 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0014_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:08:24,255 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:08:24,277 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/COMMIT_STARTED	dst=null	perm=null
2015-03-13 10:08:24,278 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/COMMIT_SUCCESS	dst=null	perm=null
2015-03-13 10:08:24,279 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/COMMIT_FAIL	dst=null	perm=null
2015-03-13 10:08:24,299 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:24,300 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:24,334 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014	dst=null	perm=null
2015-03-13 10:08:24,336 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:08:24,337 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:08:24,626 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:08:24,633 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:08:24,686 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61939, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1408382736_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741988_1164, duration: 121000
2015-03-13 10:08:24,837 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073741972_1148, blk_1073741973_1149, blk_1073741976_1152]
2015-03-13 10:08:24,837 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073741972_1148, blk_1073741973_1149, blk_1073741974_1150, blk_1073741975_1151, blk_1073741976_1152, blk_1073741979_1155]
2015-03-13 10:08:25,304 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:25,304 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:25,463 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741972_1148 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741972 for deletion
2015-03-13 10:08:25,463 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741973_1149 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741973 for deletion
2015-03-13 10:08:25,463 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741974_1150 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741974 for deletion
2015-03-13 10:08:25,463 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741972_1148 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741972
2015-03-13 10:08:25,463 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741975_1151 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741975 for deletion
2015-03-13 10:08:25,463 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741976_1152 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741976 for deletion
2015-03-13 10:08:25,463 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741974_1150 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741974
2015-03-13 10:08:25,464 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741972_1148 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741972 for deletion
2015-03-13 10:08:25,463 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741973_1149 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741973
2015-03-13 10:08:25,464 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741973_1149 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741973 for deletion
2015-03-13 10:08:25,464 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741976_1152 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741976
2015-03-13 10:08:25,464 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741972_1148 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741972
2015-03-13 10:08:25,464 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741976_1152 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741976 for deletion
2015-03-13 10:08:25,464 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741973_1149 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741973
2015-03-13 10:08:25,464 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741979_1155 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741979 for deletion
2015-03-13 10:08:25,464 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741975_1151 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741975
2015-03-13 10:08:25,464 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741976_1152 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741976
2015-03-13 10:08:25,464 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741979_1155 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741979
2015-03-13 10:08:25,505 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0014_000001 (auth:SIMPLE)
2015-03-13 10:08:25,507 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0014_000001
2015-03-13 10:08:25,507 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi	IP=10.1.1.144	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1426266260362_0014	APPATTEMPTID=appattempt_1426266260362_0014_000001
2015-03-13 10:08:25,507 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0014_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:08:25,507 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0014 State change from ACCEPTED to RUNNING
2015-03-13 10:08:25,529 INFO  namenode.FSEditLog (FSEditLog.java:printStatistics(663)) - Number of transactions: 1389 Total time for transactions(ms): 61 Number of transactions batched in Syncs: 2 Number of syncs: 787 SyncTimes(ms): 239 191 
2015-03-13 10:08:25,531 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job_1426266260362_0014_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:25,533 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-soberoi/2463283610_lower_upper_7CE7EFE8013A4AD39F74615BC414DB0A/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:08:25,592 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job_1426266260362_0014_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:25,729 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job_1426266260362_0014_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073741990_1166{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:08:25,768 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741990_1166 src: /127.0.0.1:61945 dest: /127.0.0.1:60686
2015-03-13 10:08:25,770 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741990_1166 src: /127.0.0.1:61946 dest: /127.0.0.1:60696
2015-03-13 10:08:25,771 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741990_1166 src: /127.0.0.1:61947 dest: /127.0.0.1:60693
2015-03-13 10:08:25,779 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61947, dest: /127.0.0.1:60693, bytes: 91420, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1408382736_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741990_1166, duration: 5918000
2015-03-13 10:08:25,779 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741990_1166, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:25,780 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741990_1166{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:25,780 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61946, dest: /127.0.0.1:60696, bytes: 91420, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1408382736_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741990_1166, duration: 6981000
2015-03-13 10:08:25,780 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741990_1166, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:25,780 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61945, dest: /127.0.0.1:60686, bytes: 91420, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1408382736_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741990_1166, duration: 7814000
2015-03-13 10:08:25,780 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741990_1166{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:25,781 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741990_1166, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:25,781 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741990_1166{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:25,785 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job_1426266260362_0014_1_conf.xml is closed by DFSClient_NONMAPREDUCE_1408382736_1
2015-03-13 10:08:26,307 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:26,307 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:26,622 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0013_01_000001 succeeded 
2015-03-13 10:08:26,622 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:08:26,622 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0013_01_000001
2015-03-13 10:08:26,629 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000001
2015-03-13 10:08:26,630 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0013	CONTAINERID=container_1426266260362_0013_01_000001
2015-03-13 10:08:26,630 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:08:26,630 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0013_01_000001 from application application_1426266260362_0013
2015-03-13 10:08:26,630 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:26,630 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0013
2015-03-13 10:08:26,630 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000001
2015-03-13 10:08:26,629 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000001
2015-03-13 10:08:26,630 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000001
2015-03-13 10:08:27,313 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:08:27,313 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0013_01_000001
2015-03-13 10:08:27,313 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:27,314 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0013_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:08:27,314 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0013_000001
2015-03-13 10:08:27,314 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0013_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:08:27,314 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0013_000001 State change from FINISHING to FINISHED
2015-03-13 10:08:27,314 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0013	CONTAINERID=container_1426266260362_0013_01_000001
2015-03-13 10:08:27,315 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0013_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:08:27,315 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0013 State change from FINISHING to FINISHED
2015-03-13 10:08:27,315 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:08:27,315 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1426266260362_0013
2015-03-13 10:08:27,315 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0013,name=[66292338870B4E96BCA2C279F2316D18/1DA395B3D9054135BCD4DF3C5499AF7E] lower*upper/(1/1) ...dpipesplatform/joinhasher,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0013/jobhistory/job/job_1426266260362_0013,appMasterHost=Edinburgh.local,startTime=1426266483799,finishTime=1426266500474,finalStatus=SUCCEEDED
2015-03-13 10:08:27,315 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0013_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:27,315 INFO  amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0013_000001
2015-03-13 10:08:27,316 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:27,316 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1
2015-03-13 10:08:27,316 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0013_000001 released container container_1426266260362_0013_01_000001 on node: host: 10.1.1.144:60715 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:08:27,317 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0014_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:08:27,317 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0014	CONTAINERID=container_1426266260362_0014_01_000002
2015-03-13 10:08:27,317 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0014_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:08:27,317 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0014 container=Container: [ContainerId: container_1426266260362_0014_01_000002, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0014_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:27,317 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=2, numContainers=2
2015-03-13 10:08:27,318 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:27,318 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0014_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:08:27,318 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0014	CONTAINERID=container_1426266260362_0014_01_000003
2015-03-13 10:08:27,318 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0014_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available
2015-03-13 10:08:27,318 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0014 container=Container: [ContainerId: container_1426266260362_0014_01_000003, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0014_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=2, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:27,319 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=3
2015-03-13 10:08:27,319 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:27,319 INFO  capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0013_000001 is done. finalState=FINISHED
2015-03-13 10:08:27,319 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0013 requests cleared
2015-03-13 10:08:27,319 INFO  capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0013 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:08:27,319 INFO  capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0013 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:08:27,319 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0013_000001 (auth:SIMPLE)
2015-03-13 10:08:27,320 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0013_01_000001
2015-03-13 10:08:27,329 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0013 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:08:27,329 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0014_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:08:27,329 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0014	CONTAINERID=container_1426266260362_0014_01_000004
2015-03-13 10:08:27,329 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0014_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:08:27,330 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0014 container=Container: [ContainerId: container_1426266260362_0014_01_000004, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0014_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:27,330 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0013
2015-03-13 10:08:27,330 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:08:27,330 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:27,329 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0013
2015-03-13 10:08:27,330 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0014_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:08:27,330 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0014	CONTAINERID=container_1426266260362_0014_01_000005
2015-03-13 10:08:27,330 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0014_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:08:27,331 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0014 container=Container: [ContainerId: container_1426266260362_0014_01_000005, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0014_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:27,331 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:08:27,330 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0013
2015-03-13 10:08:27,329 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0013
2015-03-13 10:08:27,329 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0013
2015-03-13 10:08:27,331 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:27,331 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0013 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:08:27,331 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0013, with delay of 10800 seconds
2015-03-13 10:08:27,331 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0014_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:08:27,332 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0014	CONTAINERID=container_1426266260362_0014_01_000006
2015-03-13 10:08:27,332 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0014_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:08:27,332 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0014 container=Container: [ContainerId: container_1426266260362_0014_01_000006, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0014_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:27,332 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=1, numContainers=6
2015-03-13 10:08:27,332 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:27,488 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741990_1166
2015-03-13 10:08:27,526 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741990_1166
2015-03-13 10:08:27,538 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0014_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:08:27,539 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0014_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:08:27,539 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0014_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:08:27,539 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0014_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:08:27,539 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0014_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:08:27,564 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.jar	dst=null	perm=null
2015-03-13 10:08:27,565 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.jar	dst=null	perm=null
2015-03-13 10:08:27,574 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.xml	dst=null	perm=null
2015-03-13 10:08:27,575 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.xml	dst=null	perm=null
2015-03-13 10:08:27,576 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:08:27,578 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:08:27,582 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:08:27,584 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:08:27,585 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:08:27,586 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:08:27,661 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0014_000001 (auth:SIMPLE)
2015-03-13 10:08:27,661 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0014_000001 (auth:SIMPLE)
2015-03-13 10:08:27,664 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0014_01_000006 by user soberoi
2015-03-13 10:08:27,665 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0014
2015-03-13 10:08:27,665 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0014	CONTAINERID=container_1426266260362_0014_01_000006
2015-03-13 10:08:27,665 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0014 transitioned from NEW to INITING
2015-03-13 10:08:27,665 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0014_01_000006 to application application_1426266260362_0014
2015-03-13 10:08:27,665 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0014_01_000005 by user soberoi
2015-03-13 10:08:27,665 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0014 transitioned from INITING to RUNNING
2015-03-13 10:08:27,665 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0014	CONTAINERID=container_1426266260362_0014_01_000005
2015-03-13 10:08:27,666 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:08:27,666 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0014_01_000005 to application application_1426266260362_0014
2015-03-13 10:08:27,666 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0014_01_000004 by user soberoi
2015-03-13 10:08:27,666 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0014	CONTAINERID=container_1426266260362_0014_01_000004
2015-03-13 10:08:27,666 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0014_01_000003 by user soberoi
2015-03-13 10:08:27,666 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0014_01_000002 by user soberoi
2015-03-13 10:08:27,666 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0014	CONTAINERID=container_1426266260362_0014_01_000003
2015-03-13 10:08:27,666 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0014	CONTAINERID=container_1426266260362_0014_01_000002
2015-03-13 10:08:27,666 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0014
2015-03-13 10:08:27,667 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0014
2015-03-13 10:08:27,667 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:08:27,667 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0014
2015-03-13 10:08:27,667 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:08:27,667 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:08:27,667 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:08:27,667 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0014_01_000004 to application application_1426266260362_0014
2015-03-13 10:08:27,668 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0014_01_000006
2015-03-13 10:08:27,667 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0014_01_000003 to application application_1426266260362_0014
2015-03-13 10:08:27,668 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0014_01_000002 to application application_1426266260362_0014
2015-03-13 10:08:27,668 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0014
2015-03-13 10:08:27,668 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:08:27,668 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0014
2015-03-13 10:08:27,668 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:08:27,668 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:08:27,668 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0014
2015-03-13 10:08:27,668 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0014
2015-03-13 10:08:27,669 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:08:27,669 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0014
2015-03-13 10:08:27,669 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0014
2015-03-13 10:08:27,669 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0014
2015-03-13 10:08:27,669 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:08:27,669 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0014
2015-03-13 10:08:27,669 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:08:27,670 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:08:27,668 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0014
2015-03-13 10:08:27,670 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:08:27,670 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0014_01_000005
2015-03-13 10:08:27,671 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0014
2015-03-13 10:08:27,685 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0014
2015-03-13 10:08:27,685 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:08:27,685 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0014
2015-03-13 10:08:27,685 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0014_01_000004
2015-03-13 10:08:27,695 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741986_1162
2015-03-13 10:08:27,697 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426266260362_0014_01_000006.tokens. Credentials list: 
2015-03-13 10:08:27,706 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426266260362_0014_01_000004.tokens. Credentials list: 
2015-03-13 10:08:27,707 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426266260362_0014_01_000005.tokens. Credentials list: 
2015-03-13 10:08:27,722 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:08:27,722 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:08:27,722 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:27,723 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:08:27,723 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:27,807 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000003/default_container_executor.sh]
2015-03-13 10:08:27,807 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000002/default_container_executor.sh]
2015-03-13 10:08:27,814 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426266260362_0014_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000006.tokens
2015-03-13 10:08:27,814 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0014 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0014
2015-03-13 10:08:27,897 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.jar	dst=null	perm=null
2015-03-13 10:08:27,898 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.jar	dst=null	perm=null
2015-03-13 10:08:27,899 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.jar	dst=null	perm=null
2015-03-13 10:08:27,908 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61953, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_915454621_7745, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741986_1162, duration: 467000
2015-03-13 10:08:27,932 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:08:27,955 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.xml	dst=null	perm=null
2015-03-13 10:08:27,956 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.xml	dst=null	perm=null
2015-03-13 10:08:27,957 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.xml	dst=null	perm=null
2015-03-13 10:08:27,965 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61954, bytes: 99469, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_915454621_7745, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741989_1165, duration: 265000
2015-03-13 10:08:27,980 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:08:27,980 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:08:27,980 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:08:27,980 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:08:28,027 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:08:28,027 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:08:28,027 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:28,027 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:08:28,027 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:28,027 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:28,078 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741990_1166
2015-03-13 10:08:28,176 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000004/default_container_executor.sh]
2015-03-13 10:08:28,176 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000006/default_container_executor.sh]
2015-03-13 10:08:28,176 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000005/default_container_executor.sh]
2015-03-13 10:08:28,314 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:28,314 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:28,314 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:28,315 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0013 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:08:28,316 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0013
2015-03-13 10:08:28,316 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0013 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:08:28,316 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0013, with delay of 10800 seconds
2015-03-13 10:08:28,316 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0013
2015-03-13 10:08:28,315 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0014_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:08:28,317 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0014_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:08:28,317 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0013
2015-03-13 10:08:28,317 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0013
2015-03-13 10:08:28,316 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0013
2015-03-13 10:08:28,331 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:28,331 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:28,331 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:28,332 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0014_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:08:28,332 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0014_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:08:28,332 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0014_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:08:28,553 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:08:29,008 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:08:29,122 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426266260362_0014_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000005.tokens
2015-03-13 10:08:29,122 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0014 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0014
2015-03-13 10:08:29,225 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:08:29,319 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:29,319 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:29,319 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:29,332 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:29,333 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:29,333 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:29,367 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426266260362_0014_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000004.tokens
2015-03-13 10:08:29,367 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0014 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0014
2015-03-13 10:08:30,323 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:30,323 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:30,323 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:30,334 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:30,334 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:30,334 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:31,329 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:31,329 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:31,329 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:31,340 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:31,340 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:31,340 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:32,332 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:32,332 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:32,333 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:32,344 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:32,344 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:32,344 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:33,336 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:33,337 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:33,337 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:33,348 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:33,348 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:33,348 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:34,340 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:34,341 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:34,341 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:34,352 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:34,352 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:34,352 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:35,344 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:35,345 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:35,345 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:35,355 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:35,355 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:35,355 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:35,917 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.split	dst=null	perm=null
2015-03-13 10:08:35,923 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.split	dst=null	perm=null
2015-03-13 10:08:35,977 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.split	dst=null	perm=null
2015-03-13 10:08:36,010 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.split	dst=null	perm=null
2015-03-13 10:08:36,010 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.split	dst=null	perm=null
2015-03-13 10:08:36,107 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61969, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0014_m_000001_0_2017851300_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741987_1163, duration: 154000
2015-03-13 10:08:36,109 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61968, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0014_m_000000_0_-1089971764_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741987_1163, duration: 151000
2015-03-13 10:08:36,151 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61971, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0014_m_000004_0_-254394080_1, offset: 1024, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741987_1163, duration: 182000
2015-03-13 10:08:36,154 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61970, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0014_m_000003_0_86517827_1, offset: 1024, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741987_1163, duration: 144000
2015-03-13 10:08:36,193 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61972, bytes: 1282, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0014_m_000002_0_-934800613_1, offset: 512, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741987_1163, duration: 154000
2015-03-13 10:08:36,233 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:08:36,245 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:08:36,253 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61973, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0014_m_000001_0_2017851300_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 203000
2015-03-13 10:08:36,277 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:08:36,281 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61970, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0014_m_000003_0_86517827_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 177000
2015-03-13 10:08:36,289 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:08:36,293 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61971, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0014_m_000004_0_-254394080_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 146000
2015-03-13 10:08:36,303 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:08:36,313 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61974, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0014_m_000002_0_-934800613_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 164000
2015-03-13 10:08:36,348 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:36,348 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:36,349 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:36,357 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:36,357 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:36,358 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:36,751 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:08:36,768 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:08:36,772 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:08:36,780 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61975, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0014_m_000000_0_-1089971764_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 174000
2015-03-13 10:08:36,785 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61975, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0014_m_000000_0_-1089971764_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 173000
2015-03-13 10:08:36,801 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:08:36,824 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:08:36,827 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:08:36,831 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2463283610_lower_upper_7CE7EFE8013A4AD39F74615BC414DB0A/_temporary/1/_temporary/attempt_1426266260362_0014_m_000000_0	dst=null	perm=null
2015-03-13 10:08:36,832 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61976, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0014_m_000001_0_2017851300_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 144000
2015-03-13 10:08:36,845 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:08:36,852 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0014_01_000002
2015-03-13 10:08:36,852 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0014	CONTAINERID=container_1426266260362_0014_01_000002
2015-03-13 10:08:36,852 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:08:36,852 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0014_01_000002
2015-03-13 10:08:36,852 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:36,852 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:08:36,853 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:36,865 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0014_01_000002 is : 143
2015-03-13 10:08:36,867 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job_1426266260362_0014_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073741991_1167{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:08:36,868 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741991_1167 src: /127.0.0.1:61977 dest: /127.0.0.1:60686
2015-03-13 10:08:36,870 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741991_1167 src: /127.0.0.1:61978 dest: /127.0.0.1:60693
2015-03-13 10:08:36,871 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741991_1167 src: /127.0.0.1:61979 dest: /127.0.0.1:60689
2015-03-13 10:08:36,871 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2463283610_lower_upper_7CE7EFE8013A4AD39F74615BC414DB0A/_temporary/1/_temporary/attempt_1426266260362_0014_m_000001_0	dst=null	perm=null
2015-03-13 10:08:36,875 INFO  hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job_1426266260362_0014_1.jhist for DFSClient_NONMAPREDUCE_1408382736_1
2015-03-13 10:08:36,877 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:08:36,878 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000002
2015-03-13 10:08:36,878 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000002
2015-03-13 10:08:36,878 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0014	CONTAINERID=container_1426266260362_0014_01_000002
2015-03-13 10:08:36,878 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:08:36,878 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0014_01_000002 from application application_1426266260362_0014
2015-03-13 10:08:36,878 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:36,878 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0014
2015-03-13 10:08:36,879 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000002
2015-03-13 10:08:36,878 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000002
2015-03-13 10:08:36,884 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0014_01_000003
2015-03-13 10:08:36,884 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0014	CONTAINERID=container_1426266260362_0014_01_000003
2015-03-13 10:08:36,884 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:08:36,884 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0014_01_000003
2015-03-13 10:08:36,884 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:36,884 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:08:36,884 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0014_01_000002
2015-03-13 10:08:36,885 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:08:36,885 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0014_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:08:36,885 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0014_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:08:36,885 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0014	CONTAINERID=container_1426266260362_0014_01_000002
2015-03-13 10:08:36,885 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0014_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available, release resources=true
2015-03-13 10:08:36,885 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:08:36,886 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0014_01_000002, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:36,886 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:36,886 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:08:36,886 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0014_000001 released container container_1426266260362_0014_01_000002 on node: host: 10.1.1.144:60715 #containers=2 available=1024 used=3072 with event: FINISHED
2015-03-13 10:08:36,894 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:08:36,896 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:08:36,897 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0014_01_000003 is : 143
2015-03-13 10:08:36,899 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:08:36,904 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61980, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0014_m_000004_0_-254394080_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 145000
2015-03-13 10:08:36,909 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:08:36,909 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:08:36,909 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000003
2015-03-13 10:08:36,909 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000003
2015-03-13 10:08:36,910 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000003
2015-03-13 10:08:36,910 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000003
2015-03-13 10:08:36,910 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0014	CONTAINERID=container_1426266260362_0014_01_000003
2015-03-13 10:08:36,910 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:08:36,910 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0014_01_000003 from application application_1426266260362_0014
2015-03-13 10:08:36,910 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:36,911 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0014
2015-03-13 10:08:36,914 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:08:36,918 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:08:36,923 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61981, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0014_m_000003_0_86517827_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 165000
2015-03-13 10:08:36,926 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:08:36,929 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:08:36,931 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2463283610_lower_upper_7CE7EFE8013A4AD39F74615BC414DB0A/_temporary/1/_temporary/attempt_1426266260362_0014_m_000004_0	dst=null	perm=null
2015-03-13 10:08:36,935 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61982, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0014_m_000002_0_-934800613_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 174000
2015-03-13 10:08:36,941 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0014_01_000006
2015-03-13 10:08:36,941 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0014	CONTAINERID=container_1426266260362_0014_01_000006
2015-03-13 10:08:36,941 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:08:36,941 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0014_01_000006
2015-03-13 10:08:36,941 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:36,942 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:36,942 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:08:36,953 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0014_01_000006 is : 143
2015-03-13 10:08:36,953 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2463283610_lower_upper_7CE7EFE8013A4AD39F74615BC414DB0A/_temporary/1/_temporary/attempt_1426266260362_0014_m_000003_0	dst=null	perm=null
2015-03-13 10:08:36,964 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0014_01_000005
2015-03-13 10:08:36,964 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0014	CONTAINERID=container_1426266260362_0014_01_000005
2015-03-13 10:08:36,964 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:36,965 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:36,965 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: -1000
2015-03-13 10:08:36,966 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:08:36,966 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:08:36,966 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000006
2015-03-13 10:08:36,967 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0014_01_000005
2015-03-13 10:08:36,967 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000006
2015-03-13 10:08:36,967 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000006
2015-03-13 10:08:36,967 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000006
2015-03-13 10:08:36,977 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0014_01_000005 is : 143
2015-03-13 10:08:36,984 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2463283610_lower_upper_7CE7EFE8013A4AD39F74615BC414DB0A/_temporary/1/_temporary/attempt_1426266260362_0014_m_000002_0	dst=null	perm=null
2015-03-13 10:08:36,986 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0014	CONTAINERID=container_1426266260362_0014_01_000006
2015-03-13 10:08:36,986 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:08:36,986 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:08:36,986 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0014_01_000006 from application application_1426266260362_0014
2015-03-13 10:08:36,986 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:36,986 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0014
2015-03-13 10:08:36,986 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000005
2015-03-13 10:08:36,987 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000005
2015-03-13 10:08:36,987 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0014	CONTAINERID=container_1426266260362_0014_01_000005
2015-03-13 10:08:36,987 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:08:36,987 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0014_01_000005 from application application_1426266260362_0014
2015-03-13 10:08:36,987 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000005
2015-03-13 10:08:36,987 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000005
2015-03-13 10:08:36,987 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:36,988 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0014
2015-03-13 10:08:36,995 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0014_01_000004
2015-03-13 10:08:36,995 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0014	CONTAINERID=container_1426266260362_0014_01_000004
2015-03-13 10:08:36,995 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:08:36,996 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0014_01_000004
2015-03-13 10:08:36,996 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:08:36,996 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:08:36,996 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0014_01_000005
2015-03-13 10:08:36,996 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:08:36,996 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0014_01_000006
2015-03-13 10:08:36,997 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0014_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:08:36,997 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0014_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:08:36,997 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0014	CONTAINERID=container_1426266260362_0014_01_000005
2015-03-13 10:08:36,997 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0014_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:08:36,997 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:08:36,997 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0014_01_000005, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:36,997 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:36,998 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:08:36,998 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0014_000001 released container container_1426266260362_0014_01_000005 on node: host: 10.1.1.144:60723 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:08:36,998 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0014_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:08:36,998 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0014_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:08:36,998 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0014	CONTAINERID=container_1426266260362_0014_01_000006
2015-03-13 10:08:36,998 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0014_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:08:36,998 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:08:36,998 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0014_01_000006, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:36,999 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:36,999 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:08:36,999 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0014_000001 released container container_1426266260362_0014_01_000006 on node: host: 10.1.1.144:60723 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:08:37,007 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0014_01_000004 is : 143
2015-03-13 10:08:37,018 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:08:37,018 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000004
2015-03-13 10:08:37,019 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000004
2015-03-13 10:08:37,019 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0014	CONTAINERID=container_1426266260362_0014_01_000004
2015-03-13 10:08:37,019 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:08:37,019 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0014_01_000004 from application application_1426266260362_0014
2015-03-13 10:08:37,019 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:37,019 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0014
2015-03-13 10:08:37,018 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000004
2015-03-13 10:08:37,019 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000004
2015-03-13 10:08:37,889 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:37,889 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:08:37,889 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0014_01_000003
2015-03-13 10:08:37,890 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0014_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:08:37,890 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0014_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:08:37,890 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0014	CONTAINERID=container_1426266260362_0014_01_000003
2015-03-13 10:08:37,890 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0014_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:08:37,890 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:08:37,891 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0014_01_000003, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:37,891 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:37,891 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:08:37,891 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0014_000001 released container container_1426266260362_0014_01_000003 on node: host: 10.1.1.144:60715 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:08:37,998 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:08:37,999 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0014_01_000004
2015-03-13 10:08:37,999 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0014_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:08:37,999 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0014_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:08:38,000 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0014	CONTAINERID=container_1426266260362_0014_01_000004
2015-03-13 10:08:38,000 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0014_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:08:38,000 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:08:38,000 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0014_01_000004, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:38,000 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:38,001 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:08:38,001 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0014_000001 released container container_1426266260362_0014_01_000004 on node: host: 10.1.1.144:60723 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:08:38,894 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:38,895 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0014_01_000007 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:08:38,895 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0014	CONTAINERID=container_1426266260362_0014_01_000007
2015-03-13 10:08:38,895 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0014_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:08:38,895 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0014 container=Container: [ContainerId: container_1426266260362_0014_01_000007, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0014_01_000007 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:38,896 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:08:38,896 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:39,599 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0014_01_000007 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:08:39,608 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0014_01_000007 by user soberoi
2015-03-13 10:08:39,608 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0014	CONTAINERID=container_1426266260362_0014_01_000007
2015-03-13 10:08:39,608 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0014_01_000007 to application application_1426266260362_0014
2015-03-13 10:08:39,609 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000007 transitioned from NEW to LOCALIZING
2015-03-13 10:08:39,609 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0014
2015-03-13 10:08:39,609 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0014
2015-03-13 10:08:39,609 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:08:39,609 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0014
2015-03-13 10:08:39,610 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000007 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:08:39,634 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000007 transitioned from LOCALIZED to RUNNING
2015-03-13 10:08:39,635 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:39,698 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000007/default_container_executor.sh]
2015-03-13 10:08:39,898 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:39,899 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:39,899 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0014_01_000007 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:08:40,606 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:08:40,904 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:40,904 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:41,908 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:41,908 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:41,975 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/2463283610_lower_upper_7CE7EFE8013A4AD39F74615BC414DB0A/_temporary/1/_temporary/attempt_1426266260362_0014_r_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:42,016 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/2463283610_lower_upper_7CE7EFE8013A4AD39F74615BC414DB0A/_temporary/1/_temporary/attempt_1426266260362_0014_r_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073741992_1168{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:08:42,070 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741992_1168 src: /127.0.0.1:61989 dest: /127.0.0.1:60686
2015-03-13 10:08:42,071 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741992_1168 src: /127.0.0.1:61990 dest: /127.0.0.1:60696
2015-03-13 10:08:42,072 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741992_1168 src: /127.0.0.1:61991 dest: /127.0.0.1:60693
2015-03-13 10:08:42,082 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61991, dest: /127.0.0.1:60693, bytes: 240, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0014_r_000000_0_1187936187_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741992_1168, duration: 8041000
2015-03-13 10:08:42,082 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741992_1168, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:42,082 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741992_1168{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:42,082 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61990, dest: /127.0.0.1:60696, bytes: 240, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0014_r_000000_0_1187936187_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741992_1168, duration: 8693000
2015-03-13 10:08:42,083 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741992_1168, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:42,083 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741992_1168{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:42,083 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61989, dest: /127.0.0.1:60686, bytes: 240, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0014_r_000000_0_1187936187_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741992_1168, duration: 9444000
2015-03-13 10:08:42,083 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741992_1168, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:42,083 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741992_1168{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:42,086 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/2463283610_lower_upper_7CE7EFE8013A4AD39F74615BC414DB0A/_temporary/1/_temporary/attempt_1426266260362_0014_r_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0014_r_000000_0_1187936187_1
2015-03-13 10:08:42,093 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2463283610_lower_upper_7CE7EFE8013A4AD39F74615BC414DB0A/_temporary/1/_temporary/attempt_1426266260362_0014_r_000000_0	dst=null	perm=null
2015-03-13 10:08:42,100 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2463283610_lower_upper_7CE7EFE8013A4AD39F74615BC414DB0A/_temporary/1/_temporary/attempt_1426266260362_0014_r_000000_0	dst=null	perm=null
2015-03-13 10:08:42,101 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2463283610_lower_upper_7CE7EFE8013A4AD39F74615BC414DB0A/_temporary/1/task_1426266260362_0014_r_000000	dst=null	perm=null
2015-03-13 10:08:42,103 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/2463283610_lower_upper_7CE7EFE8013A4AD39F74615BC414DB0A/_temporary/1/_temporary/attempt_1426266260362_0014_r_000000_0	dst=/tmp/hadoop-soberoi/2463283610_lower_upper_7CE7EFE8013A4AD39F74615BC414DB0A/_temporary/1/task_1426266260362_0014_r_000000	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:08:42,111 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0014_01_000007
2015-03-13 10:08:42,111 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0014	CONTAINERID=container_1426266260362_0014_01_000007
2015-03-13 10:08:42,111 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000007 transitioned from RUNNING to KILLING
2015-03-13 10:08:42,111 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0014_01_000007
2015-03-13 10:08:42,111 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:42,111 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:08:42,115 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:42,117 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_1408382736_1
2015-03-13 10:08:42,121 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0014_01_000007 is : 143
2015-03-13 10:08:42,121 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/2463283610_lower_upper_7CE7EFE8013A4AD39F74615BC414DB0A/_temporary/1	dst=null	perm=null
2015-03-13 10:08:42,126 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2463283610_lower_upper_7CE7EFE8013A4AD39F74615BC414DB0A	dst=null	perm=null
2015-03-13 10:08:42,127 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2463283610_lower_upper_7CE7EFE8013A4AD39F74615BC414DB0A	dst=null	perm=null
2015-03-13 10:08:42,128 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/2463283610_lower_upper_7CE7EFE8013A4AD39F74615BC414DB0A/_temporary/1/task_1426266260362_0014_r_000000	dst=null	perm=null
2015-03-13 10:08:42,129 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2463283610_lower_upper_7CE7EFE8013A4AD39F74615BC414DB0A/part-00000	dst=null	perm=null
2015-03-13 10:08:42,130 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000007 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:08:42,130 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000007
2015-03-13 10:08:42,130 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000007
2015-03-13 10:08:42,131 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0014	CONTAINERID=container_1426266260362_0014_01_000007
2015-03-13 10:08:42,131 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000007 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:08:42,131 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000007
2015-03-13 10:08:42,131 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000007
2015-03-13 10:08:42,131 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0014_01_000007 from application application_1426266260362_0014
2015-03-13 10:08:42,131 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:42,131 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0014
2015-03-13 10:08:42,132 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/2463283610_lower_upper_7CE7EFE8013A4AD39F74615BC414DB0A/_temporary/1/task_1426266260362_0014_r_000000/part-00000	dst=/tmp/hadoop-soberoi/2463283610_lower_upper_7CE7EFE8013A4AD39F74615BC414DB0A/part-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:42,136 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-soberoi/2463283610_lower_upper_7CE7EFE8013A4AD39F74615BC414DB0A/_temporary	dst=null	perm=null
2015-03-13 10:08:42,139 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/2463283610_lower_upper_7CE7EFE8013A4AD39F74615BC414DB0A/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:42,140 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/2463283610_lower_upper_7CE7EFE8013A4AD39F74615BC414DB0A/_SUCCESS is closed by DFSClient_NONMAPREDUCE_1408382736_1
2015-03-13 10:08:42,142 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:42,143 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_1408382736_1
2015-03-13 10:08:42,156 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61979, dest: /127.0.0.1:60689, bytes: 66911, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1408382736_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741991_1167, duration: 5283484000
2015-03-13 10:08:42,156 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741991_1167, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:42,157 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741991_1167{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:08:42,158 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61978, dest: /127.0.0.1:60693, bytes: 66911, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1408382736_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741991_1167, duration: 5284724000
2015-03-13 10:08:42,158 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741991_1167, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:42,159 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741991_1167{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:08:42,159 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61977, dest: /127.0.0.1:60686, bytes: 66911, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1408382736_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741991_1167, duration: 5286043000
2015-03-13 10:08:42,159 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741991_1167, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:42,159 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741991_1167{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:08:42,161 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job_1426266260362_0014_1.jhist is closed by DFSClient_NONMAPREDUCE_1408382736_1
2015-03-13 10:08:42,162 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0014.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:42,164 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0014.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741993_1169{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:08:42,166 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741993_1169 src: /127.0.0.1:61992 dest: /127.0.0.1:60696
2015-03-13 10:08:42,167 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741993_1169 src: /127.0.0.1:61993 dest: /127.0.0.1:60689
2015-03-13 10:08:42,169 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741993_1169 src: /127.0.0.1:61994 dest: /127.0.0.1:60686
2015-03-13 10:08:42,171 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61994, dest: /127.0.0.1:60686, bytes: 433, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1408382736_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741993_1169, duration: 1420000
2015-03-13 10:08:42,171 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741993_1169, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:42,172 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741993_1169{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:08:42,172 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61993, dest: /127.0.0.1:60689, bytes: 433, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1408382736_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741993_1169, duration: 1895000
2015-03-13 10:08:42,172 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741993_1169, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:42,173 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741993_1169{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:08:42,173 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61992, dest: /127.0.0.1:60696, bytes: 433, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1408382736_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741993_1169, duration: 2742000
2015-03-13 10:08:42,173 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741993_1169, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:42,173 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741993_1169{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:08:42,175 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0014.summary_tmp is closed by DFSClient_NONMAPREDUCE_1408382736_1
2015-03-13 10:08:42,177 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0014.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:08:42,181 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job_1426266260362_0014_1.jhist	dst=null	perm=null
2015-03-13 10:08:42,182 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0014-1426266501740-soberoi-%5B6DC799D3695A41EDB24861BDF4BA2FF4%2F561BA7C30D2E4E92-1426266522144-5-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:08:42,185 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job_1426266260362_0014_1.jhist	dst=null	perm=null
2015-03-13 10:08:42,185 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0014-1426266501740-soberoi-%5B6DC799D3695A41EDB24861BDF4BA2FF4%2F561BA7C30D2E4E92-1426266522144-5-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:08:42,186 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job_1426266260362_0014_1.jhist	dst=null	perm=null
2015-03-13 10:08:42,188 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0014-1426266501740-soberoi-%5B6DC799D3695A41EDB24861BDF4BA2FF4%2F561BA7C30D2E4E92-1426266522144-5-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:42,193 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61995, bytes: 67435, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1408382736_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741991_1167, duration: 301000
2015-03-13 10:08:42,195 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0014-1426266501740-soberoi-%5B6DC799D3695A41EDB24861BDF4BA2FF4%2F561BA7C30D2E4E92-1426266522144-5-1-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741994_1170{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:08:42,196 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741994_1170 src: /127.0.0.1:61996 dest: /127.0.0.1:60693
2015-03-13 10:08:42,197 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741994_1170 src: /127.0.0.1:61997 dest: /127.0.0.1:60686
2015-03-13 10:08:42,199 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741994_1170 src: /127.0.0.1:61998 dest: /127.0.0.1:60696
2015-03-13 10:08:42,202 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61998, dest: /127.0.0.1:60696, bytes: 66911, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1408382736_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741994_1170, duration: 1874000
2015-03-13 10:08:42,202 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741994_1170, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:42,203 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741994_1170{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:42,203 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61997, dest: /127.0.0.1:60686, bytes: 66911, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1408382736_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741994_1170, duration: 2539000
2015-03-13 10:08:42,203 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741994_1170, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:42,203 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741994_1170{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:42,203 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61996, dest: /127.0.0.1:60693, bytes: 66911, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1408382736_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741994_1170, duration: 3378000
2015-03-13 10:08:42,204 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741994_1170, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:42,204 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741994_1170{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:42,205 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0014-1426266501740-soberoi-%5B6DC799D3695A41EDB24861BDF4BA2FF4%2F561BA7C30D2E4E92-1426266522144-5-1-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_1408382736_1
2015-03-13 10:08:42,207 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0014-1426266501740-soberoi-%5B6DC799D3695A41EDB24861BDF4BA2FF4%2F561BA7C30D2E4E92-1426266522144-5-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:08:42,208 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job_1426266260362_0014_1_conf.xml	dst=null	perm=null
2015-03-13 10:08:42,209 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0014_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:08:42,210 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job_1426266260362_0014_1_conf.xml	dst=null	perm=null
2015-03-13 10:08:42,211 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0014_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:08:42,213 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job_1426266260362_0014_1_conf.xml	dst=null	perm=null
2015-03-13 10:08:42,215 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0014_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:42,217 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61999, bytes: 92136, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1408382736_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741990_1166, duration: 263000
2015-03-13 10:08:42,219 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0014_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741995_1171{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:08:42,221 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741995_1171 src: /127.0.0.1:62000 dest: /127.0.0.1:60696
2015-03-13 10:08:42,222 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741995_1171 src: /127.0.0.1:62001 dest: /127.0.0.1:60686
2015-03-13 10:08:42,223 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741995_1171 src: /127.0.0.1:62002 dest: /127.0.0.1:60689
2015-03-13 10:08:42,226 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62002, dest: /127.0.0.1:60689, bytes: 91420, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1408382736_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741995_1171, duration: 1769000
2015-03-13 10:08:42,226 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741995_1171, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:42,227 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741995_1171{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:08:42,227 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62001, dest: /127.0.0.1:60686, bytes: 91420, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1408382736_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741995_1171, duration: 2347000
2015-03-13 10:08:42,227 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741995_1171, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:42,227 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741995_1171{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:08:42,228 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62000, dest: /127.0.0.1:60696, bytes: 91420, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1408382736_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741995_1171, duration: 3143000
2015-03-13 10:08:42,228 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741995_1171, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:42,228 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741995_1171{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:08:42,229 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0014_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_1408382736_1
2015-03-13 10:08:42,230 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0014_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:08:42,232 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0014.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0014.summary	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:08:42,233 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0014_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0014_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:08:42,235 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0014-1426266501740-soberoi-%5B6DC799D3695A41EDB24861BDF4BA2FF4%2F561BA7C30D2E4E92-1426266522144-5-1-SUCCEEDED-default.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0014-1426266501740-soberoi-%5B6DC799D3695A41EDB24861BDF4BA2FF4%2F561BA7C30D2E4E92-1426266522144-5-1-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:08:42,240 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0014_000001 State change from RUNNING to FINISHING
2015-03-13 10:08:42,240 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0014
2015-03-13 10:08:42,241 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0014 State change from RUNNING to REMOVING
2015-03-13 10:08:42,241 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0014
2015-03-13 10:08:42,241 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0014 State change from REMOVING to FINISHING
2015-03-13 10:08:42,342 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741995_1171
2015-03-13 10:08:42,343 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741993_1169
2015-03-13 10:08:42,344 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741991_1167
2015-03-13 10:08:42,534 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741992_1168
2015-03-13 10:08:42,535 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741991_1167
2015-03-13 10:08:42,536 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741994_1170
2015-03-13 10:08:42,706 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741992_1168
2015-03-13 10:08:42,707 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741994_1170
2015-03-13 10:08:42,708 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741991_1167
2015-03-13 10:08:42,708 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741995_1171
2015-03-13 10:08:42,709 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741993_1169
2015-03-13 10:08:43,095 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741994_1170
2015-03-13 10:08:43,096 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741993_1169
2015-03-13 10:08:43,097 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741995_1171
2015-03-13 10:08:43,097 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741992_1168
2015-03-13 10:08:43,117 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:43,117 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:08:43,117 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0014_01_000007
2015-03-13 10:08:43,118 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0014_01_000007 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:08:43,118 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0014_01_000007 in state: COMPLETED event:FINISHED
2015-03-13 10:08:43,118 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0014	CONTAINERID=container_1426266260362_0014_01_000007
2015-03-13 10:08:43,119 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0014_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:08:43,119 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:08:43,119 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0014_01_000007, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:43,119 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:43,119 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:08:43,120 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0014_000001 released container container_1426266260362_0014_01_000007 on node: host: 10.1.1.144:60715 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:08:43,249 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741986_1162 127.0.0.1:60689 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60686 
2015-03-13 10:08:43,249 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741987_1163 127.0.0.1:60689 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60693 
2015-03-13 10:08:43,249 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741988_1164 127.0.0.1:60689 127.0.0.1:60696 127.0.0.1:60693 
2015-03-13 10:08:43,249 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741989_1165 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60693 
2015-03-13 10:08:43,250 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741991_1167 127.0.0.1:60686 127.0.0.1:60693 127.0.0.1:60689 
2015-03-13 10:08:43,250 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741990_1166 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60693 
2015-03-13 10:08:43,250 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014	dst=null	perm=null
2015-03-13 10:08:43,277 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper*joined] starting step: (1/2) ...splatform/joingroupbyjoin
2015-03-13 10:08:43,284 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:08:43,291 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:08:43,294 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin	dst=null	perm=null
2015-03-13 10:08:43,295 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:08:43,304 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:08:43,308 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 15
2015-03-13 10:08:43,309 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015	dst=null	perm=null
2015-03-13 10:08:43,310 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015	dst=null	perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:08:43,311 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015	dst=null	perm=soberoi:supergroup:rwx------
2015-03-13 10:08:43,312 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.jar	dst=null	perm=null
2015-03-13 10:08:43,313 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:43,315 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073741996_1172{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:08:43,316 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741996_1172 src: /127.0.0.1:62005 dest: /127.0.0.1:60693
2015-03-13 10:08:43,318 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741996_1172 src: /127.0.0.1:62006 dest: /127.0.0.1:60686
2015-03-13 10:08:43,319 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741996_1172 src: /127.0.0.1:62007 dest: /127.0.0.1:60696
2015-03-13 10:08:43,323 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62007, dest: /127.0.0.1:60696, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741996_1172, duration: 2147000
2015-03-13 10:08:43,323 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741996_1172, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:43,323 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741996_1172{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:43,323 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62006, dest: /127.0.0.1:60686, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741996_1172, duration: 2581000
2015-03-13 10:08:43,324 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741996_1172, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:43,324 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741996_1172{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:43,324 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62005, dest: /127.0.0.1:60693, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741996_1172, duration: 3710000
2015-03-13 10:08:43,324 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741996_1172, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:43,328 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741996_1172{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:43,328 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:08:43,329 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.jar
2015-03-13 10:08:43,329 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.jar	dst=null	perm=null
2015-03-13 10:08:43,330 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:43,331 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:08:43,332 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:08:43,332 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:08:43,333 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:08:43,333 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:08:43,334 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:08:43,334 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:08:43,335 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:08:43,335 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:08:43,336 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2463283610_lower_upper_7CE7EFE8013A4AD39F74615BC414DB0A	dst=null	perm=null
2015-03-13 10:08:43,337 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2463283610_lower_upper_7CE7EFE8013A4AD39F74615BC414DB0A	dst=null	perm=null
2015-03-13 10:08:43,337 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/2463283610_lower_upper_7CE7EFE8013A4AD39F74615BC414DB0A	dst=null	perm=null
2015-03-13 10:08:43,338 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:08:43,339 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:43,340 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:43,341 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.split
2015-03-13 10:08:43,341 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.split	dst=null	perm=null
2015-03-13 10:08:43,342 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073741997_1173{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:08:43,343 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741997_1173 src: /127.0.0.1:62008 dest: /127.0.0.1:60686
2015-03-13 10:08:43,345 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741997_1173 src: /127.0.0.1:62009 dest: /127.0.0.1:60696
2015-03-13 10:08:43,346 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741997_1173 src: /127.0.0.1:62010 dest: /127.0.0.1:60689
2015-03-13 10:08:43,347 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741997_1173 src: /127.0.0.1:62011 dest: /127.0.0.1:60693
2015-03-13 10:08:43,350 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62011, dest: /127.0.0.1:60693, bytes: 358, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741997_1173, duration: 1599000
2015-03-13 10:08:43,350 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741997_1173, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:43,351 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741997_1173{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:43,351 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62010, dest: /127.0.0.1:60689, bytes: 358, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741997_1173, duration: 2064000
2015-03-13 10:08:43,351 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741997_1173, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:43,352 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62009, dest: /127.0.0.1:60696, bytes: 358, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741997_1173, duration: 3159000
2015-03-13 10:08:43,352 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741997_1173, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:43,352 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741997_1173{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:43,353 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62008, dest: /127.0.0.1:60686, bytes: 358, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741997_1173, duration: 4376000
2015-03-13 10:08:43,353 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741997_1173, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:43,354 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741997_1173{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:43,355 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741997_1173{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:43,356 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:08:43,358 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:43,360 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:43,361 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073741998_1174{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:08:43,362 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741998_1174 src: /127.0.0.1:62012 dest: /127.0.0.1:60693
2015-03-13 10:08:43,364 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741998_1174 src: /127.0.0.1:62013 dest: /127.0.0.1:60686
2015-03-13 10:08:43,365 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741998_1174 src: /127.0.0.1:62014 dest: /127.0.0.1:60689
2015-03-13 10:08:43,368 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62014, dest: /127.0.0.1:60689, bytes: 44, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741998_1174, duration: 1321000
2015-03-13 10:08:43,368 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741998_1174, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:43,369 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62013, dest: /127.0.0.1:60686, bytes: 44, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741998_1174, duration: 1652000
2015-03-13 10:08:43,369 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741998_1174{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:08:43,369 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741998_1174, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:43,369 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62012, dest: /127.0.0.1:60693, bytes: 44, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741998_1174, duration: 2534000
2015-03-13 10:08:43,370 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741998_1174, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:43,369 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741998_1174{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:08:43,371 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741998_1174{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:08:43,372 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:08:43,372 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-03-13 10:08:43,373 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:43,375 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:43,376 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:08:43,376 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:08:43,376 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:08:43,379 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073741999_1175{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:08:43,381 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741999_1175 src: /127.0.0.1:62015 dest: /127.0.0.1:60693
2015-03-13 10:08:43,382 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741999_1175 src: /127.0.0.1:62016 dest: /127.0.0.1:60686
2015-03-13 10:08:43,383 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741999_1175 src: /127.0.0.1:62017 dest: /127.0.0.1:60696
2015-03-13 10:08:43,386 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62017, dest: /127.0.0.1:60696, bytes: 98174, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741999_1175, duration: 1429000
2015-03-13 10:08:43,386 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741999_1175, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:43,386 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741999_1175{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:43,386 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62016, dest: /127.0.0.1:60686, bytes: 98174, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741999_1175, duration: 1693000
2015-03-13 10:08:43,387 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741999_1175, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:43,387 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741999_1175{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:43,387 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62015, dest: /127.0.0.1:60693, bytes: 98174, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741999_1175, duration: 2339000
2015-03-13 10:08:43,387 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741999_1175, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:43,388 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741999_1175{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:43,389 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:08:43,389 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0015
2015-03-13 10:08:43,390 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015	dst=null	perm=null
2015-03-13 10:08:43,391 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.xml	dst=null	perm=null
2015-03-13 10:08:43,391 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.xml	dst=null	perm=null
2015-03-13 10:08:43,392 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.jar	dst=null	perm=null
2015-03-13 10:08:43,392 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.jar	dst=null	perm=null
2015-03-13 10:08:43,393 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.split	dst=null	perm=null
2015-03-13 10:08:43,393 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.split	dst=null	perm=null
2015-03-13 10:08:43,393 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:08:43,394 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:08:43,396 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:08:43,396 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:08:43,397 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:08:43,397 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:08:43,398 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:08:43,399 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:08:43,400 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 15 submitted by user soberoi
2015-03-13 10:08:43,400 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0015
2015-03-13 10:08:43,400 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	IP=10.1.1.144	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1426266260362_0015
2015-03-13 10:08:43,400 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0015
2015-03-13 10:08:43,400 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0015 State change from NEW to NEW_SAVING
2015-03-13 10:08:43,401 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0015 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:08:43,401 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0015_000001
2015-03-13 10:08:43,401 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0015_000001 State change from NEW to SUBMITTED
2015-03-13 10:08:43,401 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0015 from user: soberoi activated in queue: default
2015-03-13 10:08:43,401 INFO  capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0015 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:08:43,401 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0015 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:08:43,402 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0015 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:08:43,402 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0015_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:08:43,402 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0015_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:08:43,402 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0015 State change from SUBMITTED to ACCEPTED
2015-03-13 10:08:43,404 INFO  mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0015/
2015-03-13 10:08:43,405 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper*joined] submitted hadoop job: job_1426266260362_0015
2015-03-13 10:08:43,405 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper*joined] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0015/
2015-03-13 10:08:43,459 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0015_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:08:43,459 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0015	CONTAINERID=container_1426266260362_0015_01_000001
2015-03-13 10:08:43,459 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0015_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:08:43,459 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0015 container=Container: [ContainerId: container_1426266260362_0015_01_000001, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0015_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:43,459 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:08:43,459 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0015_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:08:43,459 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:43,460 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0015 AttemptId: appattempt_1426266260362_0015_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0015_01_000001, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ]
2015-03-13 10:08:43,460 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0015_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:08:43,460 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0015_000001
2015-03-13 10:08:43,460 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0015_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:08:43,461 INFO  amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0015_000001
2015-03-13 10:08:43,461 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0015_01_000001, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] for AM appattempt_1426266260362_0015_000001
2015-03-13 10:08:43,461 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0015_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-03-13 10:08:43,463 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0015_000001 (auth:SIMPLE)
2015-03-13 10:08:43,465 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0015_01_000001 by user soberoi
2015-03-13 10:08:43,465 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0015
2015-03-13 10:08:43,465 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0015	CONTAINERID=container_1426266260362_0015_01_000001
2015-03-13 10:08:43,465 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0015 transitioned from NEW to INITING
2015-03-13 10:08:43,465 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0015_01_000001 to application application_1426266260362_0015
2015-03-13 10:08:43,465 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0015 transitioned from INITING to RUNNING
2015-03-13 10:08:43,465 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0015_01_000001, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] for AM appattempt_1426266260362_0015_000001
2015-03-13 10:08:43,466 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0015_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:08:43,466 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0015_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:08:43,466 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0015
2015-03-13 10:08:43,466 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:08:43,466 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:08:43,466 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:08:43,466 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:08:43,466 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0015_01_000001
2015-03-13 10:08:43,477 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0015_01_000001.tokens. Credentials list: 
2015-03-13 10:08:43,491 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:08:43,561 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0015_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0015/container_1426266260362_0015_01_000001.tokens
2015-03-13 10:08:43,562 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0015 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0015
2015-03-13 10:08:43,619 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.jar	dst=null	perm=null
2015-03-13 10:08:43,620 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.jar	dst=null	perm=null
2015-03-13 10:08:43,621 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.jar	dst=null	perm=null
2015-03-13 10:08:43,627 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62021, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1659101727_8055, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741996_1172, duration: 487000
2015-03-13 10:08:43,645 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:08:43,662 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:08:43,662 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:08:43,663 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:08:43,669 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62022, bytes: 48, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1659101727_8055, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741998_1174, duration: 161000
2015-03-13 10:08:43,681 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:08:43,696 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.split	dst=null	perm=null
2015-03-13 10:08:43,697 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.split	dst=null	perm=null
2015-03-13 10:08:43,697 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.split	dst=null	perm=null
2015-03-13 10:08:43,703 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62021, bytes: 362, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1659101727_8055, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741997_1173, duration: 134000
2015-03-13 10:08:43,715 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:08:43,731 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.xml	dst=null	perm=null
2015-03-13 10:08:43,731 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.xml	dst=null	perm=null
2015-03-13 10:08:43,732 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.xml	dst=null	perm=null
2015-03-13 10:08:43,737 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62021, bytes: 98942, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1659101727_8055, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741999_1175, duration: 238000
2015-03-13 10:08:43,750 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:08:43,750 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0015_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:08:43,775 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0015_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:08:43,775 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:43,840 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0015/container_1426266260362_0015_01_000001/default_container_executor.sh]
2015-03-13 10:08:44,118 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:44,463 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 15 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:44,464 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0015_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:08:45,119 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:45,429 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:08:45,450 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/COMMIT_STARTED	dst=null	perm=null
2015-03-13 10:08:45,451 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/COMMIT_SUCCESS	dst=null	perm=null
2015-03-13 10:08:45,451 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/COMMIT_FAIL	dst=null	perm=null
2015-03-13 10:08:45,468 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 15 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:45,502 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015	dst=null	perm=null
2015-03-13 10:08:45,503 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:08:45,504 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:08:45,777 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:08:45,785 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:08:45,839 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62024, bytes: 48, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1318542119_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741998_1174, duration: 168000
2015-03-13 10:08:45,853 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60686 to replicate blk_1073741996_1172 to datanode(s) 127.0.0.1:60689
2015-03-13 10:08:45,853 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073741986_1162, blk_1073741987_1163, blk_1073741990_1166, blk_1073741991_1167]
2015-03-13 10:08:45,854 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073741986_1162, blk_1073741987_1163, blk_1073741988_1164, blk_1073741989_1165, blk_1073741991_1167]
2015-03-13 10:08:46,124 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:46,470 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 15 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:46,475 INFO  datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-1907321454-10.1.1.144-60686-1426266259166, infoPort=60687, ipcPort=60688, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073741996_1172 to 127.0.0.1:60689 
2015-03-13 10:08:46,475 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741986_1162 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741986 for deletion
2015-03-13 10:08:46,475 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741987_1163 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741987 for deletion
2015-03-13 10:08:46,476 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741990_1166 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741990 for deletion
2015-03-13 10:08:46,476 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741991_1167 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741991 for deletion
2015-03-13 10:08:46,476 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741986_1162 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741986
2015-03-13 10:08:46,476 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741991_1167 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741991
2015-03-13 10:08:46,476 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741987_1163 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741987
2015-03-13 10:08:46,477 INFO  datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073741996_1172 (numBytes=254067) to /127.0.0.1:60689
2015-03-13 10:08:46,477 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741990_1166 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741990
2015-03-13 10:08:46,477 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741996_1172 src: /127.0.0.1:62027 dest: /127.0.0.1:60689
2015-03-13 10:08:46,477 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741986_1162 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741986 for deletion
2015-03-13 10:08:46,478 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741987_1163 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741987 for deletion
2015-03-13 10:08:46,478 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741988_1164 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741988 for deletion
2015-03-13 10:08:46,478 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741989_1165 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741989 for deletion
2015-03-13 10:08:46,478 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741991_1167 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741991 for deletion
2015-03-13 10:08:46,478 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741986_1162 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741986
2015-03-13 10:08:46,478 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741987_1163 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741987
2015-03-13 10:08:46,479 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741988_1164 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741988
2015-03-13 10:08:46,479 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741991_1167 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741991
2015-03-13 10:08:46,479 INFO  datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073741996_1172 src: /127.0.0.1:62027 dest: /127.0.0.1:60689 of size 254067
2015-03-13 10:08:46,479 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741989_1165 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741989
2015-03-13 10:08:46,480 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741996_1172 size 254067
2015-03-13 10:08:46,605 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0015_000001 (auth:SIMPLE)
2015-03-13 10:08:46,606 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0015_000001
2015-03-13 10:08:46,606 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi	IP=10.1.1.144	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1426266260362_0015	APPATTEMPTID=appattempt_1426266260362_0015_000001
2015-03-13 10:08:46,607 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0015_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:08:46,607 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0015 State change from ACCEPTED to RUNNING
2015-03-13 10:08:46,626 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job_1426266260362_0015_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:46,629 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:08:46,685 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job_1426266260362_0015_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:46,803 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job_1426266260362_0015_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742000_1176{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:08:46,853 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742000_1176 src: /127.0.0.1:62031 dest: /127.0.0.1:60686
2015-03-13 10:08:46,854 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742000_1176 src: /127.0.0.1:62032 dest: /127.0.0.1:60693
2015-03-13 10:08:46,857 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742000_1176 src: /127.0.0.1:62033 dest: /127.0.0.1:60696
2015-03-13 10:08:46,864 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62033, dest: /127.0.0.1:60696, bytes: 90995, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1318542119_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742000_1176, duration: 5155000
2015-03-13 10:08:46,864 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742000_1176, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:46,864 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742000_1176{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:46,864 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62032, dest: /127.0.0.1:60693, bytes: 90995, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1318542119_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742000_1176, duration: 6045000
2015-03-13 10:08:46,865 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742000_1176, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:46,865 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742000_1176{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:46,865 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62031, dest: /127.0.0.1:60686, bytes: 90995, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1318542119_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742000_1176, duration: 6850000
2015-03-13 10:08:46,865 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742000_1176, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:46,866 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742000_1176{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:46,869 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job_1426266260362_0015_1_conf.xml is closed by DFSClient_NONMAPREDUCE_1318542119_1
2015-03-13 10:08:47,126 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:47,351 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741998_1174
2015-03-13 10:08:47,353 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741996_1172
2015-03-13 10:08:47,353 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741997_1173
2015-03-13 10:08:47,474 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 15 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:47,543 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741996_1172
2015-03-13 10:08:47,544 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741998_1174
2015-03-13 10:08:47,544 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741999_1175
2015-03-13 10:08:47,717 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741999_1175
2015-03-13 10:08:47,718 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741998_1174
2015-03-13 10:08:47,718 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741997_1173
2015-03-13 10:08:47,719 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742000_1176
2015-03-13 10:08:47,745 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742000_1176
2015-03-13 10:08:47,745 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741997_1173
2015-03-13 10:08:47,920 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741996_1172
2015-03-13 10:08:48,024 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0015_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:08:48,025 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0015	CONTAINERID=container_1426266260362_0015_01_000002
2015-03-13 10:08:48,025 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0015_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:08:48,025 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0015 container=Container: [ContainerId: container_1426266260362_0015_01_000002, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0015_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:48,025 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:08:48,025 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:48,102 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742000_1176
2015-03-13 10:08:48,103 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741999_1175
2015-03-13 10:08:48,103 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741997_1173
2015-03-13 10:08:48,130 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:48,304 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741996_1172
2015-03-13 10:08:48,381 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0014_01_000001 succeeded 
2015-03-13 10:08:48,381 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:08:48,381 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0014_01_000001
2015-03-13 10:08:48,389 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000001
2015-03-13 10:08:48,389 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000001
2015-03-13 10:08:48,389 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000001
2015-03-13 10:08:48,389 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000001
2015-03-13 10:08:48,389 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0014	CONTAINERID=container_1426266260362_0014_01_000001
2015-03-13 10:08:48,390 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:08:48,390 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0014_01_000001 from application application_1426266260362_0014
2015-03-13 10:08:48,390 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:48,390 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0014
2015-03-13 10:08:48,479 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 15 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:48,637 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0015_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:08:48,662 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.jar	dst=null	perm=null
2015-03-13 10:08:48,663 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.jar	dst=null	perm=null
2015-03-13 10:08:48,671 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.xml	dst=null	perm=null
2015-03-13 10:08:48,672 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.xml	dst=null	perm=null
2015-03-13 10:08:48,674 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:08:48,675 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:08:48,680 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:08:48,682 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:08:48,683 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:08:48,684 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:08:48,744 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0015_000001 (auth:SIMPLE)
2015-03-13 10:08:48,746 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0015_01_000002 by user soberoi
2015-03-13 10:08:48,746 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0015
2015-03-13 10:08:48,747 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0015	CONTAINERID=container_1426266260362_0015_01_000002
2015-03-13 10:08:48,747 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0015 transitioned from NEW to INITING
2015-03-13 10:08:48,747 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0015_01_000002 to application application_1426266260362_0015
2015-03-13 10:08:48,747 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0015 transitioned from INITING to RUNNING
2015-03-13 10:08:48,747 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0015_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:08:48,747 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0015
2015-03-13 10:08:48,747 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0015
2015-03-13 10:08:48,747 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:08:48,748 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0015
2015-03-13 10:08:48,748 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:08:48,748 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:08:48,748 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0015_01_000002
2015-03-13 10:08:48,758 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426266260362_0015_01_000002.tokens. Credentials list: 
2015-03-13 10:08:48,773 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:08:48,839 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426266260362_0015_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0015/container_1426266260362_0015_01_000002.tokens
2015-03-13 10:08:48,839 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0015 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0015
2015-03-13 10:08:48,855 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073741986_1162, blk_1073741987_1163, blk_1073741988_1164, blk_1073741989_1165, blk_1073741990_1166]
2015-03-13 10:08:48,855 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073741986_1162, blk_1073741987_1163, blk_1073741988_1164, blk_1073741989_1165, blk_1073741990_1166, blk_1073741991_1167]
2015-03-13 10:08:48,894 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.jar	dst=null	perm=null
2015-03-13 10:08:48,895 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.jar	dst=null	perm=null
2015-03-13 10:08:48,896 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.jar	dst=null	perm=null
2015-03-13 10:08:48,902 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62037, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1931043022_8158, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741996_1172, duration: 535000
2015-03-13 10:08:48,922 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:08:48,939 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.xml	dst=null	perm=null
2015-03-13 10:08:48,940 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.xml	dst=null	perm=null
2015-03-13 10:08:48,940 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.xml	dst=null	perm=null
2015-03-13 10:08:48,947 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62038, bytes: 98942, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1931043022_8158, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741999_1175, duration: 294000
2015-03-13 10:08:48,960 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:08:48,960 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0015_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:08:48,985 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0015_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:08:48,985 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:49,024 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 15 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:49,024 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0015_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:08:49,048 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0015/container_1426266260362_0015_01_000002/default_container_executor.sh]
2015-03-13 10:08:49,131 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:08:49,131 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0014_01_000001
2015-03-13 10:08:49,131 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0014_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:08:49,131 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0014_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:08:49,131 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0014_000001
2015-03-13 10:08:49,132 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0014	CONTAINERID=container_1426266260362_0014_01_000001
2015-03-13 10:08:49,132 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0014_000001 State change from FINISHING to FINISHED
2015-03-13 10:08:49,132 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0014_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60715, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:08:49,132 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0014 State change from FINISHING to FINISHED
2015-03-13 10:08:49,132 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:08:49,132 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1426266260362_0014
2015-03-13 10:08:49,132 INFO  amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0014_000001
2015-03-13 10:08:49,132 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0014_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=2, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:49,132 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:49,133 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=2, numContainers=2
2015-03-13 10:08:49,133 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0014_000001 released container container_1426266260362_0014_01_000001 on node: host: 10.1.1.144:60715 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:08:49,132 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0014,name=[6DC799D3695A41EDB24861BDF4BA2FF4/561BA7C30D2E4E9290533DB9645A592A] lower*upper*joined/(2/2),user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0014/jobhistory/job/job_1426266260362_0014,appMasterHost=Edinburgh.local,startTime=1426266501740,finishTime=1426266522241,finalStatus=SUCCEEDED
2015-03-13 10:08:49,133 INFO  capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0014_000001 is done. finalState=FINISHED
2015-03-13 10:08:49,133 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0014 requests cleared
2015-03-13 10:08:49,133 INFO  capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0014 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:08:49,133 INFO  capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0014 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:08:49,135 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0014_000001 (auth:SIMPLE)
2015-03-13 10:08:49,136 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0014_01_000001
2015-03-13 10:08:49,483 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 15 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:49,650 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741986_1162 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741986 for deletion
2015-03-13 10:08:49,651 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741987_1163 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741987 for deletion
2015-03-13 10:08:49,651 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741988_1164 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741988 for deletion
2015-03-13 10:08:49,651 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741989_1165 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741989 for deletion
2015-03-13 10:08:49,651 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741986_1162 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741986
2015-03-13 10:08:49,651 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:08:49,651 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741987_1163 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741987
2015-03-13 10:08:49,651 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741988_1164 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741988
2015-03-13 10:08:49,651 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741990_1166 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741990 for deletion
2015-03-13 10:08:49,651 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741991_1167 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741991 for deletion
2015-03-13 10:08:49,651 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741989_1165 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741989
2015-03-13 10:08:49,652 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741990_1166 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741990
2015-03-13 10:08:49,652 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741991_1167 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741991
2015-03-13 10:08:49,851 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741986_1162 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741986 for deletion
2015-03-13 10:08:49,851 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741987_1163 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741987 for deletion
2015-03-13 10:08:49,851 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741988_1164 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741988 for deletion
2015-03-13 10:08:49,851 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741989_1165 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741989 for deletion
2015-03-13 10:08:49,851 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741987_1163 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741987
2015-03-13 10:08:49,851 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741990_1166 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741990 for deletion
2015-03-13 10:08:49,851 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741986_1162 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741986
2015-03-13 10:08:49,852 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741989_1165 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741989
2015-03-13 10:08:49,852 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741988_1164 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741988
2015-03-13 10:08:49,852 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741990_1166 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741990
2015-03-13 10:08:50,025 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 15 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:50,025 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0014 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:08:50,025 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0014
2015-03-13 10:08:50,025 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0014
2015-03-13 10:08:50,026 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0014
2015-03-13 10:08:50,026 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0014 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:08:50,026 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0014, with delay of 10800 seconds
2015-03-13 10:08:50,026 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0014
2015-03-13 10:08:50,026 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0014
2015-03-13 10:08:50,133 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0014 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:08:50,133 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0014
2015-03-13 10:08:50,134 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0014
2015-03-13 10:08:50,134 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0014 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:08:50,134 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0014
2015-03-13 10:08:50,134 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0014, with delay of 10800 seconds
2015-03-13 10:08:50,134 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0014
2015-03-13 10:08:50,134 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0014
2015-03-13 10:08:50,485 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 15 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:51,027 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 15 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:51,186 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.split	dst=null	perm=null
2015-03-13 10:08:51,259 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62042, bytes: 362, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0015_m_000000_0_1911358585_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741997_1173, duration: 126000
2015-03-13 10:08:51,311 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2463283610_lower_upper_7CE7EFE8013A4AD39F74615BC414DB0A/part-00000	dst=null	perm=null
2015-03-13 10:08:51,317 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/2463283610_lower_upper_7CE7EFE8013A4AD39F74615BC414DB0A/part-00000	dst=null	perm=null
2015-03-13 10:08:51,319 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62043, bytes: 244, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0015_m_000000_0_1911358585_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741992_1168, duration: 135000
2015-03-13 10:08:51,337 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin/_temporary/1/_temporary/attempt_1426266260362_0015_m_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:51,490 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 15 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:51,491 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower+upper.txt	dst=null	perm=null
2015-03-13 10:08:51,495 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower+upper.txt	dst=null	perm=null
2015-03-13 10:08:51,499 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower+upper.txt	dst=null	perm=null
2015-03-13 10:08:51,503 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62044, bytes: 34, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0015_m_000000_0_1911358585_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741985_1161, duration: 162000
2015-03-13 10:08:51,524 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin/_temporary/1/_temporary/attempt_1426266260362_0015_m_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073742001_1177{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:08:51,553 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742001_1177 src: /127.0.0.1:62045 dest: /127.0.0.1:60693
2015-03-13 10:08:51,555 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742001_1177 src: /127.0.0.1:62046 dest: /127.0.0.1:60689
2015-03-13 10:08:51,556 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742001_1177 src: /127.0.0.1:62047 dest: /127.0.0.1:60696
2015-03-13 10:08:51,563 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62047, dest: /127.0.0.1:60696, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0015_m_000000_0_1911358585_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742001_1177, duration: 4878000
2015-03-13 10:08:51,563 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742001_1177, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:51,563 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742001_1177{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:51,564 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62046, dest: /127.0.0.1:60689, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0015_m_000000_0_1911358585_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742001_1177, duration: 5560000
2015-03-13 10:08:51,564 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742001_1177, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:51,565 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62045, dest: /127.0.0.1:60693, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0015_m_000000_0_1911358585_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742001_1177, duration: 6739000
2015-03-13 10:08:51,565 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742001_1177{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:51,565 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742001_1177, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:51,565 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742001_1177{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:51,569 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin/_temporary/1/_temporary/attempt_1426266260362_0015_m_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0015_m_000000_0_1911358585_1
2015-03-13 10:08:51,575 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin/_temporary/1/_temporary/attempt_1426266260362_0015_m_000000_0	dst=null	perm=null
2015-03-13 10:08:51,581 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin/_temporary/1/_temporary/attempt_1426266260362_0015_m_000000_0	dst=null	perm=null
2015-03-13 10:08:51,582 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin/_temporary/1/task_1426266260362_0015_m_000000	dst=null	perm=null
2015-03-13 10:08:51,585 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin/_temporary/1/_temporary/attempt_1426266260362_0015_m_000000_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin/_temporary/1/task_1426266260362_0015_m_000000	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:08:51,600 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0015_01_000002
2015-03-13 10:08:51,600 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0015	CONTAINERID=container_1426266260362_0015_01_000002
2015-03-13 10:08:51,601 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0015_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:08:51,601 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0015_01_000002
2015-03-13 10:08:51,601 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 15 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:08:51,610 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0015_01_000002 is : 143
2015-03-13 10:08:51,621 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job_1426266260362_0015_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073742002_1178{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:08:51,622 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0015_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:08:51,622 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:51,623 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742002_1178 src: /127.0.0.1:62048 dest: /127.0.0.1:60686
2015-03-13 10:08:51,623 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0015/container_1426266260362_0015_01_000002
2015-03-13 10:08:51,624 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0015/container_1426266260362_0015_01_000002
2015-03-13 10:08:51,624 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0015/container_1426266260362_0015_01_000002
2015-03-13 10:08:51,623 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0015	CONTAINERID=container_1426266260362_0015_01_000002
2015-03-13 10:08:51,624 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0015_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:08:51,624 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0015_01_000002 from application application_1426266260362_0015
2015-03-13 10:08:51,624 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:51,624 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0015
2015-03-13 10:08:51,624 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0015/container_1426266260362_0015_01_000002
2015-03-13 10:08:51,625 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742002_1178 src: /127.0.0.1:62049 dest: /127.0.0.1:60689
2015-03-13 10:08:51,626 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_1318542119_1
2015-03-13 10:08:51,627 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742002_1178 src: /127.0.0.1:62050 dest: /127.0.0.1:60696
2015-03-13 10:08:51,630 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin/_temporary/1	dst=null	perm=null
2015-03-13 10:08:51,633 INFO  hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job_1426266260362_0015_1.jhist for DFSClient_NONMAPREDUCE_1318542119_1
2015-03-13 10:08:51,638 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin	dst=null	perm=null
2015-03-13 10:08:51,639 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin	dst=null	perm=null
2015-03-13 10:08:51,640 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin/_temporary/1/task_1426266260362_0015_m_000000	dst=null	perm=null
2015-03-13 10:08:51,642 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin/part-00000	dst=null	perm=null
2015-03-13 10:08:51,644 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin/_temporary/1/task_1426266260362_0015_m_000000/part-00000	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin/part-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:51,649 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin/_temporary	dst=null	perm=null
2015-03-13 10:08:51,653 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:51,655 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin/_SUCCESS is closed by DFSClient_NONMAPREDUCE_1318542119_1
2015-03-13 10:08:51,657 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:51,659 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_1318542119_1
2015-03-13 10:08:51,672 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62050, dest: /127.0.0.1:60696, bytes: 23093, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1318542119_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742002_1178, duration: 43050000
2015-03-13 10:08:51,672 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742002_1178, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:51,675 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742002_1178{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:51,676 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62049, dest: /127.0.0.1:60689, bytes: 23093, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1318542119_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742002_1178, duration: 46704000
2015-03-13 10:08:51,676 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742002_1178, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:51,676 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742002_1178{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:51,676 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62048, dest: /127.0.0.1:60686, bytes: 23093, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1318542119_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742002_1178, duration: 47592000
2015-03-13 10:08:51,677 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742002_1178, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:51,677 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742002_1178{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:51,678 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job_1426266260362_0015_1.jhist is closed by DFSClient_NONMAPREDUCE_1318542119_1
2015-03-13 10:08:51,680 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0015.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:51,682 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0015.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742003_1179{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:08:51,684 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742003_1179 src: /127.0.0.1:62051 dest: /127.0.0.1:60696
2015-03-13 10:08:51,685 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742003_1179 src: /127.0.0.1:62052 dest: /127.0.0.1:60689
2015-03-13 10:08:51,687 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742003_1179 src: /127.0.0.1:62053 dest: /127.0.0.1:60693
2015-03-13 10:08:51,689 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62053, dest: /127.0.0.1:60693, bytes: 446, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1318542119_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742003_1179, duration: 1520000
2015-03-13 10:08:51,690 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742003_1179, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:51,690 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742003_1179{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:51,690 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62052, dest: /127.0.0.1:60689, bytes: 446, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1318542119_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742003_1179, duration: 1957000
2015-03-13 10:08:51,690 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742003_1179, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:51,691 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742003_1179{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:51,691 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62051, dest: /127.0.0.1:60696, bytes: 446, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1318542119_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742003_1179, duration: 2850000
2015-03-13 10:08:51,691 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742003_1179, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:51,692 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742003_1179{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:51,693 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0015.summary_tmp is closed by DFSClient_NONMAPREDUCE_1318542119_1
2015-03-13 10:08:51,696 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0015.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:08:51,700 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job_1426266260362_0015_1.jhist	dst=null	perm=null
2015-03-13 10:08:51,701 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0015-1426266523400-soberoi-%5B6DC799D3695A41EDB24861BDF4BA2FF4%2F3066B2C3CE374148-1426266531660-1-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:08:51,705 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job_1426266260362_0015_1.jhist	dst=null	perm=null
2015-03-13 10:08:51,706 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0015-1426266523400-soberoi-%5B6DC799D3695A41EDB24861BDF4BA2FF4%2F3066B2C3CE374148-1426266531660-1-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:08:51,707 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job_1426266260362_0015_1.jhist	dst=null	perm=null
2015-03-13 10:08:51,708 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0015-1426266523400-soberoi-%5B6DC799D3695A41EDB24861BDF4BA2FF4%2F3066B2C3CE374148-1426266531660-1-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:51,710 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62054, bytes: 23277, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1318542119_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742002_1178, duration: 149000
2015-03-13 10:08:51,712 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0015-1426266523400-soberoi-%5B6DC799D3695A41EDB24861BDF4BA2FF4%2F3066B2C3CE374148-1426266531660-1-0-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742004_1180{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:08:51,713 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742004_1180 src: /127.0.0.1:62055 dest: /127.0.0.1:60693
2015-03-13 10:08:51,715 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742004_1180 src: /127.0.0.1:62056 dest: /127.0.0.1:60696
2015-03-13 10:08:51,716 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742004_1180 src: /127.0.0.1:62057 dest: /127.0.0.1:60689
2015-03-13 10:08:51,719 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62057, dest: /127.0.0.1:60689, bytes: 23093, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1318542119_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742004_1180, duration: 1328000
2015-03-13 10:08:51,719 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742004_1180, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:51,719 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742004_1180{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:08:51,719 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62056, dest: /127.0.0.1:60696, bytes: 23093, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1318542119_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742004_1180, duration: 1781000
2015-03-13 10:08:51,719 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742004_1180, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:51,720 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742004_1180{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:08:51,720 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62055, dest: /127.0.0.1:60693, bytes: 23093, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1318542119_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742004_1180, duration: 2542000
2015-03-13 10:08:51,720 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742004_1180, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:51,721 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742004_1180{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:08:51,722 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0015-1426266523400-soberoi-%5B6DC799D3695A41EDB24861BDF4BA2FF4%2F3066B2C3CE374148-1426266531660-1-0-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_1318542119_1
2015-03-13 10:08:51,724 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0015-1426266523400-soberoi-%5B6DC799D3695A41EDB24861BDF4BA2FF4%2F3066B2C3CE374148-1426266531660-1-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:08:51,725 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job_1426266260362_0015_1_conf.xml	dst=null	perm=null
2015-03-13 10:08:51,726 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0015_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:08:51,727 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job_1426266260362_0015_1_conf.xml	dst=null	perm=null
2015-03-13 10:08:51,728 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0015_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:08:51,729 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job_1426266260362_0015_1_conf.xml	dst=null	perm=null
2015-03-13 10:08:51,731 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0015_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:51,735 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62058, bytes: 91707, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1318542119_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742000_1176, duration: 250000
2015-03-13 10:08:51,737 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0015_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742005_1181{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:08:51,738 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742005_1181 src: /127.0.0.1:62059 dest: /127.0.0.1:60689
2015-03-13 10:08:51,740 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742005_1181 src: /127.0.0.1:62060 dest: /127.0.0.1:60686
2015-03-13 10:08:51,741 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742005_1181 src: /127.0.0.1:62061 dest: /127.0.0.1:60696
2015-03-13 10:08:51,744 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62061, dest: /127.0.0.1:60696, bytes: 90995, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1318542119_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742005_1181, duration: 1897000
2015-03-13 10:08:51,744 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742005_1181, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:51,744 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742005_1181{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:51,745 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62060, dest: /127.0.0.1:60686, bytes: 90995, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1318542119_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742005_1181, duration: 2416000
2015-03-13 10:08:51,745 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742005_1181, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:51,745 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742005_1181{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:51,746 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62059, dest: /127.0.0.1:60689, bytes: 90995, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1318542119_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742005_1181, duration: 3172000
2015-03-13 10:08:51,746 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742005_1181, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:51,746 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742005_1181{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:51,748 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0015_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_1318542119_1
2015-03-13 10:08:51,749 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0015_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:08:51,751 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0015.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0015.summary	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:08:51,753 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0015_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0015_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:08:51,755 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0015-1426266523400-soberoi-%5B6DC799D3695A41EDB24861BDF4BA2FF4%2F3066B2C3CE374148-1426266531660-1-0-SUCCEEDED-default.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0015-1426266523400-soberoi-%5B6DC799D3695A41EDB24861BDF4BA2FF4%2F3066B2C3CE374148-1426266531660-1-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:08:51,761 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0015_000001 State change from RUNNING to FINISHING
2015-03-13 10:08:51,761 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0015
2015-03-13 10:08:51,761 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0015 State change from RUNNING to REMOVING
2015-03-13 10:08:51,761 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0015
2015-03-13 10:08:51,762 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0015 State change from REMOVING to FINISHING
2015-03-13 10:08:52,360 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742002_1178
2015-03-13 10:08:52,360 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742001_1177
2015-03-13 10:08:52,361 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742005_1181
2015-03-13 10:08:52,361 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742004_1180
2015-03-13 10:08:52,361 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742003_1179
2015-03-13 10:08:52,495 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 15 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:52,607 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 15 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:08:52,607 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0015_01_000002
2015-03-13 10:08:52,608 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0015_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:08:52,608 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0015_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:08:52,608 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0015	CONTAINERID=container_1426266260362_0015_01_000002
2015-03-13 10:08:52,608 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0015_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:08:52,608 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:08:52,608 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0015_01_000002, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:52,609 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:52,609 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:08:52,609 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0015_000001 released container container_1426266260362_0015_01_000002 on node: host: 10.1.1.144:60723 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:08:52,751 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742003_1179
2015-03-13 10:08:52,751 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742001_1177
2015-03-13 10:08:52,752 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742004_1180
2015-03-13 10:08:52,768 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741996_1172 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60689 
2015-03-13 10:08:52,768 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741997_1173 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60693 
2015-03-13 10:08:52,768 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741998_1174 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60689 
2015-03-13 10:08:52,769 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741999_1175 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60696 
2015-03-13 10:08:52,769 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742002_1178 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60696 
2015-03-13 10:08:52,769 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742000_1176 127.0.0.1:60686 127.0.0.1:60693 127.0.0.1:60696 
2015-03-13 10:08:52,769 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015	dst=null	perm=null
2015-03-13 10:08:52,796 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741992_1168 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60693 
2015-03-13 10:08:52,797 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-soberoi/2463283610_lower_upper_7CE7EFE8013A4AD39F74615BC414DB0A	dst=null	perm=null
2015-03-13 10:08:52,797 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin	dst=null	perm=null
2015-03-13 10:08:52,798 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin/_temporary
2015-03-13 10:08:52,798 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin/_temporary	dst=null	perm=null
2015-03-13 10:08:52,805 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:08:52,806 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:08:52,806 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:08:52,807 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin	dst=null	perm=null
2015-03-13 10:08:52,808 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin	dst=null	perm=null
2015-03-13 10:08:52,808 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin	dst=null	perm=null
2015-03-13 10:08:52,809 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:08:52,809 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin/part-00000	dst=null	perm=null
2015-03-13 10:08:52,811 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62062, bytes: 74, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742001_1177, duration: 214000
2015-03-13 10:08:52,818 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:08:52,818 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:08:52,818 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:08:52,819 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin	dst=null	perm=null
2015-03-13 10:08:52,820 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin	dst=null	perm=null
2015-03-13 10:08:52,820 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin	dst=null	perm=null
2015-03-13 10:08:52,821 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:08:52,822 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin/part-00000	dst=null	perm=null
2015-03-13 10:08:52,823 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62062, bytes: 74, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742001_1177, duration: 172000
2015-03-13 10:08:52,823 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin
2015-03-13 10:08:52,824 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin	dst=null	perm=null
2015-03-13 10:08:52,824 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin	dst=null	perm=null
2015-03-13 10:08:52,825 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin	dst=null	perm=null
2015-03-13 10:08:52,825 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin	dst=null	perm=null
2015-03-13 10:08:52,826 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin/part-00000	dst=null	perm=null
2015-03-13 10:08:52,826 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin/part-00000	dst=null	perm=null
2015-03-13 10:08:52,827 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62062, bytes: 74, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742001_1177, duration: 156000
2015-03-13 10:08:52,828 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt	dst=null	perm=null
2015-03-13 10:08:52,829 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt	dst=null	perm=null
2015-03-13 10:08:52,837 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:08:52,838 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:08:52,838 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:08:52,847 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross	dst=null	perm=null
2015-03-13 10:08:52,848 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lhs*rhs] starting
2015-03-13 10:08:52,848 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lhs*rhs]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt"]
2015-03-13 10:08:52,848 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lhs*rhs]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-03-13 10:08:52,849 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lhs*rhs]  sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross"]
2015-03-13 10:08:52,849 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lhs*rhs]  parallel execution is enabled: true
2015-03-13 10:08:52,849 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lhs*rhs]  starting jobs: 1
2015-03-13 10:08:52,849 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lhs*rhs]  allocating threads: 1
2015-03-13 10:08:52,850 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lhs*rhs] starting step: (1/1) ...ieldedpipesplatform/cross
2015-03-13 10:08:52,859 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:08:52,867 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:08:52,868 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross	dst=null	perm=null
2015-03-13 10:08:52,869 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:08:52,869 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:08:52,871 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 16
2015-03-13 10:08:52,872 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016	dst=null	perm=null
2015-03-13 10:08:52,873 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016	dst=null	perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:08:52,874 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016	dst=null	perm=soberoi:supergroup:rwx------
2015-03-13 10:08:52,874 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.jar	dst=null	perm=null
2015-03-13 10:08:52,876 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:52,877 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073742006_1182{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:08:52,878 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742006_1182 src: /127.0.0.1:62063 dest: /127.0.0.1:60693
2015-03-13 10:08:52,879 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742006_1182 src: /127.0.0.1:62064 dest: /127.0.0.1:60696
2015-03-13 10:08:52,880 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742006_1182 src: /127.0.0.1:62065 dest: /127.0.0.1:60689
2015-03-13 10:08:52,884 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62065, dest: /127.0.0.1:60689, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742006_1182, duration: 2724000
2015-03-13 10:08:52,884 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742006_1182, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:52,885 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742006_1182{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:08:52,885 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62064, dest: /127.0.0.1:60696, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742006_1182, duration: 2629000
2015-03-13 10:08:52,885 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742006_1182, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:52,885 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742006_1182{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:08:52,886 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62063, dest: /127.0.0.1:60693, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742006_1182, duration: 3570000
2015-03-13 10:08:52,886 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742006_1182, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:52,887 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742006_1182{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:08:52,888 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:08:52,888 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.jar
2015-03-13 10:08:52,889 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.jar	dst=null	perm=null
2015-03-13 10:08:52,889 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:52,890 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:08:52,891 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:08:52,891 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:08:52,892 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:08:52,892 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:08:52,893 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:08:52,893 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:08:52,894 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:08:52,894 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:08:52,896 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt	dst=null	perm=null
2015-03-13 10:08:52,896 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:08:52,897 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt	dst=null	perm=null
2015-03-13 10:08:52,898 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:52,900 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:52,900 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.split
2015-03-13 10:08:52,901 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.split	dst=null	perm=null
2015-03-13 10:08:52,902 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073742007_1183{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:08:52,904 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742007_1183 src: /127.0.0.1:62066 dest: /127.0.0.1:60689
2015-03-13 10:08:52,905 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742007_1183 src: /127.0.0.1:62067 dest: /127.0.0.1:60693
2015-03-13 10:08:52,906 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742007_1183 src: /127.0.0.1:62068 dest: /127.0.0.1:60686
2015-03-13 10:08:52,908 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742007_1183 src: /127.0.0.1:62069 dest: /127.0.0.1:60696
2015-03-13 10:08:52,910 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62069, dest: /127.0.0.1:60696, bytes: 1419, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742007_1183, duration: 1459000
2015-03-13 10:08:52,911 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742007_1183, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:52,911 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742007_1183{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:52,911 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62068, dest: /127.0.0.1:60686, bytes: 1419, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742007_1183, duration: 1845000
2015-03-13 10:08:52,911 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742007_1183, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:52,912 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742007_1183{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:52,912 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62067, dest: /127.0.0.1:60693, bytes: 1419, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742007_1183, duration: 2639000
2015-03-13 10:08:52,912 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742007_1183, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:52,912 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742007_1183{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:52,913 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62066, dest: /127.0.0.1:60689, bytes: 1419, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742007_1183, duration: 3524000
2015-03-13 10:08:52,913 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742007_1183, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:52,916 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742007_1183{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:52,917 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:08:52,919 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:52,921 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:52,922 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073742008_1184{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:08:52,923 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742008_1184 src: /127.0.0.1:62070 dest: /127.0.0.1:60696
2015-03-13 10:08:52,924 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742008_1184 src: /127.0.0.1:62071 dest: /127.0.0.1:60689
2015-03-13 10:08:52,925 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742007_1183
2015-03-13 10:08:52,926 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742008_1184 src: /127.0.0.1:62072 dest: /127.0.0.1:60686
2015-03-13 10:08:52,926 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742002_1178
2015-03-13 10:08:52,927 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742005_1181
2015-03-13 10:08:52,928 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62072, dest: /127.0.0.1:60686, bytes: 148, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742008_1184, duration: 1067000
2015-03-13 10:08:52,928 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742008_1184, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:52,928 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742008_1184{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:08:52,928 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62071, dest: /127.0.0.1:60689, bytes: 148, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742008_1184, duration: 1219000
2015-03-13 10:08:52,929 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742008_1184, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:52,929 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742008_1184{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:08:52,929 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62070, dest: /127.0.0.1:60696, bytes: 148, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742008_1184, duration: 2205000
2015-03-13 10:08:52,930 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742008_1184, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:52,930 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742008_1184{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:08:52,931 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:08:52,931 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:4
2015-03-13 10:08:52,933 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:52,934 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:52,935 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:08:52,935 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:08:52,935 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:08:52,939 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742009_1185{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:08:52,940 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742009_1185 src: /127.0.0.1:62073 dest: /127.0.0.1:60689
2015-03-13 10:08:52,941 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742009_1185 src: /127.0.0.1:62074 dest: /127.0.0.1:60693
2015-03-13 10:08:52,942 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742009_1185 src: /127.0.0.1:62075 dest: /127.0.0.1:60696
2015-03-13 10:08:52,945 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62075, dest: /127.0.0.1:60696, bytes: 97486, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742009_1185, duration: 1595000
2015-03-13 10:08:52,945 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742009_1185, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:52,945 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742009_1185{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:52,945 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62074, dest: /127.0.0.1:60693, bytes: 97486, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742009_1185, duration: 2109000
2015-03-13 10:08:52,946 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742009_1185, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:52,946 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742009_1185{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:52,946 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62073, dest: /127.0.0.1:60689, bytes: 97486, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742009_1185, duration: 2815000
2015-03-13 10:08:52,947 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742009_1185, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:52,948 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742009_1185{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:52,949 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:08:52,949 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0016
2015-03-13 10:08:52,951 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016	dst=null	perm=null
2015-03-13 10:08:52,953 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.xml	dst=null	perm=null
2015-03-13 10:08:52,954 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.xml	dst=null	perm=null
2015-03-13 10:08:52,955 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.jar	dst=null	perm=null
2015-03-13 10:08:52,955 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.jar	dst=null	perm=null
2015-03-13 10:08:52,956 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.split	dst=null	perm=null
2015-03-13 10:08:52,957 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.split	dst=null	perm=null
2015-03-13 10:08:52,958 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:08:52,958 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:08:52,969 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:08:52,970 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:08:52,971 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:08:52,972 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:08:52,973 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:08:52,973 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:08:52,975 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 16 submitted by user soberoi
2015-03-13 10:08:52,975 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0016
2015-03-13 10:08:52,975 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	IP=10.1.1.144	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1426266260362_0016
2015-03-13 10:08:52,975 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0016
2015-03-13 10:08:52,975 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0016 State change from NEW to NEW_SAVING
2015-03-13 10:08:52,976 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0016 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:08:52,976 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0016_000001
2015-03-13 10:08:52,976 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0016_000001 State change from NEW to SUBMITTED
2015-03-13 10:08:52,976 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0016 from user: soberoi activated in queue: default
2015-03-13 10:08:52,976 INFO  capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0016 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:08:52,976 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0016 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:08:52,977 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0016_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:08:52,977 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0016 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:08:52,977 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0016_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:08:52,977 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0016 State change from SUBMITTED to ACCEPTED
2015-03-13 10:08:52,979 INFO  mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0016/
2015-03-13 10:08:52,979 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lhs*rhs] submitted hadoop job: job_1426266260362_0016
2015-03-13 10:08:52,979 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lhs*rhs] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0016/
2015-03-13 10:08:53,139 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0016_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:08:53,139 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0016	CONTAINERID=container_1426266260362_0016_01_000001
2015-03-13 10:08:53,139 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0016_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:08:53,139 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0016 container=Container: [ContainerId: container_1426266260362_0016_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0016_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:53,140 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:08:53,140 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0016_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:08:53,140 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:53,141 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0016 AttemptId: appattempt_1426266260362_0016_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0016_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ]
2015-03-13 10:08:53,141 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0016_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:08:53,141 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0016_000001
2015-03-13 10:08:53,141 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0016_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:08:53,142 INFO  amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0016_000001
2015-03-13 10:08:53,142 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0016_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] for AM appattempt_1426266260362_0016_000001
2015-03-13 10:08:53,142 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0016_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-03-13 10:08:53,145 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0016_000001 (auth:SIMPLE)
2015-03-13 10:08:53,146 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0016_01_000001 by user soberoi
2015-03-13 10:08:53,146 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0016
2015-03-13 10:08:53,146 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0016	CONTAINERID=container_1426266260362_0016_01_000001
2015-03-13 10:08:53,147 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0016 transitioned from NEW to INITING
2015-03-13 10:08:53,147 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0016_01_000001 to application application_1426266260362_0016
2015-03-13 10:08:53,147 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0016 transitioned from INITING to RUNNING
2015-03-13 10:08:53,147 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0016_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] for AM appattempt_1426266260362_0016_000001
2015-03-13 10:08:53,147 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0016_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:08:53,147 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0016_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:08:53,147 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0016
2015-03-13 10:08:53,148 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:08:53,148 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:08:53,148 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:08:53,148 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:08:53,148 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0016_01_000001
2015-03-13 10:08:53,158 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426266260362_0016_01_000001.tokens. Credentials list: 
2015-03-13 10:08:53,174 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:08:53,244 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426266260362_0016_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0016/container_1426266260362_0016_01_000001.tokens
2015-03-13 10:08:53,244 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0016 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0016
2015-03-13 10:08:53,307 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.jar	dst=null	perm=null
2015-03-13 10:08:53,308 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.jar	dst=null	perm=null
2015-03-13 10:08:53,309 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.jar	dst=null	perm=null
2015-03-13 10:08:53,310 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742004_1180
2015-03-13 10:08:53,310 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742008_1184
2015-03-13 10:08:53,311 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742002_1178
2015-03-13 10:08:53,312 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742005_1181
2015-03-13 10:08:53,312 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742003_1179
2015-03-13 10:08:53,312 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742007_1183
2015-03-13 10:08:53,312 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742001_1177
2015-03-13 10:08:53,313 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742009_1185
2015-03-13 10:08:53,316 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62062, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1879701091_8313, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742006_1182, duration: 487000
2015-03-13 10:08:53,334 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:08:53,359 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:08:53,360 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:08:53,361 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:08:53,367 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62079, bytes: 152, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1879701091_8313, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742008_1184, duration: 167000
2015-03-13 10:08:53,379 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:08:53,395 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.split	dst=null	perm=null
2015-03-13 10:08:53,396 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.split	dst=null	perm=null
2015-03-13 10:08:53,396 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.split	dst=null	perm=null
2015-03-13 10:08:53,402 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62062, bytes: 1431, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1879701091_8313, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742007_1183, duration: 177000
2015-03-13 10:08:53,415 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:08:53,430 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.xml	dst=null	perm=null
2015-03-13 10:08:53,431 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.xml	dst=null	perm=null
2015-03-13 10:08:53,431 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.xml	dst=null	perm=null
2015-03-13 10:08:53,437 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62079, bytes: 98250, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1879701091_8313, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742009_1185, duration: 274000
2015-03-13 10:08:53,449 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:08:53,449 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0016_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:08:53,474 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0016_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:08:53,475 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:53,499 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 15 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:53,513 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742006_1182
2015-03-13 10:08:53,541 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0016/container_1426266260362_0016_01_000001/default_container_executor.sh]
2015-03-13 10:08:54,139 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:54,139 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0016_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:08:54,504 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 15 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:54,860 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60689 to replicate blk_1073742006_1182 to datanode(s) 127.0.0.1:60686
2015-03-13 10:08:54,860 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073742000_1176, blk_1073742002_1178, blk_1073741992_1168, blk_1073741996_1172, blk_1073741997_1173, blk_1073741998_1174, blk_1073741999_1175]
2015-03-13 10:08:54,860 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073742000_1176, blk_1073741992_1168, blk_1073741996_1172, blk_1073741997_1173, blk_1073741998_1174, blk_1073741999_1175]
2015-03-13 10:08:55,115 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:08:55,135 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/COMMIT_STARTED	dst=null	perm=null
2015-03-13 10:08:55,136 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/COMMIT_SUCCESS	dst=null	perm=null
2015-03-13 10:08:55,137 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/COMMIT_FAIL	dst=null	perm=null
2015-03-13 10:08:55,144 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:55,188 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016	dst=null	perm=null
2015-03-13 10:08:55,189 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:08:55,190 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:08:55,468 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:08:55,475 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:08:55,483 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742000_1176 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742000 for deletion
2015-03-13 10:08:55,483 INFO  datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-1172757413-10.1.1.144-60689-1426266259165, infoPort=60690, ipcPort=60692, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073742006_1182 to 127.0.0.1:60686 
2015-03-13 10:08:55,483 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742002_1178 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742002 for deletion
2015-03-13 10:08:55,483 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742000_1176 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742000
2015-03-13 10:08:55,483 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741992_1168 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741992 for deletion
2015-03-13 10:08:55,484 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741996_1172 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741996 for deletion
2015-03-13 10:08:55,484 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741997_1173 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741997 for deletion
2015-03-13 10:08:55,484 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741998_1174 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741998 for deletion
2015-03-13 10:08:55,484 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741999_1175 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741999 for deletion
2015-03-13 10:08:55,484 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742002_1178 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742002
2015-03-13 10:08:55,484 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741992_1168 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741992
2015-03-13 10:08:55,485 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741997_1173 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741997
2015-03-13 10:08:55,485 INFO  datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073742006_1182 (numBytes=254067) to /127.0.0.1:60686
2015-03-13 10:08:55,485 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741999_1175 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741999
2015-03-13 10:08:55,485 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742006_1182 src: /127.0.0.1:62081 dest: /127.0.0.1:60686
2015-03-13 10:08:55,485 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741996_1172 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741996
2015-03-13 10:08:55,485 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741998_1174 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741998
2015-03-13 10:08:55,487 INFO  datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073742006_1182 src: /127.0.0.1:62081 dest: /127.0.0.1:60686 of size 254067
2015-03-13 10:08:55,487 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742006_1182 size 254067
2015-03-13 10:08:55,508 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 15 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:55,536 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62082, bytes: 152, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-494706022_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742008_1184, duration: 186000
2015-03-13 10:08:55,657 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742000_1176 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742000 for deletion
2015-03-13 10:08:55,657 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741992_1168 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741992 for deletion
2015-03-13 10:08:55,657 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741996_1172 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741996 for deletion
2015-03-13 10:08:55,657 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742000_1176 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742000
2015-03-13 10:08:55,657 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741997_1173 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741997 for deletion
2015-03-13 10:08:55,657 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741998_1174 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741998 for deletion
2015-03-13 10:08:55,658 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741999_1175 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741999 for deletion
2015-03-13 10:08:55,658 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741997_1173 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741997
2015-03-13 10:08:55,658 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741992_1168 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741992
2015-03-13 10:08:55,658 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741996_1172 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741996
2015-03-13 10:08:55,658 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741999_1175 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741999
2015-03-13 10:08:55,658 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741998_1174 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741998
2015-03-13 10:08:56,149 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:56,290 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0016_000001 (auth:SIMPLE)
2015-03-13 10:08:56,292 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0016_000001
2015-03-13 10:08:56,292 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi	IP=10.1.1.144	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1426266260362_0016	APPATTEMPTID=appattempt_1426266260362_0016_000001
2015-03-13 10:08:56,292 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0016_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:08:56,292 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0016 State change from ACCEPTED to RUNNING
2015-03-13 10:08:56,311 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job_1426266260362_0016_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:56,315 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:08:56,380 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job_1426266260362_0016_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:56,506 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job_1426266260362_0016_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742010_1186{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:08:56,511 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 15 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:56,544 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742010_1186 src: /127.0.0.1:62088 dest: /127.0.0.1:60696
2015-03-13 10:08:56,546 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742010_1186 src: /127.0.0.1:62089 dest: /127.0.0.1:60689
2015-03-13 10:08:56,547 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742010_1186 src: /127.0.0.1:62090 dest: /127.0.0.1:60693
2015-03-13 10:08:56,556 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62090, dest: /127.0.0.1:60693, bytes: 90307, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-494706022_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742010_1186, duration: 6782000
2015-03-13 10:08:56,556 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742010_1186, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:56,557 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62089, dest: /127.0.0.1:60689, bytes: 90307, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-494706022_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742010_1186, duration: 7637000
2015-03-13 10:08:56,557 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742010_1186{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:56,557 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742010_1186, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:56,558 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62088, dest: /127.0.0.1:60696, bytes: 90307, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-494706022_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742010_1186, duration: 8661000
2015-03-13 10:08:56,558 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742010_1186, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:56,559 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742010_1186{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:56,559 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742010_1186{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:56,562 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job_1426266260362_0016_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-494706022_1
2015-03-13 10:08:57,153 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:57,370 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742007_1183
2015-03-13 10:08:57,371 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742009_1185
2015-03-13 10:08:57,372 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742006_1182
2015-03-13 10:08:57,516 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 15 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:57,517 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0016_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:08:57,517 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0016	CONTAINERID=container_1426266260362_0016_01_000002
2015-03-13 10:08:57,517 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0016_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:08:57,518 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0016 container=Container: [ContainerId: container_1426266260362_0016_01_000002, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0016_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:57,518 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:08:57,518 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:57,519 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0016_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:08:57,519 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0016	CONTAINERID=container_1426266260362_0016_01_000003
2015-03-13 10:08:57,519 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0016_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:08:57,519 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0016 container=Container: [ContainerId: container_1426266260362_0016_01_000003, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0016_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:57,519 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:08:57,519 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:57,520 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0016_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:08:57,520 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0016	CONTAINERID=container_1426266260362_0016_01_000004
2015-03-13 10:08:57,520 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0016_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:08:57,520 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0016 container=Container: [ContainerId: container_1426266260362_0016_01_000004, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0016_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:57,521 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:08:57,521 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:57,521 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0016_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:08:57,521 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0016	CONTAINERID=container_1426266260362_0016_01_000005
2015-03-13 10:08:57,521 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0016_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:08:57,521 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0016 container=Container: [ContainerId: container_1426266260362_0016_01_000005, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0016_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:57,521 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:08:57,522 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:57,575 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742010_1186
2015-03-13 10:08:57,575 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742008_1184
2015-03-13 10:08:57,756 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742009_1185
2015-03-13 10:08:57,756 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742007_1183
2015-03-13 10:08:57,758 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742010_1186
2015-03-13 10:08:57,864 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073742000_1176, blk_1073742002_1178, blk_1073741992_1168, blk_1073741996_1172, blk_1073741997_1173, blk_1073741999_1175]
2015-03-13 10:08:57,864 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073742002_1178, blk_1073741996_1172, blk_1073741997_1173, blk_1073741998_1174]
2015-03-13 10:08:57,898 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0015_01_000001 succeeded 
2015-03-13 10:08:57,898 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0015_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:08:57,898 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0015_01_000001
2015-03-13 10:08:57,906 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0015/container_1426266260362_0015_01_000001
2015-03-13 10:08:57,906 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0015/container_1426266260362_0015_01_000001
2015-03-13 10:08:57,906 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0015	CONTAINERID=container_1426266260362_0015_01_000001
2015-03-13 10:08:57,906 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0015_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:08:57,906 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0015_01_000001 from application application_1426266260362_0015
2015-03-13 10:08:57,906 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:57,906 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0015
2015-03-13 10:08:57,906 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0015/container_1426266260362_0015_01_000001
2015-03-13 10:08:57,906 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0015/container_1426266260362_0015_01_000001
2015-03-13 10:08:57,936 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742006_1182
2015-03-13 10:08:57,936 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742008_1184
2015-03-13 10:08:57,959 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742006_1182
2015-03-13 10:08:58,154 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:58,326 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0016_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:08:58,326 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0016_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:08:58,326 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0016_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:08:58,326 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0016_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:08:58,352 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.jar	dst=null	perm=null
2015-03-13 10:08:58,352 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.jar	dst=null	perm=null
2015-03-13 10:08:58,361 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.xml	dst=null	perm=null
2015-03-13 10:08:58,362 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.xml	dst=null	perm=null
2015-03-13 10:08:58,364 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:08:58,366 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:08:58,371 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:08:58,372 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:08:58,373 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:08:58,374 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:08:58,447 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0016_000001 (auth:SIMPLE)
2015-03-13 10:08:58,449 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0016_01_000002 by user soberoi
2015-03-13 10:08:58,449 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0016_01_000004 by user soberoi
2015-03-13 10:08:58,450 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0016
2015-03-13 10:08:58,450 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0016	CONTAINERID=container_1426266260362_0016_01_000004
2015-03-13 10:08:58,449 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0016_01_000005 by user soberoi
2015-03-13 10:08:58,449 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0016_01_000003 by user soberoi
2015-03-13 10:08:58,450 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0016	CONTAINERID=container_1426266260362_0016_01_000005
2015-03-13 10:08:58,450 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0016	CONTAINERID=container_1426266260362_0016_01_000002
2015-03-13 10:08:58,450 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0016_01_000004 to application application_1426266260362_0016
2015-03-13 10:08:58,451 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0016 transitioned from NEW to INITING
2015-03-13 10:08:58,450 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0016	CONTAINERID=container_1426266260362_0016_01_000003
2015-03-13 10:08:58,451 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0016_01_000002 to application application_1426266260362_0016
2015-03-13 10:08:58,451 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0016_01_000005 to application application_1426266260362_0016
2015-03-13 10:08:58,451 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0016_01_000003 to application application_1426266260362_0016
2015-03-13 10:08:58,451 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0016 transitioned from INITING to RUNNING
2015-03-13 10:08:58,451 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0016_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:08:58,452 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0016_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:08:58,452 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0016_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:08:58,452 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0016_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:08:58,452 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0016
2015-03-13 10:08:58,452 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0016
2015-03-13 10:08:58,452 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:08:58,452 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0016
2015-03-13 10:08:58,453 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:08:58,453 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:08:58,453 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0016
2015-03-13 10:08:58,453 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0016
2015-03-13 10:08:58,453 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:08:58,453 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0016
2015-03-13 10:08:58,453 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0016
2015-03-13 10:08:58,453 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0016
2015-03-13 10:08:58,453 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:08:58,453 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0016
2015-03-13 10:08:58,454 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0016
2015-03-13 10:08:58,454 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0016
2015-03-13 10:08:58,454 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:08:58,454 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0016
2015-03-13 10:08:58,454 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0016_01_000002
2015-03-13 10:08:58,455 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0016_01_000004
2015-03-13 10:08:58,456 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0016_01_000003
2015-03-13 10:08:58,457 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0016_01_000005
2015-03-13 10:08:58,473 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1426266260362_0016_01_000004.tokens. Credentials list: 
2015-03-13 10:08:58,474 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1426266260362_0016_01_000002.tokens. Credentials list: 
2015-03-13 10:08:58,474 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0016_01_000005.tokens. Credentials list: 
2015-03-13 10:08:58,474 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1426266260362_0016_01_000003.tokens. Credentials list: 
2015-03-13 10:08:58,486 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742002_1178 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742002 for deletion
2015-03-13 10:08:58,486 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741996_1172 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741996 for deletion
2015-03-13 10:08:58,486 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741997_1173 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741997 for deletion
2015-03-13 10:08:58,486 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741998_1174 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741998 for deletion
2015-03-13 10:08:58,486 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742002_1178 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742002
2015-03-13 10:08:58,486 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741996_1172 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741996
2015-03-13 10:08:58,486 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741998_1174 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741998
2015-03-13 10:08:58,487 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741997_1173 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741997
2015-03-13 10:08:58,489 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:08:58,516 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742010_1186
2015-03-13 10:08:58,517 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:58,517 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 15 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:08:58,517 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:58,517 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0015_01_000001
2015-03-13 10:08:58,518 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:58,518 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:58,518 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0015_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:08:58,518 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0015_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:08:58,518 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0015	CONTAINERID=container_1426266260362_0015_01_000001
2015-03-13 10:08:58,518 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0015_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60719, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:08:58,518 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0015_000001
2015-03-13 10:08:58,518 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0015_000001 State change from FINISHING to FINISHED
2015-03-13 10:08:58,518 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:08:58,519 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0015 State change from FINISHING to FINISHED
2015-03-13 10:08:58,519 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0015_01_000001, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:58,519 INFO  amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0015_000001
2015-03-13 10:08:58,519 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1426266260362_0015
2015-03-13 10:08:58,519 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0015,name=[6DC799D3695A41EDB24861BDF4BA2FF4/3066B2C3CE37414884C03F0C08B36832] lower*upper*joined/(1/2) ...splatform/joingroupbyjoin,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0015/jobhistory/job/job_1426266260362_0015,appMasterHost=Edinburgh.local,startTime=1426266523400,finishTime=1426266531762,finalStatus=SUCCEEDED
2015-03-13 10:08:58,519 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:58,519 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=5
2015-03-13 10:08:58,519 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0015_000001 released container container_1426266260362_0015_01_000001 on node: host: 10.1.1.144:60719 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:08:58,519 INFO  capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0015_000001 is done. finalState=FINISHED
2015-03-13 10:08:58,520 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0015 requests cleared
2015-03-13 10:08:58,520 INFO  capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0015 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:08:58,520 INFO  capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0015 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:08:58,520 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0016_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:08:58,520 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0016_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:08:58,520 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0016_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:08:58,520 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0016_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:08:58,522 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0015_000001 (auth:SIMPLE)
2015-03-13 10:08:58,523 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0015_01_000001
2015-03-13 10:08:58,560 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1426266260362_0016_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0016/container_1426266260362_0016_01_000004.tokens
2015-03-13 10:08:58,560 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0016 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0016
2015-03-13 10:08:58,610 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0015 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:08:58,611 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0015
2015-03-13 10:08:58,611 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0015
2015-03-13 10:08:58,611 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0015 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:08:58,611 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0015, with delay of 10800 seconds
2015-03-13 10:08:58,611 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0015
2015-03-13 10:08:58,611 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0015
2015-03-13 10:08:58,612 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0015
2015-03-13 10:08:58,623 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.jar	dst=null	perm=null
2015-03-13 10:08:58,624 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.jar	dst=null	perm=null
2015-03-13 10:08:58,625 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.jar	dst=null	perm=null
2015-03-13 10:08:58,631 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62095, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1949850480_8425, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742006_1182, duration: 465000
2015-03-13 10:08:58,651 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:08:58,667 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.xml	dst=null	perm=null
2015-03-13 10:08:58,668 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.xml	dst=null	perm=null
2015-03-13 10:08:58,668 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.xml	dst=null	perm=null
2015-03-13 10:08:58,674 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62096, bytes: 98250, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1949850480_8425, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742009_1185, duration: 277000
2015-03-13 10:08:58,686 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:08:58,686 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0016_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:08:58,687 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0016_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:08:58,687 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0016_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:08:58,687 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0016_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:08:58,727 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0016_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:08:58,727 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:58,727 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0016_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:08:58,727 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:58,732 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0016_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:08:58,733 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:58,733 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0016_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:08:58,733 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:58,840 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0016/container_1426266260362_0016_01_000004/default_container_executor.sh]
2015-03-13 10:08:58,840 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0016/container_1426266260362_0016_01_000002/default_container_executor.sh]
2015-03-13 10:08:58,847 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0016/container_1426266260362_0016_01_000005/default_container_executor.sh]
2015-03-13 10:08:58,847 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0016/container_1426266260362_0016_01_000003/default_container_executor.sh]
2015-03-13 10:08:58,857 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742000_1176 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742000 for deletion
2015-03-13 10:08:58,857 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742002_1178 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742002 for deletion
2015-03-13 10:08:58,857 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741992_1168 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741992 for deletion
2015-03-13 10:08:58,857 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741996_1172 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741996 for deletion
2015-03-13 10:08:58,858 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741997_1173 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741997 for deletion
2015-03-13 10:08:58,858 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741999_1175 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741999 for deletion
2015-03-13 10:08:58,858 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742000_1176 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742000
2015-03-13 10:08:58,858 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742002_1178 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742002
2015-03-13 10:08:58,858 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741992_1168 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741992
2015-03-13 10:08:58,858 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741996_1172 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741996
2015-03-13 10:08:58,859 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741999_1175 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741999
2015-03-13 10:08:58,858 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741997_1173 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741997
2015-03-13 10:08:59,155 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:59,341 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:08:59,519 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:59,519 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0015 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:08:59,519 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:59,519 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0015
2015-03-13 10:08:59,519 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0015
2015-03-13 10:08:59,519 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:59,520 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0015
2015-03-13 10:08:59,520 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0015 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:08:59,520 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0015
2015-03-13 10:08:59,519 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0015
2015-03-13 10:08:59,520 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0015, with delay of 10800 seconds
2015-03-13 10:08:59,520 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:59,715 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:08:59,830 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1426266260362_0016_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0016/container_1426266260362_0016_01_000003.tokens
2015-03-13 10:08:59,830 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0016 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0016
2015-03-13 10:08:59,937 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:09:00,076 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0016_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0016/container_1426266260362_0016_01_000005.tokens
2015-03-13 10:09:00,077 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0016 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0016
2015-03-13 10:09:00,157 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:00,178 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:09:00,308 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1426266260362_0016_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0016/container_1426266260362_0016_01_000002.tokens
2015-03-13 10:09:00,309 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0016 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0016
2015-03-13 10:09:00,524 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:00,525 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:00,525 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:00,525 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:01,158 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:01,528 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:01,528 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:01,528 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:01,529 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:02,160 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:02,531 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:02,531 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:02,532 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:02,532 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:03,164 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:03,532 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:03,533 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:03,533 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:03,533 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:04,167 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:04,537 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:04,537 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:04,537 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:04,537 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:05,003 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.split	dst=null	perm=null
2015-03-13 10:09:05,091 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.split	dst=null	perm=null
2015-03-13 10:09:05,153 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62107, bytes: 399, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0016_m_000003_0_363385392_1, offset: 1024, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742007_1183, duration: 128000
2015-03-13 10:09:05,169 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:05,253 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.split	dst=null	perm=null
2015-03-13 10:09:05,275 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62109, bytes: 1431, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0016_m_000001_0_-1252421238_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742007_1183, duration: 151000
2015-03-13 10:09:05,302 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.split	dst=null	perm=null
2015-03-13 10:09:05,341 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt	dst=null	perm=null
2015-03-13 10:09:05,345 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62111, bytes: 56, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0016_m_000003_0_363385392_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741912_1088, duration: 176000
2015-03-13 10:09:05,367 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/_temporary/attempt_1426266260362_0016_m_000003_0/part-00003	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:05,404 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62112, bytes: 915, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0016_m_000002_0_-1227443263_1, offset: 512, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742007_1183, duration: 156000
2015-03-13 10:09:05,417 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt	dst=null	perm=null
2015-03-13 10:09:05,421 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62114, bytes: 56, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0016_m_000001_0_-1252421238_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741912_1088, duration: 156000
2015-03-13 10:09:05,442 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/_temporary/attempt_1426266260362_0016_m_000001_0/part-00001	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:05,446 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62113, bytes: 1431, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0016_m_000000_0_1697196325_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742007_1183, duration: 169000
2015-03-13 10:09:05,525 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt	dst=null	perm=null
2015-03-13 10:09:05,529 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62115, bytes: 56, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0016_m_000002_0_-1227443263_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741912_1088, duration: 154000
2015-03-13 10:09:05,542 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:05,542 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:05,543 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:05,543 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:05,548 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/_temporary/attempt_1426266260362_0016_m_000002_0/part-00002	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:05,577 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt	dst=null	perm=null
2015-03-13 10:09:05,595 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/_temporary/attempt_1426266260362_0016_m_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:05,698 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt	dst=null	perm=null
2015-03-13 10:09:05,707 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt	dst=null	perm=null
2015-03-13 10:09:05,713 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt	dst=null	perm=null
2015-03-13 10:09:05,717 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62107, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0016_m_000003_0_363385392_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741913_1089, duration: 148000
2015-03-13 10:09:05,766 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/_temporary/attempt_1426266260362_0016_m_000003_0/part-00003. BP-1005356445-10.1.1.144-1426266257849 blk_1073742011_1187{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:09:05,797 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt	dst=null	perm=null
2015-03-13 10:09:05,806 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt	dst=null	perm=null
2015-03-13 10:09:05,808 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742011_1187 src: /127.0.0.1:62116 dest: /127.0.0.1:60689
2015-03-13 10:09:05,809 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt	dst=null	perm=null
2015-03-13 10:09:05,810 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742011_1187 src: /127.0.0.1:62117 dest: /127.0.0.1:60686
2015-03-13 10:09:05,811 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742011_1187 src: /127.0.0.1:62118 dest: /127.0.0.1:60696
2015-03-13 10:09:05,815 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62109, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0016_m_000001_0_-1252421238_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741913_1089, duration: 135000
2015-03-13 10:09:05,819 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62118, dest: /127.0.0.1:60696, bytes: 72, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0016_m_000003_0_363385392_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742011_1187, duration: 6640000
2015-03-13 10:09:05,820 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742011_1187, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:05,820 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742011_1187{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:05,820 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62117, dest: /127.0.0.1:60686, bytes: 72, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0016_m_000003_0_363385392_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742011_1187, duration: 7527000
2015-03-13 10:09:05,821 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742011_1187, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:05,821 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742011_1187{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:05,821 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62116, dest: /127.0.0.1:60689, bytes: 72, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0016_m_000003_0_363385392_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742011_1187, duration: 8390000
2015-03-13 10:09:05,821 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742011_1187, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:05,822 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742011_1187{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:05,826 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/_temporary/attempt_1426266260362_0016_m_000003_0/part-00003 is closed by DFSClient_attempt_1426266260362_0016_m_000003_0_363385392_1
2015-03-13 10:09:05,835 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/_temporary/attempt_1426266260362_0016_m_000003_0	dst=null	perm=null
2015-03-13 10:09:05,841 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/_temporary/attempt_1426266260362_0016_m_000003_0	dst=null	perm=null
2015-03-13 10:09:05,842 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/task_1426266260362_0016_m_000003	dst=null	perm=null
2015-03-13 10:09:05,846 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/_temporary/attempt_1426266260362_0016_m_000003_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/task_1426266260362_0016_m_000003	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:09:05,848 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/_temporary/attempt_1426266260362_0016_m_000001_0/part-00001. BP-1005356445-10.1.1.144-1426266257849 blk_1073742012_1188{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:09:05,867 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0016_01_000005
2015-03-13 10:09:05,867 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0016	CONTAINERID=container_1426266260362_0016_01_000005
2015-03-13 10:09:05,867 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0016_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:09:05,867 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0016_01_000005
2015-03-13 10:09:05,867 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:05,867 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:05,868 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:05,868 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:09:05,880 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0016_01_000005 is : 143
2015-03-13 10:09:05,882 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job_1426266260362_0016_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073742013_1189{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:09:05,884 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742013_1189 src: /127.0.0.1:62120 dest: /127.0.0.1:60686
2015-03-13 10:09:05,885 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742013_1189 src: /127.0.0.1:62121 dest: /127.0.0.1:60696
2015-03-13 10:09:05,887 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742013_1189 src: /127.0.0.1:62122 dest: /127.0.0.1:60693
2015-03-13 10:09:05,891 INFO  hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job_1426266260362_0016_1.jhist for DFSClient_NONMAPREDUCE_-494706022_1
2015-03-13 10:09:05,894 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0016_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:09:05,895 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0016/container_1426266260362_0016_01_000005
2015-03-13 10:09:05,895 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0016/container_1426266260362_0016_01_000005
2015-03-13 10:09:05,895 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0016/container_1426266260362_0016_01_000005
2015-03-13 10:09:05,895 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0016/container_1426266260362_0016_01_000005
2015-03-13 10:09:05,896 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0016	CONTAINERID=container_1426266260362_0016_01_000005
2015-03-13 10:09:05,896 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0016_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:09:05,896 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0016_01_000005 from application application_1426266260362_0016
2015-03-13 10:09:05,896 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:05,896 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0016
2015-03-13 10:09:05,915 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742012_1188 src: /127.0.0.1:62119 dest: /127.0.0.1:60686
2015-03-13 10:09:05,917 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742012_1188 src: /127.0.0.1:62123 dest: /127.0.0.1:60693
2015-03-13 10:09:05,918 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742012_1188 src: /127.0.0.1:62124 dest: /127.0.0.1:60689
2015-03-13 10:09:05,928 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62124, dest: /127.0.0.1:60689, bytes: 56, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0016_m_000001_0_-1252421238_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742012_1188, duration: 8117000
2015-03-13 10:09:05,928 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742012_1188, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:05,929 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742012_1188{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:09:05,929 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62123, dest: /127.0.0.1:60693, bytes: 56, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0016_m_000001_0_-1252421238_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742012_1188, duration: 8935000
2015-03-13 10:09:05,929 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742012_1188, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:05,930 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742012_1188{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:09:05,930 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62119, dest: /127.0.0.1:60686, bytes: 56, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0016_m_000001_0_-1252421238_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742012_1188, duration: 9703000
2015-03-13 10:09:05,930 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742012_1188, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:05,930 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742012_1188{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:09:05,935 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/_temporary/attempt_1426266260362_0016_m_000001_0/part-00001 is closed by DFSClient_attempt_1426266260362_0016_m_000001_0_-1252421238_1
2015-03-13 10:09:05,942 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt	dst=null	perm=null
2015-03-13 10:09:05,943 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/_temporary/attempt_1426266260362_0016_m_000001_0	dst=null	perm=null
2015-03-13 10:09:05,949 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/_temporary/attempt_1426266260362_0016_m_000001_0	dst=null	perm=null
2015-03-13 10:09:05,951 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/task_1426266260362_0016_m_000001	dst=null	perm=null
2015-03-13 10:09:05,953 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt	dst=null	perm=null
2015-03-13 10:09:05,954 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/_temporary/attempt_1426266260362_0016_m_000001_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/task_1426266260362_0016_m_000001	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:09:05,957 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt	dst=null	perm=null
2015-03-13 10:09:05,961 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62112, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0016_m_000002_0_-1227443263_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741913_1089, duration: 151000
2015-03-13 10:09:05,965 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0016_01_000003
2015-03-13 10:09:05,965 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0016	CONTAINERID=container_1426266260362_0016_01_000003
2015-03-13 10:09:05,965 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0016_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:09:05,966 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:05,966 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0016_01_000003
2015-03-13 10:09:05,966 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:09:05,966 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:05,966 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:09:05,966 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0016_01_000005
2015-03-13 10:09:05,967 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0016_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:09:05,967 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0016_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:09:05,967 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0016	CONTAINERID=container_1426266260362_0016_01_000005
2015-03-13 10:09:05,967 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0016_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:09:05,967 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:09:05,967 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0016_01_000005, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:05,967 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:05,967 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:09:05,967 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0016_000001 released container container_1426266260362_0016_01_000005 on node: host: 10.1.1.144:60711 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:09:05,978 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0016_01_000003 is : 143
2015-03-13 10:09:05,991 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0016_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:09:05,992 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0016/container_1426266260362_0016_01_000003
2015-03-13 10:09:05,992 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0016/container_1426266260362_0016_01_000003
2015-03-13 10:09:05,993 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0016/container_1426266260362_0016_01_000003
2015-03-13 10:09:05,993 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0016/container_1426266260362_0016_01_000003
2015-03-13 10:09:05,994 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0016	CONTAINERID=container_1426266260362_0016_01_000003
2015-03-13 10:09:05,994 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0016_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:09:05,994 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0016_01_000003 from application application_1426266260362_0016
2015-03-13 10:09:05,994 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:05,994 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0016
2015-03-13 10:09:06,007 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/_temporary/attempt_1426266260362_0016_m_000002_0/part-00002. BP-1005356445-10.1.1.144-1426266257849 blk_1073742014_1190{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:09:06,049 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742014_1190 src: /127.0.0.1:62125 dest: /127.0.0.1:60693
2015-03-13 10:09:06,050 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742014_1190 src: /127.0.0.1:62126 dest: /127.0.0.1:60689
2015-03-13 10:09:06,052 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742014_1190 src: /127.0.0.1:62127 dest: /127.0.0.1:60696
2015-03-13 10:09:06,059 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62127, dest: /127.0.0.1:60696, bytes: 72, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0016_m_000002_0_-1227443263_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742014_1190, duration: 6342000
2015-03-13 10:09:06,060 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742014_1190, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:06,060 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62126, dest: /127.0.0.1:60689, bytes: 72, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0016_m_000002_0_-1227443263_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742014_1190, duration: 7090000
2015-03-13 10:09:06,060 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742014_1190{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:06,060 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742014_1190, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:06,061 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62125, dest: /127.0.0.1:60693, bytes: 72, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0016_m_000002_0_-1227443263_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742014_1190, duration: 8017000
2015-03-13 10:09:06,061 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742014_1190{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:06,061 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742014_1190{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:06,061 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742014_1190, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:06,063 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt	dst=null	perm=null
2015-03-13 10:09:06,066 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/_temporary/attempt_1426266260362_0016_m_000002_0/part-00002 is closed by DFSClient_attempt_1426266260362_0016_m_000002_0_-1227443263_1
2015-03-13 10:09:06,073 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt	dst=null	perm=null
2015-03-13 10:09:06,075 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/_temporary/attempt_1426266260362_0016_m_000002_0	dst=null	perm=null
2015-03-13 10:09:06,076 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt	dst=null	perm=null
2015-03-13 10:09:06,081 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62128, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0016_m_000000_0_1697196325_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741913_1089, duration: 152000
2015-03-13 10:09:06,082 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/_temporary/attempt_1426266260362_0016_m_000002_0	dst=null	perm=null
2015-03-13 10:09:06,083 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/task_1426266260362_0016_m_000002	dst=null	perm=null
2015-03-13 10:09:06,086 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62129, bytes: 56, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0016_m_000000_0_1697196325_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741912_1088, duration: 147000
2015-03-13 10:09:06,086 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/_temporary/attempt_1426266260362_0016_m_000002_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/task_1426266260362_0016_m_000002	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:09:06,097 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0016_01_000004
2015-03-13 10:09:06,097 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0016	CONTAINERID=container_1426266260362_0016_01_000004
2015-03-13 10:09:06,097 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0016_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:09:06,097 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:06,099 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:09:06,099 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0016_01_000003
2015-03-13 10:09:06,099 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:09:06,099 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0016_01_000004
2015-03-13 10:09:06,099 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0016_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:09:06,100 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0016_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:09:06,100 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0016	CONTAINERID=container_1426266260362_0016_01_000003
2015-03-13 10:09:06,100 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0016_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:09:06,100 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:09:06,100 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0016_01_000003, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:06,100 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:06,100 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:09:06,100 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0016_000001 released container container_1426266260362_0016_01_000003 on node: host: 10.1.1.144:60711 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:09:06,108 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/_temporary/attempt_1426266260362_0016_m_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073742015_1191{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:09:06,112 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0016_01_000004 is : 143
2015-03-13 10:09:06,124 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0016_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:09:06,125 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0016/container_1426266260362_0016_01_000004
2015-03-13 10:09:06,125 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0016/container_1426266260362_0016_01_000004
2015-03-13 10:09:06,126 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0016/container_1426266260362_0016_01_000004
2015-03-13 10:09:06,126 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0016/container_1426266260362_0016_01_000004
2015-03-13 10:09:06,127 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0016	CONTAINERID=container_1426266260362_0016_01_000004
2015-03-13 10:09:06,128 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0016_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:09:06,128 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0016_01_000004 from application application_1426266260362_0016
2015-03-13 10:09:06,128 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:06,128 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0016
2015-03-13 10:09:06,155 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742015_1191 src: /127.0.0.1:62130 dest: /127.0.0.1:60693
2015-03-13 10:09:06,156 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742015_1191 src: /127.0.0.1:62131 dest: /127.0.0.1:60696
2015-03-13 10:09:06,158 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742015_1191 src: /127.0.0.1:62132 dest: /127.0.0.1:60689
2015-03-13 10:09:06,169 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62132, dest: /127.0.0.1:60689, bytes: 96, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0016_m_000000_0_1697196325_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742015_1191, duration: 9808000
2015-03-13 10:09:06,169 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742015_1191, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:06,170 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742015_1191{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:09:06,170 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62131, dest: /127.0.0.1:60696, bytes: 96, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0016_m_000000_0_1697196325_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742015_1191, duration: 10696000
2015-03-13 10:09:06,170 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742015_1191, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:06,170 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742015_1191{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:09:06,171 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62130, dest: /127.0.0.1:60693, bytes: 96, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0016_m_000000_0_1697196325_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742015_1191, duration: 11422000
2015-03-13 10:09:06,171 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742015_1191, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:06,171 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742015_1191{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:09:06,175 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:06,175 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/_temporary/attempt_1426266260362_0016_m_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0016_m_000000_0_1697196325_1
2015-03-13 10:09:06,181 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/_temporary/attempt_1426266260362_0016_m_000000_0	dst=null	perm=null
2015-03-13 10:09:06,187 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/_temporary/attempt_1426266260362_0016_m_000000_0	dst=null	perm=null
2015-03-13 10:09:06,188 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/task_1426266260362_0016_m_000000	dst=null	perm=null
2015-03-13 10:09:06,191 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/_temporary/attempt_1426266260362_0016_m_000000_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/task_1426266260362_0016_m_000000	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:09:06,200 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0016_01_000002
2015-03-13 10:09:06,201 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0016	CONTAINERID=container_1426266260362_0016_01_000002
2015-03-13 10:09:06,201 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0016_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:09:06,201 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:06,201 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:09:06,201 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0016_01_000002
2015-03-13 10:09:06,201 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0016_01_000004
2015-03-13 10:09:06,202 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0016_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:09:06,202 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0016_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:09:06,202 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0016	CONTAINERID=container_1426266260362_0016_01_000004
2015-03-13 10:09:06,202 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0016_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:09:06,202 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:09:06,202 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0016_01_000004, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:06,203 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:06,203 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:09:06,203 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0016_000001 released container container_1426266260362_0016_01_000004 on node: host: 10.1.1.144:60711 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:09:06,205 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:06,207 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-494706022_1
2015-03-13 10:09:06,210 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1	dst=null	perm=null
2015-03-13 10:09:06,217 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0016_01_000002 is : 143
2015-03-13 10:09:06,217 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross	dst=null	perm=null
2015-03-13 10:09:06,218 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross	dst=null	perm=null
2015-03-13 10:09:06,219 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/task_1426266260362_0016_m_000000	dst=null	perm=null
2015-03-13 10:09:06,220 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/part-00000	dst=null	perm=null
2015-03-13 10:09:06,223 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/task_1426266260362_0016_m_000000/part-00000	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/part-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:06,226 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross	dst=null	perm=null
2015-03-13 10:09:06,227 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross	dst=null	perm=null
2015-03-13 10:09:06,228 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/task_1426266260362_0016_m_000001	dst=null	perm=null
2015-03-13 10:09:06,229 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0016_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:09:06,229 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0016/container_1426266260362_0016_01_000002
2015-03-13 10:09:06,229 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0016/container_1426266260362_0016_01_000002
2015-03-13 10:09:06,229 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/part-00001	dst=null	perm=null
2015-03-13 10:09:06,230 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0016/container_1426266260362_0016_01_000002
2015-03-13 10:09:06,231 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0016/container_1426266260362_0016_01_000002
2015-03-13 10:09:06,231 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/task_1426266260362_0016_m_000001/part-00001	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/part-00001	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:06,232 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0016	CONTAINERID=container_1426266260362_0016_01_000002
2015-03-13 10:09:06,232 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross	dst=null	perm=null
2015-03-13 10:09:06,232 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0016_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:09:06,233 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0016_01_000002 from application application_1426266260362_0016
2015-03-13 10:09:06,233 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:06,233 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0016
2015-03-13 10:09:06,234 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross	dst=null	perm=null
2015-03-13 10:09:06,234 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/task_1426266260362_0016_m_000002	dst=null	perm=null
2015-03-13 10:09:06,238 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/part-00002	dst=null	perm=null
2015-03-13 10:09:06,239 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/task_1426266260362_0016_m_000002/part-00002	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/part-00002	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:06,240 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross	dst=null	perm=null
2015-03-13 10:09:06,241 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross	dst=null	perm=null
2015-03-13 10:09:06,242 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/task_1426266260362_0016_m_000003	dst=null	perm=null
2015-03-13 10:09:06,243 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/part-00003	dst=null	perm=null
2015-03-13 10:09:06,245 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/task_1426266260362_0016_m_000003/part-00003	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/part-00003	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:06,248 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary	dst=null	perm=null
2015-03-13 10:09:06,252 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:06,254 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-494706022_1
2015-03-13 10:09:06,256 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:06,258 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-494706022_1
2015-03-13 10:09:06,269 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62122, dest: /127.0.0.1:60693, bytes: 46407, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-494706022_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742013_1189, duration: 381423000
2015-03-13 10:09:06,270 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742013_1189, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:06,270 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742013_1189{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:09:06,271 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62121, dest: /127.0.0.1:60696, bytes: 46407, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-494706022_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742013_1189, duration: 382304000
2015-03-13 10:09:06,271 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742013_1189, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:06,272 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742013_1189{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:09:06,272 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62120, dest: /127.0.0.1:60686, bytes: 46407, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-494706022_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742013_1189, duration: 383808000
2015-03-13 10:09:06,272 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742013_1189, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:06,273 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742013_1189{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:09:06,274 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job_1426266260362_0016_1.jhist is closed by DFSClient_NONMAPREDUCE_-494706022_1
2015-03-13 10:09:06,275 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0016.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:06,278 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0016.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742016_1192{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:09:06,280 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742016_1192 src: /127.0.0.1:62133 dest: /127.0.0.1:60686
2015-03-13 10:09:06,283 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742016_1192 src: /127.0.0.1:62134 dest: /127.0.0.1:60689
2015-03-13 10:09:06,284 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742016_1192 src: /127.0.0.1:62135 dest: /127.0.0.1:60696
2015-03-13 10:09:06,287 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62135, dest: /127.0.0.1:60696, bytes: 436, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-494706022_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742016_1192, duration: 1360000
2015-03-13 10:09:06,287 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742016_1192, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:06,288 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742016_1192{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:06,288 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62134, dest: /127.0.0.1:60689, bytes: 436, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-494706022_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742016_1192, duration: 1918000
2015-03-13 10:09:06,288 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742016_1192, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:06,288 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742016_1192{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:06,289 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62133, dest: /127.0.0.1:60686, bytes: 436, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-494706022_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742016_1192, duration: 2807000
2015-03-13 10:09:06,289 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742016_1192, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:06,289 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742016_1192{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:06,290 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0016.summary_tmp is closed by DFSClient_NONMAPREDUCE_-494706022_1
2015-03-13 10:09:06,294 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0016.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:09:06,299 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job_1426266260362_0016_1.jhist	dst=null	perm=null
2015-03-13 10:09:06,301 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0016-1426266532975-soberoi-%5BE7F6D5868D024899941007FA966EB2C9%2FDF3D800AAAC34623-1426266546259-4-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:09:06,304 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job_1426266260362_0016_1.jhist	dst=null	perm=null
2015-03-13 10:09:06,305 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0016-1426266532975-soberoi-%5BE7F6D5868D024899941007FA966EB2C9%2FDF3D800AAAC34623-1426266546259-4-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:09:06,306 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job_1426266260362_0016_1.jhist	dst=null	perm=null
2015-03-13 10:09:06,308 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0016-1426266532975-soberoi-%5BE7F6D5868D024899941007FA966EB2C9%2FDF3D800AAAC34623-1426266546259-4-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:06,310 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62136, bytes: 46771, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-494706022_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742013_1189, duration: 173000
2015-03-13 10:09:06,311 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0016-1426266532975-soberoi-%5BE7F6D5868D024899941007FA966EB2C9%2FDF3D800AAAC34623-1426266546259-4-0-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742017_1193{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:09:06,313 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742017_1193 src: /127.0.0.1:62137 dest: /127.0.0.1:60696
2015-03-13 10:09:06,314 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742017_1193 src: /127.0.0.1:62138 dest: /127.0.0.1:60686
2015-03-13 10:09:06,315 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742017_1193 src: /127.0.0.1:62139 dest: /127.0.0.1:60689
2015-03-13 10:09:06,318 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62139, dest: /127.0.0.1:60689, bytes: 46407, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-494706022_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742017_1193, duration: 1391000
2015-03-13 10:09:06,318 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742017_1193, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:06,319 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742017_1193{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:09:06,319 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62138, dest: /127.0.0.1:60686, bytes: 46407, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-494706022_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742017_1193, duration: 1879000
2015-03-13 10:09:06,319 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742017_1193, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:06,319 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742017_1193{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:09:06,320 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62137, dest: /127.0.0.1:60696, bytes: 46407, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-494706022_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742017_1193, duration: 2644000
2015-03-13 10:09:06,320 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742017_1193, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:06,320 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742017_1193{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:09:06,322 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0016-1426266532975-soberoi-%5BE7F6D5868D024899941007FA966EB2C9%2FDF3D800AAAC34623-1426266546259-4-0-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-494706022_1
2015-03-13 10:09:06,323 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0016-1426266532975-soberoi-%5BE7F6D5868D024899941007FA966EB2C9%2FDF3D800AAAC34623-1426266546259-4-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:09:06,325 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job_1426266260362_0016_1_conf.xml	dst=null	perm=null
2015-03-13 10:09:06,325 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0016_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:09:06,326 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job_1426266260362_0016_1_conf.xml	dst=null	perm=null
2015-03-13 10:09:06,327 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0016_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:09:06,329 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job_1426266260362_0016_1_conf.xml	dst=null	perm=null
2015-03-13 10:09:06,331 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0016_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:06,334 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62140, bytes: 91015, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-494706022_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742010_1186, duration: 246000
2015-03-13 10:09:06,336 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0016_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742018_1194{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:09:06,338 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742018_1194 src: /127.0.0.1:62141 dest: /127.0.0.1:60696
2015-03-13 10:09:06,340 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742018_1194 src: /127.0.0.1:62142 dest: /127.0.0.1:60686
2015-03-13 10:09:06,341 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742018_1194 src: /127.0.0.1:62143 dest: /127.0.0.1:60693
2015-03-13 10:09:06,345 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62143, dest: /127.0.0.1:60693, bytes: 90307, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-494706022_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742018_1194, duration: 2162000
2015-03-13 10:09:06,345 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742018_1194, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:06,346 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742018_1194{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:09:06,346 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62142, dest: /127.0.0.1:60686, bytes: 90307, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-494706022_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742018_1194, duration: 2698000
2015-03-13 10:09:06,346 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742018_1194, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:06,347 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62141, dest: /127.0.0.1:60696, bytes: 90307, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-494706022_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742018_1194, duration: 3966000
2015-03-13 10:09:06,348 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742018_1194, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:06,348 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742018_1194{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:09:06,349 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742018_1194{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:09:06,349 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0016_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-494706022_1
2015-03-13 10:09:06,351 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0016_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:09:06,352 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0016.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0016.summary	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:09:06,354 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0016_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0016_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:09:06,356 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0016-1426266532975-soberoi-%5BE7F6D5868D024899941007FA966EB2C9%2FDF3D800AAAC34623-1426266546259-4-0-SUCCEEDED-default.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0016-1426266532975-soberoi-%5BE7F6D5868D024899941007FA966EB2C9%2FDF3D800AAAC34623-1426266546259-4-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:09:06,361 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0016_000001 State change from RUNNING to FINISHING
2015-03-13 10:09:06,361 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0016
2015-03-13 10:09:06,361 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0016 State change from RUNNING to REMOVING
2015-03-13 10:09:06,361 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0016
2015-03-13 10:09:06,361 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0016 State change from REMOVING to FINISHING
2015-03-13 10:09:07,180 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:07,205 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:09:07,206 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0016_01_000002
2015-03-13 10:09:07,206 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0016_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:09:07,206 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0016_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:09:07,206 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0016	CONTAINERID=container_1426266260362_0016_01_000002
2015-03-13 10:09:07,207 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0016_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:09:07,207 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:09:07,207 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0016_01_000002, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:07,207 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:07,207 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:09:07,207 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0016_000001 released container container_1426266260362_0016_01_000002 on node: host: 10.1.1.144:60711 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:09:07,369 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742006_1182 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60686 
2015-03-13 10:09:07,370 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742007_1183 127.0.0.1:60689 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60696 
2015-03-13 10:09:07,370 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742008_1184 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60686 
2015-03-13 10:09:07,370 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742009_1185 127.0.0.1:60689 127.0.0.1:60693 127.0.0.1:60696 
2015-03-13 10:09:07,370 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742013_1189 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60693 
2015-03-13 10:09:07,370 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742010_1186 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60693 
2015-03-13 10:09:07,371 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016	dst=null	perm=null
2015-03-13 10:09:07,410 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross	dst=null	perm=null
2015-03-13 10:09:07,410 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary
2015-03-13 10:09:07,411 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary	dst=null	perm=null
2015-03-13 10:09:07,418 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:09:07,419 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:09:07,419 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:09:07,420 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross	dst=null	perm=null
2015-03-13 10:09:07,421 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross	dst=null	perm=null
2015-03-13 10:09:07,421 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross	dst=null	perm=null
2015-03-13 10:09:07,423 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 4
2015-03-13 10:09:07,423 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/part-00000	dst=null	perm=null
2015-03-13 10:09:07,425 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62145, bytes: 100, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742015_1191, duration: 179000
2015-03-13 10:09:07,426 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/part-00001	dst=null	perm=null
2015-03-13 10:09:07,428 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62146, bytes: 60, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742012_1188, duration: 174000
2015-03-13 10:09:07,429 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/part-00002	dst=null	perm=null
2015-03-13 10:09:07,430 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62146, bytes: 76, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742014_1190, duration: 140000
2015-03-13 10:09:07,430 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/part-00003	dst=null	perm=null
2015-03-13 10:09:07,432 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62147, bytes: 76, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742011_1187, duration: 148000
2015-03-13 10:09:07,439 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:09:07,440 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:09:07,440 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:09:07,441 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross	dst=null	perm=null
2015-03-13 10:09:07,442 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross	dst=null	perm=null
2015-03-13 10:09:07,442 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross	dst=null	perm=null
2015-03-13 10:09:07,444 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 4
2015-03-13 10:09:07,444 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/part-00000	dst=null	perm=null
2015-03-13 10:09:07,445 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62146, bytes: 100, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742015_1191, duration: 150000
2015-03-13 10:09:07,446 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/part-00001	dst=null	perm=null
2015-03-13 10:09:07,448 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62147, bytes: 60, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742012_1188, duration: 163000
2015-03-13 10:09:07,449 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/part-00002	dst=null	perm=null
2015-03-13 10:09:07,450 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62146, bytes: 76, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742014_1190, duration: 161000
2015-03-13 10:09:07,450 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/part-00003	dst=null	perm=null
2015-03-13 10:09:07,452 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62145, bytes: 76, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742011_1187, duration: 148000
2015-03-13 10:09:07,452 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/cross
2015-03-13 10:09:07,452 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross	dst=null	perm=null
2015-03-13 10:09:07,453 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross	dst=null	perm=null
2015-03-13 10:09:07,453 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross	dst=null	perm=null
2015-03-13 10:09:07,454 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross	dst=null	perm=null
2015-03-13 10:09:07,455 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/part-00000	dst=null	perm=null
2015-03-13 10:09:07,455 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/part-00000	dst=null	perm=null
2015-03-13 10:09:07,456 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62145, bytes: 100, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742015_1191, duration: 160000
2015-03-13 10:09:07,457 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/part-00001	dst=null	perm=null
2015-03-13 10:09:07,458 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/part-00001	dst=null	perm=null
2015-03-13 10:09:07,459 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62145, bytes: 60, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742012_1188, duration: 164000
2015-03-13 10:09:07,459 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/part-00002	dst=null	perm=null
2015-03-13 10:09:07,460 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/part-00002	dst=null	perm=null
2015-03-13 10:09:07,461 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62146, bytes: 76, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742014_1190, duration: 165000
2015-03-13 10:09:07,462 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/part-00003	dst=null	perm=null
2015-03-13 10:09:07,462 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/part-00003	dst=null	perm=null
2015-03-13 10:09:07,463 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62145, bytes: 76, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742011_1187, duration: 184000
2015-03-13 10:09:07,464 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:09:07,465 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:09:07,473 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:09:07,474 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:09:07,474 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:09:07,482 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join	dst=null	perm=null
2015-03-13 10:09:07,483 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting
2015-03-13 10:09:07,484 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt"]
2015-03-13 10:09:07,484 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-03-13 10:09:07,484 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join"]
2015-03-13 10:09:07,484 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  parallel execution is enabled: true
2015-03-13 10:09:07,484 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  starting jobs: 1
2015-03-13 10:09:07,484 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  allocating threads: 1
2015-03-13 10:09:07,485 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (1/1) ...fieldedpipesplatform/join
2015-03-13 10:09:07,491 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:09:07,499 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:09:07,500 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join	dst=null	perm=null
2015-03-13 10:09:07,501 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:09:07,501 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:09:07,503 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 17
2015-03-13 10:09:07,504 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017	dst=null	perm=null
2015-03-13 10:09:07,505 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017	dst=null	perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:09:07,506 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017	dst=null	perm=soberoi:supergroup:rwx------
2015-03-13 10:09:07,507 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.jar	dst=null	perm=null
2015-03-13 10:09:07,508 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:09:07,509 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073742019_1195{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:09:07,510 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742019_1195 src: /127.0.0.1:62149 dest: /127.0.0.1:60696
2015-03-13 10:09:07,512 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742019_1195 src: /127.0.0.1:62150 dest: /127.0.0.1:60689
2015-03-13 10:09:07,513 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742019_1195 src: /127.0.0.1:62151 dest: /127.0.0.1:60686
2015-03-13 10:09:07,517 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62151, dest: /127.0.0.1:60686, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742019_1195, duration: 1894000
2015-03-13 10:09:07,517 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742019_1195, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:07,517 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742019_1195{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:09:07,517 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62150, dest: /127.0.0.1:60689, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742019_1195, duration: 2283000
2015-03-13 10:09:07,518 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742019_1195, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:07,518 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742019_1195{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:09:07,518 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62149, dest: /127.0.0.1:60696, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742019_1195, duration: 3330000
2015-03-13 10:09:07,518 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742019_1195, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:07,519 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742019_1195{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:09:07,520 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:09:07,521 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.jar
2015-03-13 10:09:07,521 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.jar	dst=null	perm=null
2015-03-13 10:09:07,522 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:09:07,523 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:09:07,523 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:09:07,524 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:09:07,525 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:09:07,525 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:09:07,525 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:09:07,526 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:09:07,526 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:09:07,527 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:09:07,528 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:09:07,528 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:09:07,529 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:09:07,531 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:09:07,532 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:09:07,532 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.split
2015-03-13 10:09:07,533 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.split	dst=null	perm=null
2015-03-13 10:09:07,534 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073742020_1196{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:09:07,535 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742020_1196 src: /127.0.0.1:62152 dest: /127.0.0.1:60693
2015-03-13 10:09:07,536 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742020_1196 src: /127.0.0.1:62153 dest: /127.0.0.1:60696
2015-03-13 10:09:07,537 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742020_1196 src: /127.0.0.1:62154 dest: /127.0.0.1:60689
2015-03-13 10:09:07,538 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742020_1196 src: /127.0.0.1:62155 dest: /127.0.0.1:60686
2015-03-13 10:09:07,541 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62155, dest: /127.0.0.1:60686, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742020_1196, duration: 1679000
2015-03-13 10:09:07,541 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742020_1196, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:07,541 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742020_1196{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:09:07,541 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62154, dest: /127.0.0.1:60689, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742020_1196, duration: 2059000
2015-03-13 10:09:07,542 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742020_1196, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:07,542 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742020_1196{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:09:07,542 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62153, dest: /127.0.0.1:60696, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742020_1196, duration: 2806000
2015-03-13 10:09:07,542 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742020_1196, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:07,543 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742020_1196{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:09:07,543 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62152, dest: /127.0.0.1:60693, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742020_1196, duration: 3234000
2015-03-13 10:09:07,543 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742020_1196, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:07,544 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742020_1196{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:09:07,545 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:09:07,546 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:09:07,547 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:09:07,548 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073742021_1197{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:09:07,549 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742021_1197 src: /127.0.0.1:62156 dest: /127.0.0.1:60689
2015-03-13 10:09:07,551 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742021_1197 src: /127.0.0.1:62157 dest: /127.0.0.1:60686
2015-03-13 10:09:07,552 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742021_1197 src: /127.0.0.1:62158 dest: /127.0.0.1:60696
2015-03-13 10:09:07,554 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62158, dest: /127.0.0.1:60696, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742021_1197, duration: 1007000
2015-03-13 10:09:07,554 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742021_1197, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:07,554 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742021_1197{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:07,554 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62157, dest: /127.0.0.1:60686, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742021_1197, duration: 1354000
2015-03-13 10:09:07,555 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742021_1197, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:07,555 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742021_1197{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:07,555 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62156, dest: /127.0.0.1:60689, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742021_1197, duration: 2094000
2015-03-13 10:09:07,555 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742021_1197, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:07,556 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742021_1197{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:07,557 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:09:07,558 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:09:07,559 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:09:07,560 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:09:07,561 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:09:07,561 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:09:07,562 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:09:07,565 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742022_1198{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:09:07,566 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742022_1198 src: /127.0.0.1:62159 dest: /127.0.0.1:60686
2015-03-13 10:09:07,567 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742022_1198 src: /127.0.0.1:62160 dest: /127.0.0.1:60689
2015-03-13 10:09:07,568 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742022_1198 src: /127.0.0.1:62161 dest: /127.0.0.1:60696
2015-03-13 10:09:07,571 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62161, dest: /127.0.0.1:60696, bytes: 97628, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742022_1198, duration: 1636000
2015-03-13 10:09:07,571 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742022_1198, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:07,572 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742022_1198{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:07,572 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62160, dest: /127.0.0.1:60689, bytes: 97628, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742022_1198, duration: 2164000
2015-03-13 10:09:07,572 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742022_1198, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:07,572 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742022_1198{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:07,573 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62159, dest: /127.0.0.1:60686, bytes: 97628, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742022_1198, duration: 2955000
2015-03-13 10:09:07,573 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742022_1198, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:07,576 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742022_1198{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:07,577 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:09:07,577 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0017
2015-03-13 10:09:07,578 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017	dst=null	perm=null
2015-03-13 10:09:07,578 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.xml	dst=null	perm=null
2015-03-13 10:09:07,579 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.xml	dst=null	perm=null
2015-03-13 10:09:07,579 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.jar	dst=null	perm=null
2015-03-13 10:09:07,580 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.jar	dst=null	perm=null
2015-03-13 10:09:07,580 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.split	dst=null	perm=null
2015-03-13 10:09:07,581 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.split	dst=null	perm=null
2015-03-13 10:09:07,581 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742020_1196
2015-03-13 10:09:07,581 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742015_1191
2015-03-13 10:09:07,581 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:09:07,581 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742021_1197
2015-03-13 10:09:07,582 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742011_1187
2015-03-13 10:09:07,582 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:09:07,582 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742014_1190
2015-03-13 10:09:07,582 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742012_1188
2015-03-13 10:09:07,582 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742016_1192
2015-03-13 10:09:07,583 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:09:07,584 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:09:07,584 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742019_1195
2015-03-13 10:09:07,584 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742017_1193
2015-03-13 10:09:07,584 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:09:07,585 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:09:07,585 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:09:07,586 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:09:07,587 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 17 submitted by user soberoi
2015-03-13 10:09:07,587 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0017
2015-03-13 10:09:07,587 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	IP=10.1.1.144	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1426266260362_0017
2015-03-13 10:09:07,587 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0017 State change from NEW to NEW_SAVING
2015-03-13 10:09:07,587 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0017
2015-03-13 10:09:07,588 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0017 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:09:07,588 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0017_000001
2015-03-13 10:09:07,588 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0017_000001 State change from NEW to SUBMITTED
2015-03-13 10:09:07,588 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0017 from user: soberoi activated in queue: default
2015-03-13 10:09:07,588 INFO  capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0017 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:09:07,588 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0017 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:09:07,588 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0017 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:09:07,588 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0017_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:09:07,589 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0017_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:09:07,589 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0017 State change from SUBMITTED to ACCEPTED
2015-03-13 10:09:07,591 INFO  mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0017/
2015-03-13 10:09:07,591 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1426266260362_0017
2015-03-13 10:09:07,591 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0017/
2015-03-13 10:09:07,632 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0017_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:09:07,632 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0017	CONTAINERID=container_1426266260362_0017_01_000001
2015-03-13 10:09:07,632 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0017_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:09:07,633 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0017 container=Container: [ContainerId: container_1426266260362_0017_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0017_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:07,633 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:09:07,633 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0017_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:09:07,633 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:07,634 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0017 AttemptId: appattempt_1426266260362_0017_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0017_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ]
2015-03-13 10:09:07,634 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0017_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:09:07,634 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0017_000001
2015-03-13 10:09:07,635 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0017_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:09:07,635 INFO  amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0017_000001
2015-03-13 10:09:07,635 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0017_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] for AM appattempt_1426266260362_0017_000001
2015-03-13 10:09:07,635 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0017_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-03-13 10:09:07,638 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0017_000001 (auth:SIMPLE)
2015-03-13 10:09:07,639 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0017_01_000001 by user soberoi
2015-03-13 10:09:07,639 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0017
2015-03-13 10:09:07,639 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0017	CONTAINERID=container_1426266260362_0017_01_000001
2015-03-13 10:09:07,639 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0017 transitioned from NEW to INITING
2015-03-13 10:09:07,639 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0017_01_000001 to application application_1426266260362_0017
2015-03-13 10:09:07,639 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0017_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] for AM appattempt_1426266260362_0017_000001
2015-03-13 10:09:07,640 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0017 transitioned from INITING to RUNNING
2015-03-13 10:09:07,640 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0017_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:09:07,640 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:09:07,640 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0017
2015-03-13 10:09:07,640 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:09:07,640 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:09:07,640 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:09:07,640 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:09:07,641 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0017_01_000001
2015-03-13 10:09:07,650 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1426266260362_0017_01_000001.tokens. Credentials list: 
2015-03-13 10:09:07,665 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:09:07,730 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1426266260362_0017_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000001.tokens
2015-03-13 10:09:07,730 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0017 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0017
2015-03-13 10:09:07,783 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742022_1198
2015-03-13 10:09:07,788 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.jar	dst=null	perm=null
2015-03-13 10:09:07,789 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.jar	dst=null	perm=null
2015-03-13 10:09:07,790 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.jar	dst=null	perm=null
2015-03-13 10:09:07,797 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62165, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1240182633_8781, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742019_1195, duration: 482000
2015-03-13 10:09:07,815 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:09:07,831 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:09:07,832 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:09:07,832 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:09:07,838 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62145, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1240182633_8781, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742021_1197, duration: 166000
2015-03-13 10:09:07,850 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:09:07,876 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.split	dst=null	perm=null
2015-03-13 10:09:07,877 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.split	dst=null	perm=null
2015-03-13 10:09:07,878 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.split	dst=null	perm=null
2015-03-13 10:09:07,883 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62147, bytes: 1798, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1240182633_8781, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742020_1196, duration: 185000
2015-03-13 10:09:07,895 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:09:07,918 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.xml	dst=null	perm=null
2015-03-13 10:09:07,919 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.xml	dst=null	perm=null
2015-03-13 10:09:07,920 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.xml	dst=null	perm=null
2015-03-13 10:09:07,927 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62147, bytes: 98392, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1240182633_8781, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742022_1198, duration: 278000
2015-03-13 10:09:07,939 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:09:07,940 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:09:07,940 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742016_1192
2015-03-13 10:09:07,940 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742022_1198
2015-03-13 10:09:07,965 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742015_1191
2015-03-13 10:09:07,965 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742012_1188
2015-03-13 10:09:07,966 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742014_1190
2015-03-13 10:09:07,966 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742018_1194
2015-03-13 10:09:07,967 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742020_1196
2015-03-13 10:09:07,967 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742013_1189
2015-03-13 10:09:07,971 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:09:07,971 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:08,047 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000001/default_container_executor.sh]
2015-03-13 10:09:08,145 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742019_1195
2015-03-13 10:09:08,146 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742012_1188
2015-03-13 10:09:08,146 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742011_1187
2015-03-13 10:09:08,147 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742017_1193
2015-03-13 10:09:08,147 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742013_1189
2015-03-13 10:09:08,147 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742020_1196
2015-03-13 10:09:08,181 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:08,345 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742018_1194
2015-03-13 10:09:08,346 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742021_1197
2015-03-13 10:09:08,519 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742021_1197
2015-03-13 10:09:08,519 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742016_1192
2015-03-13 10:09:08,520 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742020_1196
2015-03-13 10:09:08,520 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742014_1190
2015-03-13 10:09:08,520 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742015_1191
2015-03-13 10:09:08,521 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742018_1194
2015-03-13 10:09:08,521 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742011_1187
2015-03-13 10:09:08,522 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742022_1198
2015-03-13 10:09:08,634 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:08,634 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0017_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:09:08,725 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742019_1195
2015-03-13 10:09:08,726 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742017_1193
2015-03-13 10:09:08,726 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742013_1189
2015-03-13 10:09:09,185 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:09,640 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:09,700 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:09:09,720 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/COMMIT_STARTED	dst=null	perm=null
2015-03-13 10:09:09,721 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/COMMIT_SUCCESS	dst=null	perm=null
2015-03-13 10:09:09,722 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/COMMIT_FAIL	dst=null	perm=null
2015-03-13 10:09:09,775 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017	dst=null	perm=null
2015-03-13 10:09:09,776 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:09:09,777 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:09:09,882 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60686 to replicate blk_1073742019_1195 to datanode(s) 127.0.0.1:60693
2015-03-13 10:09:09,882 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073742006_1182, blk_1073742007_1183, blk_1073742008_1184, blk_1073742009_1185, blk_1073742010_1186]
2015-03-13 10:09:09,882 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073742006_1182, blk_1073742007_1183, blk_1073742009_1185, blk_1073742010_1186, blk_1073742013_1189]
2015-03-13 10:09:10,060 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:09:10,067 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:09:10,121 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62167, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1266609083_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742021_1197, duration: 129000
2015-03-13 10:09:10,186 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:10,496 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742006_1182 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742006 for deletion
2015-03-13 10:09:10,496 INFO  datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-1907321454-10.1.1.144-60686-1426266259166, infoPort=60687, ipcPort=60688, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073742019_1195 to 127.0.0.1:60693 
2015-03-13 10:09:10,496 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742007_1183 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742007 for deletion
2015-03-13 10:09:10,497 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742008_1184 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742008 for deletion
2015-03-13 10:09:10,497 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742009_1185 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742009 for deletion
2015-03-13 10:09:10,497 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742010_1186 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742010 for deletion
2015-03-13 10:09:10,497 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742006_1182 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742006
2015-03-13 10:09:10,497 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742007_1183 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742007
2015-03-13 10:09:10,498 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742008_1184 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742008
2015-03-13 10:09:10,498 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742009_1185 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742009
2015-03-13 10:09:10,498 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742010_1186 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742010
2015-03-13 10:09:10,498 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742019_1195 src: /127.0.0.1:62170 dest: /127.0.0.1:60693
2015-03-13 10:09:10,498 INFO  datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073742019_1195 (numBytes=254067) to /127.0.0.1:60693
2015-03-13 10:09:10,500 INFO  datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073742019_1195 src: /127.0.0.1:62170 dest: /127.0.0.1:60693 of size 254067
2015-03-13 10:09:10,500 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742019_1195 size 254067
2015-03-13 10:09:10,641 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:10,671 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742006_1182 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742006 for deletion
2015-03-13 10:09:10,671 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742007_1183 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742007 for deletion
2015-03-13 10:09:10,671 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742009_1185 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742009 for deletion
2015-03-13 10:09:10,671 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742010_1186 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742010 for deletion
2015-03-13 10:09:10,671 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742006_1182 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742006
2015-03-13 10:09:10,671 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742007_1183 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742007
2015-03-13 10:09:10,671 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742009_1185 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742009
2015-03-13 10:09:10,671 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742013_1189 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742013 for deletion
2015-03-13 10:09:10,672 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742010_1186 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742010
2015-03-13 10:09:10,672 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742013_1189 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742013
2015-03-13 10:09:10,907 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0017_000001 (auth:SIMPLE)
2015-03-13 10:09:10,908 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0017_000001
2015-03-13 10:09:10,908 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi	IP=10.1.1.144	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1426266260362_0017	APPATTEMPTID=appattempt_1426266260362_0017_000001
2015-03-13 10:09:10,908 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0017_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:09:10,908 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0017 State change from ACCEPTED to RUNNING
2015-03-13 10:09:10,929 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job_1426266260362_0017_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:10,930 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:09:10,992 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job_1426266260362_0017_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:11,117 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job_1426266260362_0017_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742023_1199{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:09:11,162 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742023_1199 src: /127.0.0.1:62174 dest: /127.0.0.1:60686
2015-03-13 10:09:11,164 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742023_1199 src: /127.0.0.1:62175 dest: /127.0.0.1:60689
2015-03-13 10:09:11,165 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742023_1199 src: /127.0.0.1:62176 dest: /127.0.0.1:60696
2015-03-13 10:09:11,172 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62176, dest: /127.0.0.1:60696, bytes: 90444, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1266609083_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742023_1199, duration: 5207000
2015-03-13 10:09:11,172 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742023_1199, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:11,172 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742023_1199{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:11,172 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62175, dest: /127.0.0.1:60689, bytes: 90444, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1266609083_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742023_1199, duration: 5707000
2015-03-13 10:09:11,173 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742023_1199, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:11,173 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742023_1199{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:11,173 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62174, dest: /127.0.0.1:60686, bytes: 90444, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1266609083_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742023_1199, duration: 6642000
2015-03-13 10:09:11,173 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742023_1199, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:11,174 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742023_1199{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:11,178 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job_1426266260362_0017_1_conf.xml is closed by DFSClient_NONMAPREDUCE_1266609083_1
2015-03-13 10:09:11,189 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:11,646 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:12,194 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:12,195 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0017_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:09:12,196 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0017	CONTAINERID=container_1426266260362_0017_01_000002
2015-03-13 10:09:12,196 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0017_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:09:12,196 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0017 container=Container: [ContainerId: container_1426266260362_0017_01_000002, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0017_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:12,196 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:09:12,196 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:12,197 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0017_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:09:12,197 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0017	CONTAINERID=container_1426266260362_0017_01_000003
2015-03-13 10:09:12,197 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0017_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available
2015-03-13 10:09:12,197 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0017 container=Container: [ContainerId: container_1426266260362_0017_01_000003, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0017_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:12,197 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:09:12,198 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:12,219 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0017_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:09:12,219 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0017	CONTAINERID=container_1426266260362_0017_01_000004
2015-03-13 10:09:12,219 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0017_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:09:12,219 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0017 container=Container: [ContainerId: container_1426266260362_0017_01_000004, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0017_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:12,220 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:09:12,220 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:12,220 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0017_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:09:12,221 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0017	CONTAINERID=container_1426266260362_0017_01_000005
2015-03-13 10:09:12,221 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0017_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:09:12,221 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0017 container=Container: [ContainerId: container_1426266260362_0017_01_000005, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0017_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:12,221 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:09:12,221 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:12,222 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0017_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:09:12,222 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0017	CONTAINERID=container_1426266260362_0017_01_000006
2015-03-13 10:09:12,222 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0017_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:09:12,222 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0017 container=Container: [ContainerId: container_1426266260362_0017_01_000006, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0017_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:12,223 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7
2015-03-13 10:09:12,223 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:12,504 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0016_01_000001 succeeded 
2015-03-13 10:09:12,504 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0016_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:09:12,504 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0016_01_000001
2015-03-13 10:09:12,513 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0016/container_1426266260362_0016_01_000001
2015-03-13 10:09:12,514 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0016/container_1426266260362_0016_01_000001
2015-03-13 10:09:12,514 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0016	CONTAINERID=container_1426266260362_0016_01_000001
2015-03-13 10:09:12,514 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0016_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:09:12,514 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0016_01_000001 from application application_1426266260362_0016
2015-03-13 10:09:12,514 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:12,515 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0016
2015-03-13 10:09:12,513 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0016/container_1426266260362_0016_01_000001
2015-03-13 10:09:12,514 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0016/container_1426266260362_0016_01_000001
2015-03-13 10:09:12,651 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:12,788 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742023_1199
2015-03-13 10:09:12,882 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073742006_1182, blk_1073742007_1183, blk_1073742008_1184, blk_1073742009_1185, blk_1073742010_1186, blk_1073742013_1189]
2015-03-13 10:09:12,883 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073742006_1182, blk_1073742007_1183, blk_1073742008_1184, blk_1073742013_1189]
2015-03-13 10:09:12,947 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0017_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:09:12,947 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0017_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:09:12,947 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0017_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:09:12,947 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0017_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:09:12,948 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0017_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:09:12,975 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.jar	dst=null	perm=null
2015-03-13 10:09:12,977 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742019_1195
2015-03-13 10:09:12,977 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.jar	dst=null	perm=null
2015-03-13 10:09:12,989 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.xml	dst=null	perm=null
2015-03-13 10:09:12,990 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.xml	dst=null	perm=null
2015-03-13 10:09:12,993 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:09:12,995 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:09:13,001 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:09:13,003 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:09:13,005 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:09:13,006 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:09:13,083 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0017_000001 (auth:SIMPLE)
2015-03-13 10:09:13,083 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0017_000001 (auth:SIMPLE)
2015-03-13 10:09:13,086 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0017_01_000002 by user soberoi
2015-03-13 10:09:13,086 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0017
2015-03-13 10:09:13,086 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0017	CONTAINERID=container_1426266260362_0017_01_000002
2015-03-13 10:09:13,086 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0017 transitioned from NEW to INITING
2015-03-13 10:09:13,086 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0017_01_000002 to application application_1426266260362_0017
2015-03-13 10:09:13,086 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0017_01_000003 by user soberoi
2015-03-13 10:09:13,087 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0017 transitioned from INITING to RUNNING
2015-03-13 10:09:13,087 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0017	CONTAINERID=container_1426266260362_0017_01_000003
2015-03-13 10:09:13,087 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:09:13,087 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0017_01_000003 to application application_1426266260362_0017
2015-03-13 10:09:13,087 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0017
2015-03-13 10:09:13,087 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0017
2015-03-13 10:09:13,087 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:09:13,087 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0017
2015-03-13 10:09:13,088 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:09:13,088 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:09:13,088 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0017_01_000004 by user soberoi
2015-03-13 10:09:13,088 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0017
2015-03-13 10:09:13,088 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0017	CONTAINERID=container_1426266260362_0017_01_000004
2015-03-13 10:09:13,088 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0017_01_000005 by user soberoi
2015-03-13 10:09:13,089 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0017	CONTAINERID=container_1426266260362_0017_01_000005
2015-03-13 10:09:13,088 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:09:13,089 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0017_01_000002
2015-03-13 10:09:13,089 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0017 transitioned from NEW to INITING
2015-03-13 10:09:13,089 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0017_01_000004 to application application_1426266260362_0017
2015-03-13 10:09:13,089 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0017_01_000005 to application application_1426266260362_0017
2015-03-13 10:09:13,090 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0017 transitioned from INITING to RUNNING
2015-03-13 10:09:13,090 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0017
2015-03-13 10:09:13,090 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0017
2015-03-13 10:09:13,090 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:09:13,090 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:09:13,090 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0017_01_000006 by user soberoi
2015-03-13 10:09:13,090 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:09:13,090 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0017
2015-03-13 10:09:13,090 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0017
2015-03-13 10:09:13,090 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:09:13,090 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0017
2015-03-13 10:09:13,090 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:09:13,091 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:09:13,091 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0017
2015-03-13 10:09:13,091 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0017
2015-03-13 10:09:13,091 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:09:13,091 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0017
2015-03-13 10:09:13,091 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0017_01_000006 to application application_1426266260362_0017
2015-03-13 10:09:13,091 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0017_01_000005
2015-03-13 10:09:13,090 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0017
2015-03-13 10:09:13,092 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0017_01_000003
2015-03-13 10:09:13,090 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0017	CONTAINERID=container_1426266260362_0017_01_000006
2015-03-13 10:09:13,093 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0017_01_000004
2015-03-13 10:09:13,094 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:09:13,094 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0017
2015-03-13 10:09:13,094 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0017
2015-03-13 10:09:13,094 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:09:13,095 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0017
2015-03-13 10:09:13,095 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0017_01_000006
2015-03-13 10:09:13,115 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426266260362_0017_01_000002.tokens. Credentials list: 
2015-03-13 10:09:13,115 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0017_01_000006.tokens. Credentials list: 
2015-03-13 10:09:13,116 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1426266260362_0017_01_000005.tokens. Credentials list: 
2015-03-13 10:09:13,116 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0017_01_000003.tokens. Credentials list: 
2015-03-13 10:09:13,116 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0017_01_000004.tokens. Credentials list: 
2015-03-13 10:09:13,136 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:09:13,137 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:09:13,200 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:09:13,200 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0016_01_000001
2015-03-13 10:09:13,200 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:13,200 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:13,201 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0017_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:09:13,201 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0017_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:09:13,201 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0016_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:09:13,202 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0016_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:09:13,202 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0016	CONTAINERID=container_1426266260362_0016_01_000001
2015-03-13 10:09:13,202 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0016_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:09:13,202 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:7168, vCores:6> numContainers=6 user=soberoi user-resources=<memory:7168, vCores:6>
2015-03-13 10:09:13,202 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0016_000001
2015-03-13 10:09:13,202 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0016_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:13,202 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0016_000001 State change from FINISHING to FINISHED
2015-03-13 10:09:13,202 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:13,203 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6
2015-03-13 10:09:13,203 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0016_000001 released container container_1426266260362_0016_01_000001 on node: host: 10.1.1.144:60715 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:09:13,202 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0016 State change from FINISHING to FINISHED
2015-03-13 10:09:13,203 INFO  capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0016_000001 is done. finalState=FINISHED
2015-03-13 10:09:13,203 INFO  amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0016_000001
2015-03-13 10:09:13,203 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1426266260362_0016
2015-03-13 10:09:13,203 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0016 requests cleared
2015-03-13 10:09:13,203 INFO  capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0016 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:09:13,203 INFO  capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0016 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:09:13,203 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0016,name=[E7F6D5868D024899941007FA966EB2C9/DF3D800AAAC346239F59A15452AAF080] lhs*rhs/(1/1) ...ieldedpipesplatform/cross,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0016/jobhistory/job/job_1426266260362_0016,appMasterHost=Edinburgh.local,startTime=1426266532975,finishTime=1426266546361,finalStatus=SUCCEEDED
2015-03-13 10:09:13,206 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0016_000001 (auth:SIMPLE)
2015-03-13 10:09:13,207 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0016_01_000001
2015-03-13 10:09:13,219 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:13,219 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:13,219 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:13,220 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0016 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:09:13,220 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0017_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:09:13,220 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0017_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:09:13,220 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0017_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:09:13,220 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0016
2015-03-13 10:09:13,220 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0016
2015-03-13 10:09:13,221 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0016
2015-03-13 10:09:13,221 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0016
2015-03-13 10:09:13,221 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0016
2015-03-13 10:09:13,221 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0016 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:09:13,221 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0016, with delay of 10800 seconds
2015-03-13 10:09:13,226 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0017_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000006.tokens
2015-03-13 10:09:13,226 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426266260362_0017_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000002.tokens
2015-03-13 10:09:13,226 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0017 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0017
2015-03-13 10:09:13,226 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0017 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0017
2015-03-13 10:09:13,305 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.jar	dst=null	perm=null
2015-03-13 10:09:13,306 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.jar	dst=null	perm=null
2015-03-13 10:09:13,307 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.jar	dst=null	perm=null
2015-03-13 10:09:13,310 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.jar	dst=null	perm=null
2015-03-13 10:09:13,311 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.jar	dst=null	perm=null
2015-03-13 10:09:13,312 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.jar	dst=null	perm=null
2015-03-13 10:09:13,316 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62184, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-231761080_8926, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742019_1195, duration: 476000
2015-03-13 10:09:13,322 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62185, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_498224832_8929, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742019_1195, duration: 476000
2015-03-13 10:09:13,337 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:09:13,343 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:09:13,352 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742023_1199
2015-03-13 10:09:13,359 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.xml	dst=null	perm=null
2015-03-13 10:09:13,359 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.xml	dst=null	perm=null
2015-03-13 10:09:13,360 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.xml	dst=null	perm=null
2015-03-13 10:09:13,365 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.xml	dst=null	perm=null
2015-03-13 10:09:13,366 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.xml	dst=null	perm=null
2015-03-13 10:09:13,367 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.xml	dst=null	perm=null
2015-03-13 10:09:13,367 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62184, bytes: 98392, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-231761080_8926, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742022_1198, duration: 257000
2015-03-13 10:09:13,373 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62185, bytes: 98392, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_498224832_8929, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742022_1198, duration: 263000
2015-03-13 10:09:13,382 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:09:13,382 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:09:13,383 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:09:13,383 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:09:13,393 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:09:13,394 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:09:13,394 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:09:13,427 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:09:13,427 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:13,436 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:09:13,436 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:13,437 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:09:13,437 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:13,444 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:09:13,444 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:09:13,444 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:13,444 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:13,501 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742006_1182 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742006 for deletion
2015-03-13 10:09:13,501 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742007_1183 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742007 for deletion
2015-03-13 10:09:13,501 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742008_1184 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742008 for deletion
2015-03-13 10:09:13,501 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742013_1189 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742013 for deletion
2015-03-13 10:09:13,502 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742006_1182 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742006
2015-03-13 10:09:13,502 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742007_1183 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742007
2015-03-13 10:09:13,502 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742013_1189 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742013
2015-03-13 10:09:13,503 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742008_1184 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742008
2015-03-13 10:09:13,570 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000005/default_container_executor.sh]
2015-03-13 10:09:13,575 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000004/default_container_executor.sh]
2015-03-13 10:09:13,575 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000002/default_container_executor.sh]
2015-03-13 10:09:13,580 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000003/default_container_executor.sh]
2015-03-13 10:09:13,596 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000006/default_container_executor.sh]
2015-03-13 10:09:13,655 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:13,733 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742023_1199
2015-03-13 10:09:13,869 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742006_1182 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742006 for deletion
2015-03-13 10:09:13,869 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742007_1183 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742007 for deletion
2015-03-13 10:09:13,869 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742008_1184 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742008 for deletion
2015-03-13 10:09:13,869 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742009_1185 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742009 for deletion
2015-03-13 10:09:13,869 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742006_1182 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742006
2015-03-13 10:09:13,870 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742010_1186 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742010 for deletion
2015-03-13 10:09:13,870 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742007_1183 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742007
2015-03-13 10:09:13,870 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742013_1189 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742013 for deletion
2015-03-13 10:09:13,870 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742008_1184 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742008
2015-03-13 10:09:13,870 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742009_1185 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742009
2015-03-13 10:09:13,870 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742010_1186 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742010
2015-03-13 10:09:13,870 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742013_1189 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742013
2015-03-13 10:09:13,962 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:09:14,204 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:14,204 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:14,204 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0016 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:09:14,205 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0016
2015-03-13 10:09:14,205 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0016
2015-03-13 10:09:14,205 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0016
2015-03-13 10:09:14,205 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0016
2015-03-13 10:09:14,205 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0016 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:09:14,205 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0016, with delay of 10800 seconds
2015-03-13 10:09:14,205 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0016
2015-03-13 10:09:14,222 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:14,222 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:14,222 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:14,411 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:09:14,424 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:09:14,532 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0017_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000004.tokens
2015-03-13 10:09:14,533 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0017 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0017
2015-03-13 10:09:14,548 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0017_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000003.tokens
2015-03-13 10:09:14,548 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0017 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0017
2015-03-13 10:09:14,647 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:09:14,656 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:14,778 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1426266260362_0017_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000005.tokens
2015-03-13 10:09:14,778 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0017 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0017
2015-03-13 10:09:15,209 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:15,209 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:15,225 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:15,225 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:15,225 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:15,659 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:16,215 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:16,215 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:16,231 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:16,231 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:16,231 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:16,660 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:17,220 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:17,220 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:17,235 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:17,235 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:17,236 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:17,662 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:18,225 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:18,225 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:18,237 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:18,237 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:18,237 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:18,663 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:19,228 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:19,228 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:19,240 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:19,240 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:19,241 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:19,665 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:20,232 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:20,232 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:20,246 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:20,246 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:20,246 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:20,670 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:21,219 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.split	dst=null	perm=null
2015-03-13 10:09:21,235 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:21,235 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:21,250 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:21,250 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:21,251 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:21,375 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.split	dst=null	perm=null
2015-03-13 10:09:21,423 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.split	dst=null	perm=null
2015-03-13 10:09:21,444 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.split	dst=null	perm=null
2015-03-13 10:09:21,449 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62196, bytes: 1282, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0017_m_000002_0_-1525715967_1, offset: 512, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742020_1196, duration: 144000
2015-03-13 10:09:21,479 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.split	dst=null	perm=null
2015-03-13 10:09:21,539 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62200, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0017_m_000000_0_128292015_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742020_1196, duration: 148000
2015-03-13 10:09:21,572 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62201, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0017_m_000001_0_810505873_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742020_1196, duration: 158000
2015-03-13 10:09:21,591 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:09:21,596 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62203, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0017_m_000002_0_-1525715967_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 198000
2015-03-13 10:09:21,612 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62202, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0017_m_000003_0_1381020241_1, offset: 1024, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742020_1196, duration: 148000
2015-03-13 10:09:21,618 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/_temporary/attempt_1426266260362_0017_m_000002_0/part-00002	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:21,629 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62204, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0017_m_000004_0_-413749313_1, offset: 1024, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742020_1196, duration: 148000
2015-03-13 10:09:21,670 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:21,674 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:09:21,684 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:09:21,691 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/_temporary/attempt_1426266260362_0017_m_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:21,702 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62205, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0017_m_000001_0_810505873_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 153000
2015-03-13 10:09:21,722 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:09:21,726 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62206, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0017_m_000003_0_1381020241_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 142000
2015-03-13 10:09:21,740 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/_temporary/attempt_1426266260362_0017_m_000001_0/part-00001	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:21,748 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:09:21,753 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62207, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0017_m_000004_0_-413749313_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 174000
2015-03-13 10:09:21,764 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/_temporary/attempt_1426266260362_0017_m_000003_0/part-00003	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:21,782 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/_temporary/attempt_1426266260362_0017_m_000004_0/part-00004	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:22,030 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:09:22,039 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:09:22,042 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:09:22,046 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62208, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0017_m_000002_0_-1525715967_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 148000
2015-03-13 10:09:22,076 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/_temporary/attempt_1426266260362_0017_m_000002_0/part-00002. BP-1005356445-10.1.1.144-1426266257849 blk_1073742024_1200{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:09:22,104 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:09:22,113 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:09:22,117 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:09:22,118 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742024_1200 src: /127.0.0.1:62209 dest: /127.0.0.1:60696
2015-03-13 10:09:22,120 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742024_1200 src: /127.0.0.1:62210 dest: /127.0.0.1:60693
2015-03-13 10:09:22,121 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742024_1200 src: /127.0.0.1:62211 dest: /127.0.0.1:60689
2015-03-13 10:09:22,123 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62212, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0017_m_000000_0_128292015_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 148000
2015-03-13 10:09:22,130 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62211, dest: /127.0.0.1:60689, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0017_m_000002_0_-1525715967_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742024_1200, duration: 6967000
2015-03-13 10:09:22,130 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742024_1200, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:22,130 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742024_1200{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:09:22,131 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62210, dest: /127.0.0.1:60693, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0017_m_000002_0_-1525715967_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742024_1200, duration: 7830000
2015-03-13 10:09:22,131 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742024_1200, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:22,131 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742024_1200{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:09:22,131 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62209, dest: /127.0.0.1:60696, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0017_m_000002_0_-1525715967_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742024_1200, duration: 8628000
2015-03-13 10:09:22,132 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742024_1200, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:22,132 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742024_1200{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:09:22,133 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62200, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0017_m_000000_0_128292015_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 138000
2015-03-13 10:09:22,137 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/_temporary/attempt_1426266260362_0017_m_000002_0/part-00002 is closed by DFSClient_attempt_1426266260362_0017_m_000002_0_-1525715967_1
2015-03-13 10:09:22,146 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/_temporary/attempt_1426266260362_0017_m_000002_0	dst=null	perm=null
2015-03-13 10:09:22,152 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/_temporary/attempt_1426266260362_0017_m_000002_0	dst=null	perm=null
2015-03-13 10:09:22,154 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/task_1426266260362_0017_m_000002	dst=null	perm=null
2015-03-13 10:09:22,157 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/_temporary/attempt_1426266260362_0017_m_000002_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/task_1426266260362_0017_m_000002	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:09:22,158 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/_temporary/attempt_1426266260362_0017_m_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073742025_1201{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:09:22,171 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:09:22,178 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0017_01_000004
2015-03-13 10:09:22,178 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0017	CONTAINERID=container_1426266260362_0017_01_000004
2015-03-13 10:09:22,178 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:09:22,178 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0017_01_000004
2015-03-13 10:09:22,179 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:09:22,179 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:22,179 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:22,191 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0017_01_000004 is : 143
2015-03-13 10:09:22,193 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job_1426266260362_0017_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073742026_1202{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:09:22,195 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742026_1202 src: /127.0.0.1:62214 dest: /127.0.0.1:60696
2015-03-13 10:09:22,196 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742026_1202 src: /127.0.0.1:62215 dest: /127.0.0.1:60686
2015-03-13 10:09:22,198 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742026_1202 src: /127.0.0.1:62216 dest: /127.0.0.1:60693
2015-03-13 10:09:22,202 INFO  hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job_1426266260362_0017_1.jhist for DFSClient_NONMAPREDUCE_1266609083_1
2015-03-13 10:09:22,203 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:09:22,204 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000004
2015-03-13 10:09:22,204 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000004
2015-03-13 10:09:22,204 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0017	CONTAINERID=container_1426266260362_0017_01_000004
2015-03-13 10:09:22,205 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:09:22,205 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0017_01_000004 from application application_1426266260362_0017
2015-03-13 10:09:22,205 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:22,205 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000004
2015-03-13 10:09:22,204 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000004
2015-03-13 10:09:22,205 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0017
2015-03-13 10:09:22,222 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742025_1201 src: /127.0.0.1:62213 dest: /127.0.0.1:60696
2015-03-13 10:09:22,222 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:09:22,223 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742025_1201 src: /127.0.0.1:62217 dest: /127.0.0.1:60689
2015-03-13 10:09:22,225 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742025_1201 src: /127.0.0.1:62218 dest: /127.0.0.1:60693
2015-03-13 10:09:22,228 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:09:22,234 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62201, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0017_m_000001_0_810505873_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 196000
2015-03-13 10:09:22,235 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62218, dest: /127.0.0.1:60693, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0017_m_000000_0_128292015_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742025_1201, duration: 8746000
2015-03-13 10:09:22,235 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742025_1201, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:22,236 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742025_1201{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:09:22,236 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62217, dest: /127.0.0.1:60689, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0017_m_000000_0_128292015_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742025_1201, duration: 9341000
2015-03-13 10:09:22,236 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:22,236 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742025_1201, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:22,236 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:22,236 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742025_1201{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:09:22,236 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62213, dest: /127.0.0.1:60696, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0017_m_000000_0_128292015_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742025_1201, duration: 10052000
2015-03-13 10:09:22,237 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742025_1201, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:22,237 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742025_1201{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:09:22,258 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/_temporary/attempt_1426266260362_0017_m_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0017_m_000000_0_128292015_1
2015-03-13 10:09:22,266 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/_temporary/attempt_1426266260362_0017_m_000000_0	dst=null	perm=null
2015-03-13 10:09:22,268 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/_temporary/attempt_1426266260362_0017_m_000001_0/part-00001. BP-1005356445-10.1.1.144-1426266257849 blk_1073742027_1203{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:09:22,273 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/_temporary/attempt_1426266260362_0017_m_000000_0	dst=null	perm=null
2015-03-13 10:09:22,275 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/task_1426266260362_0017_m_000000	dst=null	perm=null
2015-03-13 10:09:22,278 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/_temporary/attempt_1426266260362_0017_m_000000_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/task_1426266260362_0017_m_000000	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:09:22,290 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0017_01_000002
2015-03-13 10:09:22,290 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0017	CONTAINERID=container_1426266260362_0017_01_000002
2015-03-13 10:09:22,291 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:09:22,291 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0017_01_000002
2015-03-13 10:09:22,291 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:09:22,291 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:22,303 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0017_01_000002 is : 143
2015-03-13 10:09:22,314 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:09:22,314 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000002
2015-03-13 10:09:22,315 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0017	CONTAINERID=container_1426266260362_0017_01_000002
2015-03-13 10:09:22,315 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000002
2015-03-13 10:09:22,316 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000002
2015-03-13 10:09:22,315 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000002
2015-03-13 10:09:22,316 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:09:22,316 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0017_01_000002 from application application_1426266260362_0017
2015-03-13 10:09:22,317 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:22,317 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0017
2015-03-13 10:09:22,317 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742027_1203 src: /127.0.0.1:62219 dest: /127.0.0.1:60696
2015-03-13 10:09:22,319 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742027_1203 src: /127.0.0.1:62220 dest: /127.0.0.1:60689
2015-03-13 10:09:22,320 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742027_1203 src: /127.0.0.1:62221 dest: /127.0.0.1:60693
2015-03-13 10:09:22,324 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:09:22,328 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62221, dest: /127.0.0.1:60693, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0017_m_000001_0_810505873_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742027_1203, duration: 6110000
2015-03-13 10:09:22,328 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742027_1203, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:22,328 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742027_1203{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:09:22,328 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62220, dest: /127.0.0.1:60689, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0017_m_000001_0_810505873_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742027_1203, duration: 6759000
2015-03-13 10:09:22,328 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742027_1203, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:22,329 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742027_1203{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:09:22,329 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62219, dest: /127.0.0.1:60696, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0017_m_000001_0_810505873_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742027_1203, duration: 7451000
2015-03-13 10:09:22,329 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742027_1203, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:22,329 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742027_1203{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:09:22,336 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:09:22,340 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:09:22,342 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/_temporary/attempt_1426266260362_0017_m_000001_0/part-00001 is closed by DFSClient_attempt_1426266260362_0017_m_000001_0_810505873_1
2015-03-13 10:09:22,345 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62222, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0017_m_000003_0_1381020241_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 151000
2015-03-13 10:09:22,350 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:09:22,350 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/_temporary/attempt_1426266260362_0017_m_000001_0	dst=null	perm=null
2015-03-13 10:09:22,356 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/_temporary/attempt_1426266260362_0017_m_000001_0	dst=null	perm=null
2015-03-13 10:09:22,357 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/task_1426266260362_0017_m_000001	dst=null	perm=null
2015-03-13 10:09:22,361 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/_temporary/attempt_1426266260362_0017_m_000001_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/task_1426266260362_0017_m_000001	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:09:22,367 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:09:22,368 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/_temporary/attempt_1426266260362_0017_m_000003_0/part-00003. BP-1005356445-10.1.1.144-1426266257849 blk_1073742028_1204{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:09:22,370 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:09:22,372 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0017_01_000003
2015-03-13 10:09:22,372 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0017	CONTAINERID=container_1426266260362_0017_01_000003
2015-03-13 10:09:22,373 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:09:22,373 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0017_01_000002
2015-03-13 10:09:22,373 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:09:22,373 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0017_01_000003
2015-03-13 10:09:22,373 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:09:22,374 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0017_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:09:22,374 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0017_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:09:22,374 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0017	CONTAINERID=container_1426266260362_0017_01_000002
2015-03-13 10:09:22,374 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0017_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:09:22,374 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:09:22,374 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0017_01_000002, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:22,374 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:22,374 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:09:22,375 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0017_000001 released container container_1426266260362_0017_01_000002 on node: host: 10.1.1.144:60715 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:09:22,386 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0017_01_000003 is : 143
2015-03-13 10:09:22,392 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62204, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0017_m_000004_0_-413749313_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 140000
2015-03-13 10:09:22,398 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:09:22,399 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000003
2015-03-13 10:09:22,399 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000003
2015-03-13 10:09:22,399 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000003
2015-03-13 10:09:22,399 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000003
2015-03-13 10:09:22,399 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0017	CONTAINERID=container_1426266260362_0017_01_000003
2015-03-13 10:09:22,400 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:09:22,400 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0017_01_000003 from application application_1426266260362_0017
2015-03-13 10:09:22,400 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:22,401 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0017
2015-03-13 10:09:22,408 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/_temporary/attempt_1426266260362_0017_m_000004_0/part-00004 is closed by DFSClient_attempt_1426266260362_0017_m_000004_0_-413749313_1
2015-03-13 10:09:22,419 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742028_1204 src: /127.0.0.1:62223 dest: /127.0.0.1:60689
2015-03-13 10:09:22,420 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/_temporary/attempt_1426266260362_0017_m_000004_0	dst=null	perm=null
2015-03-13 10:09:22,421 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742028_1204 src: /127.0.0.1:62224 dest: /127.0.0.1:60696
2015-03-13 10:09:22,422 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742028_1204 src: /127.0.0.1:62225 dest: /127.0.0.1:60686
2015-03-13 10:09:22,430 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/_temporary/attempt_1426266260362_0017_m_000004_0	dst=null	perm=null
2015-03-13 10:09:22,432 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62225, dest: /127.0.0.1:60686, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0017_m_000003_0_1381020241_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742028_1204, duration: 8762000
2015-03-13 10:09:22,433 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742028_1204, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:22,433 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742028_1204{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:09:22,433 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62224, dest: /127.0.0.1:60696, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0017_m_000003_0_1381020241_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742028_1204, duration: 9433000
2015-03-13 10:09:22,433 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742028_1204, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:22,434 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742028_1204{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:09:22,434 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62223, dest: /127.0.0.1:60689, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0017_m_000003_0_1381020241_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742028_1204, duration: 10186000
2015-03-13 10:09:22,434 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742028_1204, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:22,434 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742028_1204{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:09:22,437 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/task_1426266260362_0017_m_000004	dst=null	perm=null
2015-03-13 10:09:22,438 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/_temporary/attempt_1426266260362_0017_m_000003_0/part-00003 is closed by DFSClient_attempt_1426266260362_0017_m_000003_0_1381020241_1
2015-03-13 10:09:22,442 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/_temporary/attempt_1426266260362_0017_m_000004_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/task_1426266260362_0017_m_000004	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:09:22,448 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/_temporary/attempt_1426266260362_0017_m_000003_0	dst=null	perm=null
2015-03-13 10:09:22,454 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/_temporary/attempt_1426266260362_0017_m_000003_0	dst=null	perm=null
2015-03-13 10:09:22,455 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/task_1426266260362_0017_m_000003	dst=null	perm=null
2015-03-13 10:09:22,458 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/_temporary/attempt_1426266260362_0017_m_000003_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/task_1426266260362_0017_m_000003	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:09:22,464 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0017_01_000006
2015-03-13 10:09:22,464 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0017	CONTAINERID=container_1426266260362_0017_01_000006
2015-03-13 10:09:22,464 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:09:22,464 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:09:22,465 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0017_01_000004
2015-03-13 10:09:22,465 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0017_01_000006
2015-03-13 10:09:22,465 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:22,465 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:09:22,465 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0017_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:09:22,465 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0017_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:09:22,465 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0017	CONTAINERID=container_1426266260362_0017_01_000004
2015-03-13 10:09:22,466 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0017_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:09:22,466 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:09:22,466 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0017_01_000004, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:22,466 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:22,466 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:09:22,466 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0017_000001 released container container_1426266260362_0017_01_000004 on node: host: 10.1.1.144:60711 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:09:22,471 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0017_01_000005
2015-03-13 10:09:22,471 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0017	CONTAINERID=container_1426266260362_0017_01_000005
2015-03-13 10:09:22,472 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:22,472 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:09:22,476 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:22,477 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_1266609083_1
2015-03-13 10:09:22,478 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0017_01_000006 is : 143
2015-03-13 10:09:22,481 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1	dst=null	perm=null
2015-03-13 10:09:22,488 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join	dst=null	perm=null
2015-03-13 10:09:22,490 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join	dst=null	perm=null
2015-03-13 10:09:22,490 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:09:22,490 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:09:22,491 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0017_01_000005
2015-03-13 10:09:22,491 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/task_1426266260362_0017_m_000000	dst=null	perm=null
2015-03-13 10:09:22,493 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/part-00000	dst=null	perm=null
2015-03-13 10:09:22,496 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/task_1426266260362_0017_m_000000/part-00000	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/part-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:22,500 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join	dst=null	perm=null
2015-03-13 10:09:22,501 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join	dst=null	perm=null
2015-03-13 10:09:22,502 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/task_1426266260362_0017_m_000001	dst=null	perm=null
2015-03-13 10:09:22,504 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/part-00001	dst=null	perm=null
2015-03-13 10:09:22,505 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0017_01_000005 is : 143
2015-03-13 10:09:22,505 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/task_1426266260362_0017_m_000001/part-00001	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/part-00001	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:22,506 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join	dst=null	perm=null
2015-03-13 10:09:22,507 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join	dst=null	perm=null
2015-03-13 10:09:22,508 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/task_1426266260362_0017_m_000002	dst=null	perm=null
2015-03-13 10:09:22,510 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/part-00002	dst=null	perm=null
2015-03-13 10:09:22,512 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/task_1426266260362_0017_m_000002/part-00002	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/part-00002	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:22,514 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join	dst=null	perm=null
2015-03-13 10:09:22,515 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join	dst=null	perm=null
2015-03-13 10:09:22,516 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/task_1426266260362_0017_m_000003	dst=null	perm=null
2015-03-13 10:09:22,517 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/part-00003	dst=null	perm=null
2015-03-13 10:09:22,517 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000006
2015-03-13 10:09:22,518 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000006
2015-03-13 10:09:22,518 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:09:22,518 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000006
2015-03-13 10:09:22,518 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000006
2015-03-13 10:09:22,518 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0017	CONTAINERID=container_1426266260362_0017_01_000006
2015-03-13 10:09:22,519 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:09:22,519 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000005
2015-03-13 10:09:22,519 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000005
2015-03-13 10:09:22,519 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/task_1426266260362_0017_m_000003/part-00003	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/part-00003	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:22,520 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000005
2015-03-13 10:09:22,520 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0017_01_000006 from application application_1426266260362_0017
2015-03-13 10:09:22,520 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:22,520 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0017
2015-03-13 10:09:22,520 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0017	CONTAINERID=container_1426266260362_0017_01_000005
2015-03-13 10:09:22,520 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:09:22,520 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0017_01_000005 from application application_1426266260362_0017
2015-03-13 10:09:22,520 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:22,520 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0017
2015-03-13 10:09:22,519 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000005
2015-03-13 10:09:22,521 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join	dst=null	perm=null
2015-03-13 10:09:22,522 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join	dst=null	perm=null
2015-03-13 10:09:22,523 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/task_1426266260362_0017_m_000004	dst=null	perm=null
2015-03-13 10:09:22,524 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/part-00004	dst=null	perm=null
2015-03-13 10:09:22,525 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/task_1426266260362_0017_m_000004/part-00004	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/part-00004	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:22,529 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary	dst=null	perm=null
2015-03-13 10:09:22,533 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:22,535 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_SUCCESS is closed by DFSClient_NONMAPREDUCE_1266609083_1
2015-03-13 10:09:22,537 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:22,539 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_1266609083_1
2015-03-13 10:09:22,551 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62216, dest: /127.0.0.1:60693, bytes: 53294, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1266609083_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742026_1202, duration: 352276000
2015-03-13 10:09:22,552 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742026_1202, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:22,553 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742026_1202{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:09:22,553 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62215, dest: /127.0.0.1:60686, bytes: 53294, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1266609083_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742026_1202, duration: 353487000
2015-03-13 10:09:22,553 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742026_1202, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:22,554 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742026_1202{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:09:22,555 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62214, dest: /127.0.0.1:60696, bytes: 53294, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1266609083_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742026_1202, duration: 355375000
2015-03-13 10:09:22,555 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742026_1202, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:22,556 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742026_1202{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:09:22,557 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job_1426266260362_0017_1.jhist is closed by DFSClient_NONMAPREDUCE_1266609083_1
2015-03-13 10:09:22,562 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0017.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:22,565 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0017.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742029_1205{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:09:22,567 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742029_1205 src: /127.0.0.1:62226 dest: /127.0.0.1:60693
2015-03-13 10:09:22,568 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742029_1205 src: /127.0.0.1:62227 dest: /127.0.0.1:60689
2015-03-13 10:09:22,570 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742029_1205 src: /127.0.0.1:62228 dest: /127.0.0.1:60696
2015-03-13 10:09:22,573 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62228, dest: /127.0.0.1:60696, bytes: 440, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1266609083_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742029_1205, duration: 1523000
2015-03-13 10:09:22,573 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742029_1205, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:22,573 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742029_1205{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:22,573 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62227, dest: /127.0.0.1:60689, bytes: 440, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1266609083_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742029_1205, duration: 2175000
2015-03-13 10:09:22,574 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742029_1205, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:22,574 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742029_1205{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:22,574 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62226, dest: /127.0.0.1:60693, bytes: 440, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1266609083_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742029_1205, duration: 2943000
2015-03-13 10:09:22,574 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742029_1205, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:22,575 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742029_1205{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:22,576 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0017.summary_tmp is closed by DFSClient_NONMAPREDUCE_1266609083_1
2015-03-13 10:09:22,579 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0017.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:09:22,583 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job_1426266260362_0017_1.jhist	dst=null	perm=null
2015-03-13 10:09:22,584 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0017-1426266547587-soberoi-%5BE8F7ECEBD6AF435181C0FE297F64D1A5%2FDF54CDC6A1544804-1426266562540-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:09:22,587 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job_1426266260362_0017_1.jhist	dst=null	perm=null
2015-03-13 10:09:22,595 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0017-1426266547587-soberoi-%5BE8F7ECEBD6AF435181C0FE297F64D1A5%2FDF54CDC6A1544804-1426266562540-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:09:22,596 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job_1426266260362_0017_1.jhist	dst=null	perm=null
2015-03-13 10:09:22,599 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0017-1426266547587-soberoi-%5BE8F7ECEBD6AF435181C0FE297F64D1A5%2FDF54CDC6A1544804-1426266562540-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:22,602 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62229, bytes: 53714, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1266609083_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742026_1202, duration: 208000
2015-03-13 10:09:22,604 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0017-1426266547587-soberoi-%5BE8F7ECEBD6AF435181C0FE297F64D1A5%2FDF54CDC6A1544804-1426266562540-5-0-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742030_1206{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:09:22,606 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742030_1206 src: /127.0.0.1:62230 dest: /127.0.0.1:60693
2015-03-13 10:09:22,607 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742030_1206 src: /127.0.0.1:62231 dest: /127.0.0.1:60689
2015-03-13 10:09:22,609 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742030_1206 src: /127.0.0.1:62232 dest: /127.0.0.1:60696
2015-03-13 10:09:22,612 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62232, dest: /127.0.0.1:60696, bytes: 53294, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1266609083_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742030_1206, duration: 1669000
2015-03-13 10:09:22,612 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742030_1206, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:22,613 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742030_1206{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:22,613 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62231, dest: /127.0.0.1:60689, bytes: 53294, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1266609083_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742030_1206, duration: 2493000
2015-03-13 10:09:22,613 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742030_1206, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:22,614 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62230, dest: /127.0.0.1:60693, bytes: 53294, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1266609083_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742030_1206, duration: 3462000
2015-03-13 10:09:22,614 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742030_1206, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:22,615 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742030_1206{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:22,615 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742030_1206{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:22,617 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0017-1426266547587-soberoi-%5BE8F7ECEBD6AF435181C0FE297F64D1A5%2FDF54CDC6A1544804-1426266562540-5-0-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_1266609083_1
2015-03-13 10:09:22,619 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0017-1426266547587-soberoi-%5BE8F7ECEBD6AF435181C0FE297F64D1A5%2FDF54CDC6A1544804-1426266562540-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:09:22,620 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job_1426266260362_0017_1_conf.xml	dst=null	perm=null
2015-03-13 10:09:22,621 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0017_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:09:22,622 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job_1426266260362_0017_1_conf.xml	dst=null	perm=null
2015-03-13 10:09:22,623 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0017_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:09:22,624 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job_1426266260362_0017_1_conf.xml	dst=null	perm=null
2015-03-13 10:09:22,626 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0017_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:22,628 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62229, bytes: 91152, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1266609083_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742023_1199, duration: 265000
2015-03-13 10:09:22,630 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0017_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742031_1207{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:09:22,631 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742031_1207 src: /127.0.0.1:62233 dest: /127.0.0.1:60696
2015-03-13 10:09:22,633 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742031_1207 src: /127.0.0.1:62234 dest: /127.0.0.1:60689
2015-03-13 10:09:22,634 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742031_1207 src: /127.0.0.1:62235 dest: /127.0.0.1:60693
2015-03-13 10:09:22,636 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62235, dest: /127.0.0.1:60693, bytes: 90444, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1266609083_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742031_1207, duration: 1831000
2015-03-13 10:09:22,637 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742031_1207, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:22,637 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742031_1207{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:09:22,637 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62234, dest: /127.0.0.1:60689, bytes: 90444, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1266609083_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742031_1207, duration: 2450000
2015-03-13 10:09:22,637 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742031_1207, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:22,638 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742031_1207{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:09:22,638 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62233, dest: /127.0.0.1:60696, bytes: 90444, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1266609083_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742031_1207, duration: 3353000
2015-03-13 10:09:22,638 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742031_1207, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:22,639 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742031_1207{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:09:22,641 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0017_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_1266609083_1
2015-03-13 10:09:22,642 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0017_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:09:22,644 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0017.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0017.summary	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:09:22,646 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0017_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0017_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:09:22,648 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0017-1426266547587-soberoi-%5BE8F7ECEBD6AF435181C0FE297F64D1A5%2FDF54CDC6A1544804-1426266562540-5-0-SUCCEEDED-default.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0017-1426266547587-soberoi-%5BE8F7ECEBD6AF435181C0FE297F64D1A5%2FDF54CDC6A1544804-1426266562540-5-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:09:22,653 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0017_000001 State change from RUNNING to FINISHING
2015-03-13 10:09:22,653 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0017
2015-03-13 10:09:22,653 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0017 State change from RUNNING to REMOVING
2015-03-13 10:09:22,653 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0017
2015-03-13 10:09:22,654 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0017 State change from REMOVING to FINISHING
2015-03-13 10:09:22,676 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:22,798 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742027_1203
2015-03-13 10:09:22,798 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742029_1205
2015-03-13 10:09:22,799 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742028_1204
2015-03-13 10:09:22,800 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742030_1206
2015-03-13 10:09:22,800 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742031_1207
2015-03-13 10:09:22,801 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742024_1200
2015-03-13 10:09:22,801 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742025_1201
2015-03-13 10:09:22,984 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742030_1206
2015-03-13 10:09:22,985 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742024_1200
2015-03-13 10:09:22,985 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742027_1203
2015-03-13 10:09:22,986 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742025_1201
2015-03-13 10:09:22,987 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742031_1207
2015-03-13 10:09:22,987 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742026_1202
2015-03-13 10:09:22,987 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742029_1205
2015-03-13 10:09:23,356 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742028_1204
2015-03-13 10:09:23,357 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742026_1202
2015-03-13 10:09:23,378 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:09:23,378 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0017_01_000003
2015-03-13 10:09:23,378 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0017_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:09:23,379 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0017_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:09:23,379 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0017	CONTAINERID=container_1426266260362_0017_01_000003
2015-03-13 10:09:23,379 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0017_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:09:23,379 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:09:23,379 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0017_01_000003, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:23,379 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:23,380 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:09:23,380 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0017_000001 released container container_1426266260362_0017_01_000003 on node: host: 10.1.1.144:60715 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:09:23,475 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:09:23,476 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0017_01_000005
2015-03-13 10:09:23,476 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:09:23,476 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0017_01_000006
2015-03-13 10:09:23,477 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0017_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:09:23,477 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0017_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:09:23,477 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0017	CONTAINERID=container_1426266260362_0017_01_000005
2015-03-13 10:09:23,477 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0017_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:09:23,477 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:09:23,477 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0017_01_000005, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:23,478 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:23,478 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:09:23,478 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0017_000001 released container container_1426266260362_0017_01_000005 on node: host: 10.1.1.144:60711 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:09:23,478 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0017_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:09:23,478 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0017_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:09:23,478 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0017	CONTAINERID=container_1426266260362_0017_01_000006
2015-03-13 10:09:23,479 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0017_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:09:23,479 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:09:23,479 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0017_01_000006, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:23,479 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:23,479 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:09:23,479 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0017_000001 released container container_1426266260362_0017_01_000006 on node: host: 10.1.1.144:60711 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:09:23,659 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742019_1195 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60686 127.0.0.1:60693 
2015-03-13 10:09:23,660 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742020_1196 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60686 
2015-03-13 10:09:23,660 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742021_1197 127.0.0.1:60689 127.0.0.1:60686 127.0.0.1:60696 
2015-03-13 10:09:23,660 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742022_1198 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60696 
2015-03-13 10:09:23,660 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742026_1202 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60693 
2015-03-13 10:09:23,660 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742023_1199 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60696 
2015-03-13 10:09:23,661 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017	dst=null	perm=null
2015-03-13 10:09:23,679 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:23,691 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join	dst=null	perm=null
2015-03-13 10:09:23,691 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary
2015-03-13 10:09:23,691 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary	dst=null	perm=null
2015-03-13 10:09:23,699 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:09:23,699 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:09:23,699 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:09:23,700 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join	dst=null	perm=null
2015-03-13 10:09:23,701 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join	dst=null	perm=null
2015-03-13 10:09:23,701 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join	dst=null	perm=null
2015-03-13 10:09:23,703 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:09:23,704 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/part-00000	dst=null	perm=null
2015-03-13 10:09:23,705 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62237, bytes: 20, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742025_1201, duration: 185000
2015-03-13 10:09:23,706 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/part-00001	dst=null	perm=null
2015-03-13 10:09:23,708 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62238, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742027_1203, duration: 156000
2015-03-13 10:09:23,709 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/part-00002	dst=null	perm=null
2015-03-13 10:09:23,710 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62239, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742024_1200, duration: 156000
2015-03-13 10:09:23,711 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/part-00003	dst=null	perm=null
2015-03-13 10:09:23,712 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62237, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742028_1204, duration: 150000
2015-03-13 10:09:23,713 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/part-00004	dst=null	perm=null
2015-03-13 10:09:23,720 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:09:23,720 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:09:23,721 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:09:23,722 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join	dst=null	perm=null
2015-03-13 10:09:23,722 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join	dst=null	perm=null
2015-03-13 10:09:23,723 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join	dst=null	perm=null
2015-03-13 10:09:23,724 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:09:23,725 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/part-00000	dst=null	perm=null
2015-03-13 10:09:23,726 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62238, bytes: 20, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742025_1201, duration: 171000
2015-03-13 10:09:23,727 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/part-00001	dst=null	perm=null
2015-03-13 10:09:23,728 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62237, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742027_1203, duration: 156000
2015-03-13 10:09:23,728 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/part-00002	dst=null	perm=null
2015-03-13 10:09:23,729 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62238, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742024_1200, duration: 129000
2015-03-13 10:09:23,730 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/part-00003	dst=null	perm=null
2015-03-13 10:09:23,731 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62238, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742028_1204, duration: 158000
2015-03-13 10:09:23,732 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/part-00004	dst=null	perm=null
2015-03-13 10:09:23,732 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/join
2015-03-13 10:09:23,732 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join	dst=null	perm=null
2015-03-13 10:09:23,733 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join	dst=null	perm=null
2015-03-13 10:09:23,733 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join	dst=null	perm=null
2015-03-13 10:09:23,734 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join	dst=null	perm=null
2015-03-13 10:09:23,735 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/part-00000	dst=null	perm=null
2015-03-13 10:09:23,735 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/part-00000	dst=null	perm=null
2015-03-13 10:09:23,736 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62239, bytes: 20, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742025_1201, duration: 145000
2015-03-13 10:09:23,737 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/part-00001	dst=null	perm=null
2015-03-13 10:09:23,737 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/part-00001	dst=null	perm=null
2015-03-13 10:09:23,738 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742031_1207
2015-03-13 10:09:23,739 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62238, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742027_1203, duration: 109000
2015-03-13 10:09:23,739 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742025_1201
2015-03-13 10:09:23,739 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742027_1203
2015-03-13 10:09:23,739 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/part-00002	dst=null	perm=null
2015-03-13 10:09:23,739 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742030_1206
2015-03-13 10:09:23,740 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742029_1205
2015-03-13 10:09:23,740 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/part-00002	dst=null	perm=null
2015-03-13 10:09:23,740 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742024_1200
2015-03-13 10:09:23,740 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742026_1202
2015-03-13 10:09:23,740 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742028_1204
2015-03-13 10:09:23,741 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62238, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742024_1200, duration: 141000
2015-03-13 10:09:23,741 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/part-00003	dst=null	perm=null
2015-03-13 10:09:23,742 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/part-00003	dst=null	perm=null
2015-03-13 10:09:23,743 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62237, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742028_1204, duration: 165000
2015-03-13 10:09:23,744 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/part-00004	dst=null	perm=null
2015-03-13 10:09:23,744 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/part-00004	dst=null	perm=null
2015-03-13 10:09:23,745 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:09:23,746 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:09:23,746 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt	dst=null	perm=null
2015-03-13 10:09:23,747 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt	dst=null	perm=null
2015-03-13 10:09:23,757 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:09:23,758 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:09:23,759 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:09:23,773 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby	dst=null	perm=null
2015-03-13 10:09:23,774 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [merging] starting
2015-03-13 10:09:23,775 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [merging]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt"]
2015-03-13 10:09:23,775 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [merging]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-03-13 10:09:23,775 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [merging]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt"]
2015-03-13 10:09:23,775 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [merging]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-03-13 10:09:23,775 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [merging]  sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby"]
2015-03-13 10:09:23,775 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [merging]  parallel execution is enabled: true
2015-03-13 10:09:23,775 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [merging]  starting jobs: 1
2015-03-13 10:09:23,775 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [merging]  allocating threads: 1
2015-03-13 10:09:23,776 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [merging] starting step: (1/1) ...platform/joinsintogroupby
2015-03-13 10:09:23,784 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:09:23,793 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:09:23,794 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby	dst=null	perm=null
2015-03-13 10:09:23,794 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:09:23,795 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:09:23,797 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 18
2015-03-13 10:09:23,798 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018	dst=null	perm=null
2015-03-13 10:09:23,799 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018	dst=null	perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:09:23,799 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018	dst=null	perm=soberoi:supergroup:rwx------
2015-03-13 10:09:23,800 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.jar	dst=null	perm=null
2015-03-13 10:09:23,801 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:09:23,803 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073742032_1208{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:09:23,804 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742032_1208 src: /127.0.0.1:62241 dest: /127.0.0.1:60696
2015-03-13 10:09:23,805 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742032_1208 src: /127.0.0.1:62242 dest: /127.0.0.1:60693
2015-03-13 10:09:23,806 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742032_1208 src: /127.0.0.1:62243 dest: /127.0.0.1:60689
2015-03-13 10:09:23,810 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62243, dest: /127.0.0.1:60689, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742032_1208, duration: 1720000
2015-03-13 10:09:23,810 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742032_1208, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:23,811 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742032_1208{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:09:23,811 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62242, dest: /127.0.0.1:60693, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742032_1208, duration: 2327000
2015-03-13 10:09:23,811 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742032_1208, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:23,811 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742032_1208{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:09:23,811 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62241, dest: /127.0.0.1:60696, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742032_1208, duration: 2973000
2015-03-13 10:09:23,812 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742032_1208, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:23,813 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742032_1208{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:09:23,813 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:09:23,814 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.jar
2015-03-13 10:09:23,814 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.jar	dst=null	perm=null
2015-03-13 10:09:23,815 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:09:23,816 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:09:23,817 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:09:23,817 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:09:23,818 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:09:23,818 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:09:23,819 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:09:23,819 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:09:23,820 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:09:23,820 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:09:23,822 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:09:23,822 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:09:23,822 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:09:23,823 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt	dst=null	perm=null
2015-03-13 10:09:23,824 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:09:23,824 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt	dst=null	perm=null
2015-03-13 10:09:23,825 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:09:23,825 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:09:23,826 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:09:23,827 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt	dst=null	perm=null
2015-03-13 10:09:23,827 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:09:23,827 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt	dst=null	perm=null
2015-03-13 10:09:23,829 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:09:23,830 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:09:23,831 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.split
2015-03-13 10:09:23,831 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.split	dst=null	perm=null
2015-03-13 10:09:23,832 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073742033_1209{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:09:23,833 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742033_1209 src: /127.0.0.1:62244 dest: /127.0.0.1:60686
2015-03-13 10:09:23,834 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742033_1209 src: /127.0.0.1:62245 dest: /127.0.0.1:60689
2015-03-13 10:09:23,835 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742033_1209 src: /127.0.0.1:62246 dest: /127.0.0.1:60696
2015-03-13 10:09:23,836 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742033_1209 src: /127.0.0.1:62247 dest: /127.0.0.1:60693
2015-03-13 10:09:23,839 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62247, dest: /127.0.0.1:60693, bytes: 2133, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742033_1209, duration: 1692000
2015-03-13 10:09:23,839 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742033_1209, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:23,840 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742033_1209{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:09:23,840 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62246, dest: /127.0.0.1:60696, bytes: 2133, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742033_1209, duration: 2001000
2015-03-13 10:09:23,840 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742033_1209, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:23,840 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742033_1209{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:09:23,840 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62245, dest: /127.0.0.1:60689, bytes: 2133, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742033_1209, duration: 2763000
2015-03-13 10:09:23,841 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742033_1209, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:23,841 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742033_1209{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:09:23,841 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62244, dest: /127.0.0.1:60686, bytes: 2133, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742033_1209, duration: 3351000
2015-03-13 10:09:23,841 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742033_1209, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:23,842 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742033_1209{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:09:23,843 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:09:23,844 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:09:23,846 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:09:23,846 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073742034_1210{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:09:23,848 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742034_1210 src: /127.0.0.1:62248 dest: /127.0.0.1:60696
2015-03-13 10:09:23,849 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742034_1210 src: /127.0.0.1:62249 dest: /127.0.0.1:60689
2015-03-13 10:09:23,850 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742034_1210 src: /127.0.0.1:62250 dest: /127.0.0.1:60686
2015-03-13 10:09:23,852 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62250, dest: /127.0.0.1:60686, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742034_1210, duration: 1153000
2015-03-13 10:09:23,852 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742034_1210, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:23,853 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742034_1210{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:09:23,853 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62249, dest: /127.0.0.1:60689, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742034_1210, duration: 1656000
2015-03-13 10:09:23,853 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742034_1210, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:23,854 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62248, dest: /127.0.0.1:60696, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742034_1210, duration: 2361000
2015-03-13 10:09:23,854 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742034_1210{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:09:23,854 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742034_1210, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:23,855 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742034_1210{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:09:23,855 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:09:23,856 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:6
2015-03-13 10:09:23,857 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:09:23,858 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:09:23,859 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:09:23,859 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:09:23,860 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:09:23,862 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742035_1211{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:09:23,864 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742035_1211 src: /127.0.0.1:62251 dest: /127.0.0.1:60696
2015-03-13 10:09:23,865 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742035_1211 src: /127.0.0.1:62252 dest: /127.0.0.1:60693
2015-03-13 10:09:23,866 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742035_1211 src: /127.0.0.1:62253 dest: /127.0.0.1:60686
2015-03-13 10:09:23,868 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62253, dest: /127.0.0.1:60686, bytes: 100334, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742035_1211, duration: 1491000
2015-03-13 10:09:23,869 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742035_1211, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:23,869 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742035_1211{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:09:23,869 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62252, dest: /127.0.0.1:60693, bytes: 100334, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742035_1211, duration: 2000000
2015-03-13 10:09:23,869 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742035_1211, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:23,870 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742035_1211{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:09:23,870 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62251, dest: /127.0.0.1:60696, bytes: 100334, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742035_1211, duration: 2710000
2015-03-13 10:09:23,870 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742035_1211, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:23,871 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742035_1211{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:09:23,871 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:09:23,872 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0018
2015-03-13 10:09:23,873 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018	dst=null	perm=null
2015-03-13 10:09:23,873 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.xml	dst=null	perm=null
2015-03-13 10:09:23,874 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.xml	dst=null	perm=null
2015-03-13 10:09:23,874 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.jar	dst=null	perm=null
2015-03-13 10:09:23,875 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.jar	dst=null	perm=null
2015-03-13 10:09:23,875 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.split	dst=null	perm=null
2015-03-13 10:09:23,876 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.split	dst=null	perm=null
2015-03-13 10:09:23,876 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:09:23,877 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:09:23,878 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:09:23,879 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:09:23,879 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:09:23,880 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:09:23,880 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:09:23,881 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:09:23,882 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 18 submitted by user soberoi
2015-03-13 10:09:23,882 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0018
2015-03-13 10:09:23,882 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	IP=10.1.1.144	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1426266260362_0018
2015-03-13 10:09:23,882 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0018
2015-03-13 10:09:23,882 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0018 State change from NEW to NEW_SAVING
2015-03-13 10:09:23,882 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0018 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:09:23,883 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0018_000001
2015-03-13 10:09:23,883 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0018_000001 State change from NEW to SUBMITTED
2015-03-13 10:09:23,883 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0018 from user: soberoi activated in queue: default
2015-03-13 10:09:23,883 INFO  capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0018 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:09:23,883 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0018 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:09:23,883 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0018 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:09:23,883 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0018_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:09:23,883 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0018_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:09:23,885 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0018 State change from SUBMITTED to ACCEPTED
2015-03-13 10:09:23,885 INFO  mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0018/
2015-03-13 10:09:23,886 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [merging] submitted hadoop job: job_1426266260362_0018
2015-03-13 10:09:23,886 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [merging] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0018/
2015-03-13 10:09:24,382 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:09:24,383 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0018	CONTAINERID=container_1426266260362_0018_01_000001
2015-03-13 10:09:24,383 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0018_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:09:24,383 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0018 container=Container: [ContainerId: container_1426266260362_0018_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0018_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:24,384 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:09:24,384 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:09:24,384 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:24,385 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0018 AttemptId: appattempt_1426266260362_0018_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0018_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ]
2015-03-13 10:09:24,385 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0018_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:09:24,385 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0018_000001
2015-03-13 10:09:24,385 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0018_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:09:24,385 INFO  amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0018_000001
2015-03-13 10:09:24,386 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0018_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] for AM appattempt_1426266260362_0018_000001
2015-03-13 10:09:24,386 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0018_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-03-13 10:09:24,388 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0018_000001 (auth:SIMPLE)
2015-03-13 10:09:24,389 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0018_01_000001 by user soberoi
2015-03-13 10:09:24,389 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0018
2015-03-13 10:09:24,389 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0018	CONTAINERID=container_1426266260362_0018_01_000001
2015-03-13 10:09:24,390 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0018 transitioned from NEW to INITING
2015-03-13 10:09:24,390 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0018_01_000001 to application application_1426266260362_0018
2015-03-13 10:09:24,390 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0018_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] for AM appattempt_1426266260362_0018_000001
2015-03-13 10:09:24,390 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0018 transitioned from INITING to RUNNING
2015-03-13 10:09:24,390 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0018_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:09:24,390 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:09:24,390 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0018
2015-03-13 10:09:24,390 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:09:24,390 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:09:24,391 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:09:24,391 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:09:24,391 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0018_01_000001
2015-03-13 10:09:24,400 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426266260362_0018_01_000001.tokens. Credentials list: 
2015-03-13 10:09:24,414 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:09:24,480 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426266260362_0018_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000001.tokens
2015-03-13 10:09:24,481 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0018 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0018
2015-03-13 10:09:24,536 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.jar	dst=null	perm=null
2015-03-13 10:09:24,537 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.jar	dst=null	perm=null
2015-03-13 10:09:24,538 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.jar	dst=null	perm=null
2015-03-13 10:09:24,543 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62238, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1745663571_9329, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742032_1208, duration: 506000
2015-03-13 10:09:24,563 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:09:24,579 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:09:24,579 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:09:24,580 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:09:24,586 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62257, bytes: 222, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1745663571_9329, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742034_1210, duration: 115000
2015-03-13 10:09:24,598 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:09:24,615 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.split	dst=null	perm=null
2015-03-13 10:09:24,615 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.split	dst=null	perm=null
2015-03-13 10:09:24,616 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.split	dst=null	perm=null
2015-03-13 10:09:24,621 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62257, bytes: 2153, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1745663571_9329, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742033_1209, duration: 166000
2015-03-13 10:09:24,633 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:09:24,649 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.xml	dst=null	perm=null
2015-03-13 10:09:24,650 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.xml	dst=null	perm=null
2015-03-13 10:09:24,651 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.xml	dst=null	perm=null
2015-03-13 10:09:24,656 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62238, bytes: 101118, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1745663571_9329, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742035_1211, duration: 254000
2015-03-13 10:09:24,669 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:09:24,669 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:09:24,680 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:24,692 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:09:24,692 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:24,756 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000001/default_container_executor.sh]
2015-03-13 10:09:24,891 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60696 to replicate blk_1073742032_1208 to datanode(s) 127.0.0.1:60686
2015-03-13 10:09:24,891 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073742019_1195, blk_1073742020_1196, blk_1073742021_1197, blk_1073742022_1198, blk_1073742023_1199, blk_1073742026_1202]
2015-03-13 10:09:24,891 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073742019_1195, blk_1073742020_1196, blk_1073742021_1197, blk_1073742022_1198, blk_1073742023_1199]
2015-03-13 10:09:25,385 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:25,385 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:09:25,508 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742019_1195 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742019 for deletion
2015-03-13 10:09:25,508 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742019_1195 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742019 for deletion
2015-03-13 10:09:25,509 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742020_1196 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742020 for deletion
2015-03-13 10:09:25,509 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742021_1197 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742021 for deletion
2015-03-13 10:09:25,509 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742019_1195 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742019
2015-03-13 10:09:25,509 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742020_1196 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742020 for deletion
2015-03-13 10:09:25,509 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742020_1196 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742020
2015-03-13 10:09:25,509 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742019_1195 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742019
2015-03-13 10:09:25,509 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742022_1198 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742022 for deletion
2015-03-13 10:09:25,509 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742020_1196 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742020
2015-03-13 10:09:25,509 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742021_1197 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742021 for deletion
2015-03-13 10:09:25,510 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742021_1197 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742021
2015-03-13 10:09:25,510 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742023_1199 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742023 for deletion
2015-03-13 10:09:25,510 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742022_1198 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742022
2015-03-13 10:09:25,510 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742022_1198 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742022 for deletion
2015-03-13 10:09:25,510 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742023_1199 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742023
2015-03-13 10:09:25,510 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742021_1197 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742021
2015-03-13 10:09:25,510 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742022_1198 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742022
2015-03-13 10:09:25,510 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742023_1199 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742023 for deletion
2015-03-13 10:09:25,511 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742026_1202 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742026 for deletion
2015-03-13 10:09:25,511 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742023_1199 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742023
2015-03-13 10:09:25,511 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742026_1202 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742026
2015-03-13 10:09:25,685 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:25,876 INFO  datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-318492837-10.1.1.144-60696-1426266259571, infoPort=60697, ipcPort=60698, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073742032_1208 to 127.0.0.1:60686 
2015-03-13 10:09:25,878 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742032_1208 src: /127.0.0.1:62258 dest: /127.0.0.1:60686
2015-03-13 10:09:25,878 INFO  datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073742032_1208 (numBytes=254067) to /127.0.0.1:60686
2015-03-13 10:09:25,879 INFO  datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073742032_1208 src: /127.0.0.1:62258 dest: /127.0.0.1:60686 of size 254067
2015-03-13 10:09:25,880 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742032_1208 size 254067
2015-03-13 10:09:26,353 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:09:26,374 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/COMMIT_STARTED	dst=null	perm=null
2015-03-13 10:09:26,375 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/COMMIT_SUCCESS	dst=null	perm=null
2015-03-13 10:09:26,376 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/COMMIT_FAIL	dst=null	perm=null
2015-03-13 10:09:26,385 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:26,427 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018	dst=null	perm=null
2015-03-13 10:09:26,428 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:09:26,429 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:09:26,687 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:26,704 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:09:26,710 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:09:26,764 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62260, bytes: 222, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-869631751_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742034_1210, duration: 177000
2015-03-13 10:09:27,386 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:27,552 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0018_000001 (auth:SIMPLE)
2015-03-13 10:09:27,554 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0018_000001
2015-03-13 10:09:27,554 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi	IP=10.1.1.144	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1426266260362_0018	APPATTEMPTID=appattempt_1426266260362_0018_000001
2015-03-13 10:09:27,554 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0018_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:09:27,554 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0018 State change from ACCEPTED to RUNNING
2015-03-13 10:09:27,575 INFO  namenode.FSEditLog (FSEditLog.java:printStatistics(663)) - Number of transactions: 1763 Total time for transactions(ms): 84 Number of transactions batched in Syncs: 2 Number of syncs: 1000 SyncTimes(ms): 288 219 
2015-03-13 10:09:27,576 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job_1426266260362_0018_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:27,579 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:09:27,639 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job_1426266260362_0018_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:27,693 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:27,758 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job_1426266260362_0018_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742036_1212{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:09:27,802 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742036_1212 src: /127.0.0.1:62266 dest: /127.0.0.1:60696
2015-03-13 10:09:27,804 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742034_1210
2015-03-13 10:09:27,805 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742033_1209
2015-03-13 10:09:27,805 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742036_1212 src: /127.0.0.1:62267 dest: /127.0.0.1:60693
2015-03-13 10:09:27,806 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742032_1208
2015-03-13 10:09:27,807 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742036_1212 src: /127.0.0.1:62268 dest: /127.0.0.1:60686
2015-03-13 10:09:27,815 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62268, dest: /127.0.0.1:60686, bytes: 92846, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-869631751_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742036_1212, duration: 6648000
2015-03-13 10:09:27,816 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742036_1212, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:27,816 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742036_1212{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:09:27,816 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62267, dest: /127.0.0.1:60693, bytes: 92846, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-869631751_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742036_1212, duration: 7137000
2015-03-13 10:09:27,816 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742036_1212, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:27,817 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742036_1212{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:09:27,817 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62266, dest: /127.0.0.1:60696, bytes: 92846, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-869631751_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742036_1212, duration: 8037000
2015-03-13 10:09:27,817 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742036_1212, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:27,817 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742036_1212{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:09:27,822 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job_1426266260362_0018_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-869631751_1
2015-03-13 10:09:27,896 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073742019_1195, blk_1073742020_1196, blk_1073742026_1202]
2015-03-13 10:09:27,896 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073742019_1195, blk_1073742020_1196, blk_1073742021_1197, blk_1073742022_1198, blk_1073742023_1199, blk_1073742026_1202]
2015-03-13 10:09:27,992 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742036_1212
2015-03-13 10:09:27,993 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742033_1209
2015-03-13 10:09:28,196 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742032_1208
2015-03-13 10:09:28,197 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742035_1211
2015-03-13 10:09:28,360 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742033_1209
2015-03-13 10:09:28,360 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742034_1210
2015-03-13 10:09:28,361 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742035_1211
2015-03-13 10:09:28,362 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742036_1212
2015-03-13 10:09:28,387 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:28,563 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742032_1208
2015-03-13 10:09:28,601 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:09:28,601 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0018	CONTAINERID=container_1426266260362_0018_01_000002
2015-03-13 10:09:28,601 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0018_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:09:28,602 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0018 container=Container: [ContainerId: container_1426266260362_0018_01_000002, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0018_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:28,602 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:09:28,602 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:28,603 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:09:28,603 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0018	CONTAINERID=container_1426266260362_0018_01_000003
2015-03-13 10:09:28,603 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0018_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:09:28,603 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0018 container=Container: [ContainerId: container_1426266260362_0018_01_000003, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0018_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:28,603 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:09:28,604 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:28,604 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:09:28,604 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0018	CONTAINERID=container_1426266260362_0018_01_000004
2015-03-13 10:09:28,604 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0018_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:09:28,605 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0018 container=Container: [ContainerId: container_1426266260362_0018_01_000004, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0018_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:28,605 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:09:28,605 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:28,605 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:09:28,605 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0018	CONTAINERID=container_1426266260362_0018_01_000005
2015-03-13 10:09:28,605 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0018_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:09:28,605 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0018 container=Container: [ContainerId: container_1426266260362_0018_01_000005, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0018_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:28,606 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:09:28,606 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:28,687 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742019_1195 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742019 for deletion
2015-03-13 10:09:28,687 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742020_1196 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742020 for deletion
2015-03-13 10:09:28,687 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742026_1202 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742026 for deletion
2015-03-13 10:09:28,687 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742019_1195 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742019
2015-03-13 10:09:28,687 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742020_1196 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742020
2015-03-13 10:09:28,688 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742026_1202 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742026
2015-03-13 10:09:28,698 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:28,699 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:09:28,699 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0018	CONTAINERID=container_1426266260362_0018_01_000006
2015-03-13 10:09:28,699 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0018_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:09:28,699 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0018 container=Container: [ContainerId: container_1426266260362_0018_01_000006, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0018_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:28,699 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7
2015-03-13 10:09:28,700 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:28,700 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000007 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:09:28,700 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0018	CONTAINERID=container_1426266260362_0018_01_000007
2015-03-13 10:09:28,700 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0018_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available
2015-03-13 10:09:28,700 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0018 container=Container: [ContainerId: container_1426266260362_0018_01_000007, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0018_01_000007 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7 usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:28,701 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:10240, vCores:8>usedCapacity=0.625, absoluteUsedCapacity=0.625, numApps=2, numContainers=8
2015-03-13 10:09:28,701 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.625 absoluteUsedCapacity=0.625 used=<memory:10240, vCores:8> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:28,749 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742035_1211
2015-03-13 10:09:28,795 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0017_01_000001 succeeded 
2015-03-13 10:09:28,795 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:09:28,795 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0017_01_000001
2015-03-13 10:09:28,803 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000001
2015-03-13 10:09:28,803 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000001
2015-03-13 10:09:28,803 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000001
2015-03-13 10:09:28,803 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000001
2015-03-13 10:09:28,803 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0017	CONTAINERID=container_1426266260362_0017_01_000001
2015-03-13 10:09:28,804 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:09:28,804 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0017_01_000001 from application application_1426266260362_0017
2015-03-13 10:09:28,804 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:28,804 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0017
2015-03-13 10:09:28,881 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742019_1195 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742019 for deletion
2015-03-13 10:09:28,881 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742020_1196 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742020 for deletion
2015-03-13 10:09:28,881 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742021_1197 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742021 for deletion
2015-03-13 10:09:28,881 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742022_1198 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742022 for deletion
2015-03-13 10:09:28,882 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742019_1195 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742019
2015-03-13 10:09:28,882 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742020_1196 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742020
2015-03-13 10:09:28,882 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742023_1199 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742023 for deletion
2015-03-13 10:09:28,882 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742026_1202 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742026 for deletion
2015-03-13 10:09:28,882 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742022_1198 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742022
2015-03-13 10:09:28,882 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742021_1197 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742021
2015-03-13 10:09:28,882 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742023_1199 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742023
2015-03-13 10:09:28,883 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742026_1202 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742026
2015-03-13 10:09:28,955 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742032_1208
2015-03-13 10:09:28,956 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742036_1212
2015-03-13 10:09:28,956 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742034_1210
2015-03-13 10:09:28,957 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742033_1209
2015-03-13 10:09:29,387 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:29,584 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:09:29,585 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:09:29,585 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:09:29,585 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:09:29,585 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:09:29,585 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000007 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:09:29,613 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.jar	dst=null	perm=null
2015-03-13 10:09:29,614 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.jar	dst=null	perm=null
2015-03-13 10:09:29,622 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.xml	dst=null	perm=null
2015-03-13 10:09:29,623 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.xml	dst=null	perm=null
2015-03-13 10:09:29,625 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:09:29,626 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:09:29,647 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:09:29,651 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:09:29,652 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:09:29,653 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:09:29,701 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:09:29,701 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0017_01_000001
2015-03-13 10:09:29,701 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0017_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:09:29,701 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0017_000001
2015-03-13 10:09:29,701 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0017_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:09:29,702 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0017	CONTAINERID=container_1426266260362_0017_01_000001
2015-03-13 10:09:29,702 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0017_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60723, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:09:29,702 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0017_000001 State change from FINISHING to FINISHED
2015-03-13 10:09:29,702 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0017 State change from FINISHING to FINISHED
2015-03-13 10:09:29,702 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:8192, vCores:7> numContainers=7 user=soberoi user-resources=<memory:8192, vCores:7>
2015-03-13 10:09:29,702 INFO  amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0017_000001
2015-03-13 10:09:29,702 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0017_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:7>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=7 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:29,702 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1426266260362_0017
2015-03-13 10:09:29,702 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0017,name=[E8F7ECEBD6AF435181C0FE297F64D1A5/DF54CDC6A1544804917CE472FDCAAAEE] lower*upper/(1/1) ...fieldedpipesplatform/join,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0017/jobhistory/job/job_1426266260362_0017,appMasterHost=Edinburgh.local,startTime=1426266547587,finishTime=1426266562654,finalStatus=SUCCEEDED
2015-03-13 10:09:29,702 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:29,703 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:7>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=7
2015-03-13 10:09:29,703 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0017_000001 released container container_1426266260362_0017_01_000001 on node: host: 10.1.1.144:60723 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:09:29,703 INFO  capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0017_000001 is done. finalState=FINISHED
2015-03-13 10:09:29,703 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0017 requests cleared
2015-03-13 10:09:29,703 INFO  capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0017 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:09:29,703 INFO  capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0017 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:09:29,705 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0017_000001 (auth:SIMPLE)
2015-03-13 10:09:29,706 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0017_01_000001
2015-03-13 10:09:29,713 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0018_000001 (auth:SIMPLE)
2015-03-13 10:09:29,713 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0018_000001 (auth:SIMPLE)
2015-03-13 10:09:29,716 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0018_01_000002 by user soberoi
2015-03-13 10:09:29,716 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0018
2015-03-13 10:09:29,717 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0018_01_000003 by user soberoi
2015-03-13 10:09:29,717 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0018	CONTAINERID=container_1426266260362_0018_01_000003
2015-03-13 10:09:29,717 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0018_01_000007 by user soberoi
2015-03-13 10:09:29,717 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0018
2015-03-13 10:09:29,717 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0018_01_000004 by user soberoi
2015-03-13 10:09:29,717 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0018 transitioned from NEW to INITING
2015-03-13 10:09:29,717 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0018	CONTAINERID=container_1426266260362_0018_01_000004
2015-03-13 10:09:29,718 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0018 transitioned from NEW to INITING
2015-03-13 10:09:29,718 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0018_01_000007 to application application_1426266260362_0018
2015-03-13 10:09:29,718 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0018 transitioned from INITING to RUNNING
2015-03-13 10:09:29,717 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0018_01_000006 by user soberoi
2015-03-13 10:09:29,718 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000007 transitioned from NEW to LOCALIZING
2015-03-13 10:09:29,718 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0018	CONTAINERID=container_1426266260362_0018_01_000006
2015-03-13 10:09:29,717 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0018	CONTAINERID=container_1426266260362_0018_01_000002
2015-03-13 10:09:29,718 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0018
2015-03-13 10:09:29,719 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0018
2015-03-13 10:09:29,719 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:09:29,719 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0018
2015-03-13 10:09:29,719 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:09:29,719 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:09:29,719 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0018_01_000006 to application application_1426266260362_0018
2015-03-13 10:09:29,719 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0018_01_000007
2015-03-13 10:09:29,718 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0018_01_000002 to application application_1426266260362_0018
2015-03-13 10:09:29,720 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0018_01_000003 to application application_1426266260362_0018
2015-03-13 10:09:29,720 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0018_01_000004 to application application_1426266260362_0018
2015-03-13 10:09:29,720 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:09:29,720 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0018
2015-03-13 10:09:29,720 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0018
2015-03-13 10:09:29,721 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:09:29,721 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0018
2015-03-13 10:09:29,721 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0018_01_000006
2015-03-13 10:09:29,717 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0018	CONTAINERID=container_1426266260362_0018_01_000007
2015-03-13 10:09:29,717 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0018_01_000005 by user soberoi
2015-03-13 10:09:29,722 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0018	CONTAINERID=container_1426266260362_0018_01_000005
2015-03-13 10:09:29,720 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0018 transitioned from INITING to RUNNING
2015-03-13 10:09:29,722 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:09:29,723 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:09:29,723 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:09:29,723 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0018_01_000005 to application application_1426266260362_0018
2015-03-13 10:09:29,723 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0018
2015-03-13 10:09:29,723 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0018
2015-03-13 10:09:29,723 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:09:29,723 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0018
2015-03-13 10:09:29,723 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:09:29,723 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:09:29,724 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0018
2015-03-13 10:09:29,724 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0018
2015-03-13 10:09:29,724 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:09:29,724 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0018
2015-03-13 10:09:29,724 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0018
2015-03-13 10:09:29,724 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0018
2015-03-13 10:09:29,724 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:09:29,724 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0018
2015-03-13 10:09:29,725 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:09:29,725 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0018_01_000003
2015-03-13 10:09:29,726 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0018_01_000002
2015-03-13 10:09:29,727 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0018_01_000004
2015-03-13 10:09:29,728 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0018
2015-03-13 10:09:29,728 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0018
2015-03-13 10:09:29,729 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:09:29,729 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0018
2015-03-13 10:09:29,729 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0018_01_000005
2015-03-13 10:09:29,748 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426266260362_0018_01_000007.tokens. Credentials list: 
2015-03-13 10:09:29,749 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0018_01_000004.tokens. Credentials list: 
2015-03-13 10:09:29,750 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0018_01_000003.tokens. Credentials list: 
2015-03-13 10:09:29,750 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1426266260362_0018_01_000006.tokens. Credentials list: 
2015-03-13 10:09:29,752 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0018_01_000002.tokens. Credentials list: 
2015-03-13 10:09:29,754 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0018_01_000005.tokens. Credentials list: 
2015-03-13 10:09:29,772 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:09:29,772 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:09:29,858 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426266260362_0018_01_000007.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000007.tokens
2015-03-13 10:09:29,858 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0018 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0018
2015-03-13 10:09:29,859 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0018_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000004.tokens
2015-03-13 10:09:29,859 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0018 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0018
2015-03-13 10:09:29,931 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.jar	dst=null	perm=null
2015-03-13 10:09:29,932 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.jar	dst=null	perm=null
2015-03-13 10:09:29,932 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.jar	dst=null	perm=null
2015-03-13 10:09:29,932 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.jar	dst=null	perm=null
2015-03-13 10:09:29,933 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.jar	dst=null	perm=null
2015-03-13 10:09:29,933 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.jar	dst=null	perm=null
2015-03-13 10:09:29,949 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62276, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1347572288_9478, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742032_1208, duration: 487000
2015-03-13 10:09:29,949 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62277, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_605198009_9479, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742032_1208, duration: 544000
2015-03-13 10:09:29,972 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:09:29,972 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:09:29,991 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.xml	dst=null	perm=null
2015-03-13 10:09:29,991 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.xml	dst=null	perm=null
2015-03-13 10:09:29,992 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.xml	dst=null	perm=null
2015-03-13 10:09:29,992 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.xml	dst=null	perm=null
2015-03-13 10:09:29,993 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.xml	dst=null	perm=null
2015-03-13 10:09:29,993 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.xml	dst=null	perm=null
2015-03-13 10:09:29,999 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62278, bytes: 101118, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_605198009_9479, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742035_1211, duration: 290000
2015-03-13 10:09:30,004 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62277, bytes: 101118, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1347572288_9478, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742035_1211, duration: 265000
2015-03-13 10:09:30,015 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:09:30,015 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:09:30,015 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:09:30,015 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:09:30,015 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:09:30,024 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:09:30,024 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000007 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:09:30,024 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:09:30,063 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:09:30,063 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:30,071 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:09:30,071 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:30,076 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:09:30,077 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:30,079 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000007 transitioned from LOCALIZED to RUNNING
2015-03-13 10:09:30,079 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:30,085 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:09:30,085 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:30,102 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:09:30,102 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:30,226 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000003/default_container_executor.sh]
2015-03-13 10:09:30,233 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000005/default_container_executor.sh]
2015-03-13 10:09:30,240 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000002/default_container_executor.sh]
2015-03-13 10:09:30,264 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000007/default_container_executor.sh]
2015-03-13 10:09:30,265 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000006/default_container_executor.sh]
2015-03-13 10:09:30,306 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000004/default_container_executor.sh]
2015-03-13 10:09:30,390 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:30,390 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0017 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:09:30,390 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0017
2015-03-13 10:09:30,391 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0017
2015-03-13 10:09:30,391 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0017 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:09:30,391 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0017, with delay of 10800 seconds
2015-03-13 10:09:30,391 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0017
2015-03-13 10:09:30,391 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0017
2015-03-13 10:09:30,392 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0017
2015-03-13 10:09:30,496 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0017 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:09:30,497 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0017
2015-03-13 10:09:30,497 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0017
2015-03-13 10:09:30,497 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0017 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:09:30,497 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0017, with delay of 10800 seconds
2015-03-13 10:09:30,497 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0017
2015-03-13 10:09:30,498 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0017
2015-03-13 10:09:30,498 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0017
2015-03-13 10:09:30,602 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:09:30,606 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:30,606 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:30,607 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:30,607 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:30,607 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:09:30,607 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:09:30,607 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:09:30,608 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:09:30,706 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:30,706 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:30,706 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0017 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:09:30,706 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:09:30,706 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0017
2015-03-13 10:09:30,707 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0017
2015-03-13 10:09:30,707 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0017
2015-03-13 10:09:30,707 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0017 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:09:30,707 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0017, with delay of 10800 seconds
2015-03-13 10:09:30,707 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0017
2015-03-13 10:09:30,706 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000007 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:09:30,707 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0017
2015-03-13 10:09:31,043 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:09:31,061 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:09:31,157 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0018_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000005.tokens
2015-03-13 10:09:31,157 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0018 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0018
2015-03-13 10:09:31,181 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1426266260362_0018_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000006.tokens
2015-03-13 10:09:31,181 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0018 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0018
2015-03-13 10:09:31,265 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:09:31,394 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:31,406 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0018_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000002.tokens
2015-03-13 10:09:31,406 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0018 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0018
2015-03-13 10:09:31,520 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:09:31,611 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:31,612 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:31,612 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:31,612 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:31,661 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0018_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000003.tokens
2015-03-13 10:09:31,661 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0018 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0018
2015-03-13 10:09:31,710 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:31,710 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:32,398 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:32,617 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:32,617 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:32,617 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:32,618 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:32,711 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:32,711 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:33,401 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:33,620 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:33,620 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:33,621 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:33,621 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:33,713 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:33,714 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:34,402 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:34,626 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:34,626 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:34,626 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:34,627 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:34,719 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:34,719 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:35,403 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:35,627 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:35,628 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:35,628 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:35,628 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:35,725 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:35,725 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:36,406 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:36,633 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:36,633 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:36,633 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:36,634 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:36,729 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:36,730 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:37,410 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:37,638 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:37,639 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:37,639 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:37,639 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:37,734 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:37,734 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:38,410 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:38,643 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:38,643 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:38,643 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:38,644 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:38,736 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:38,737 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:39,411 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:39,624 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.split	dst=null	perm=null
2015-03-13 10:09:39,647 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:39,647 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:39,647 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:39,647 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:39,735 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.split	dst=null	perm=null
2015-03-13 10:09:39,741 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:39,741 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:39,777 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.split	dst=null	perm=null
2015-03-13 10:09:39,828 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.split	dst=null	perm=null
2015-03-13 10:09:39,838 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62291, bytes: 2153, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0018_m_000001_0_107862477_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742033_1209, duration: 145000
2015-03-13 10:09:39,982 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62294, bytes: 2153, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0018_m_000000_0_-1276300845_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742033_1209, duration: 153000
2015-03-13 10:09:39,992 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.split	dst=null	perm=null
2015-03-13 10:09:40,018 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62295, bytes: 1637, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0018_m_000002_0_-173108709_1, offset: 512, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742033_1209, duration: 157000
2015-03-13 10:09:40,042 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.split	dst=null	perm=null
2015-03-13 10:09:40,063 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt	dst=null	perm=null
2015-03-13 10:09:40,067 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62299, bytes: 56, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0018_m_000001_0_107862477_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741912_1088, duration: 174000
2015-03-13 10:09:40,068 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62297, bytes: 605, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0018_m_000005_0_68992022_1, offset: 1536, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742033_1209, duration: 128000
2015-03-13 10:09:40,140 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt	dst=null	perm=null
2015-03-13 10:09:40,174 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62300, bytes: 1121, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0018_m_000003_0_-20792857_1, offset: 1024, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742033_1209, duration: 184000
2015-03-13 10:09:40,186 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:09:40,210 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62301, bytes: 1121, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0018_m_000004_0_1920819369_1, offset: 1024, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742033_1209, duration: 119000
2015-03-13 10:09:40,218 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:09:40,222 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62302, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0018_m_000005_0_68992022_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 166000
2015-03-13 10:09:40,334 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:09:40,338 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62303, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0018_m_000003_0_-20792857_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 156000
2015-03-13 10:09:40,363 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:09:40,372 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62304, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0018_m_000004_0_1920819369_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 173000
2015-03-13 10:09:40,415 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:40,651 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:40,651 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:40,651 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:40,652 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:40,697 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt	dst=null	perm=null
2015-03-13 10:09:40,740 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt	dst=null	perm=null
2015-03-13 10:09:40,743 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt	dst=null	perm=null
2015-03-13 10:09:40,743 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:40,744 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:40,748 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62305, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0018_m_000001_0_107862477_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741913_1089, duration: 183000
2015-03-13 10:09:40,797 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby/_temporary/1/_temporary/attempt_1426266260362_0018_m_000001_0	dst=null	perm=null
2015-03-13 10:09:40,819 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0018_000001 (auth:SIMPLE)
2015-03-13 10:09:40,821 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0018_01_000003
2015-03-13 10:09:40,821 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0018	CONTAINERID=container_1426266260362_0018_01_000003
2015-03-13 10:09:40,821 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:09:40,822 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0018_01_000003
2015-03-13 10:09:40,822 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:40,822 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:09:40,822 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:40,822 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:40,824 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt	dst=null	perm=null
2015-03-13 10:09:40,834 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0018_01_000003 is : 143
2015-03-13 10:09:40,838 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job_1426266260362_0018_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073742037_1213{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:09:40,840 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742037_1213 src: /127.0.0.1:62308 dest: /127.0.0.1:60689
2015-03-13 10:09:40,841 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742037_1213 src: /127.0.0.1:62309 dest: /127.0.0.1:60686
2015-03-13 10:09:40,842 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742037_1213 src: /127.0.0.1:62310 dest: /127.0.0.1:60696
2015-03-13 10:09:40,846 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:09:40,847 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000003
2015-03-13 10:09:40,847 INFO  hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job_1426266260362_0018_1.jhist for DFSClient_NONMAPREDUCE_-869631751_1
2015-03-13 10:09:40,847 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0018	CONTAINERID=container_1426266260362_0018_01_000003
2015-03-13 10:09:40,847 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:09:40,847 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000003
2015-03-13 10:09:40,847 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000003
2015-03-13 10:09:40,847 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000003
2015-03-13 10:09:40,847 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0018_01_000003 from application application_1426266260362_0018
2015-03-13 10:09:40,848 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:40,848 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0018
2015-03-13 10:09:40,853 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:09:40,864 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt	dst=null	perm=null
2015-03-13 10:09:40,868 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt	dst=null	perm=null
2015-03-13 10:09:40,872 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:09:40,872 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62294, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0018_m_000000_0_-1276300845_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741913_1089, duration: 141000
2015-03-13 10:09:40,879 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62311, bytes: 56, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0018_m_000000_0_-1276300845_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741912_1088, duration: 160000
2015-03-13 10:09:40,879 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:09:40,884 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62312, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0018_m_000002_0_-173108709_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 189000
2015-03-13 10:09:40,893 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62312, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0018_m_000002_0_-173108709_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 155000
2015-03-13 10:09:40,908 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby/_temporary/1/_temporary/attempt_1426266260362_0018_m_000000_0	dst=null	perm=null
2015-03-13 10:09:40,912 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:09:40,918 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0018_01_000002
2015-03-13 10:09:40,918 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0018	CONTAINERID=container_1426266260362_0018_01_000002
2015-03-13 10:09:40,918 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:09:40,918 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0018_01_000002
2015-03-13 10:09:40,918 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:09:40,919 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:09:40,919 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0018_01_000003
2015-03-13 10:09:40,919 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:40,919 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:40,919 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:09:40,920 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0018_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:09:40,920 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0018	CONTAINERID=container_1426266260362_0018_01_000003
2015-03-13 10:09:40,920 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0018_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:09:40,920 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:7168, vCores:6> numContainers=6 user=soberoi user-resources=<memory:7168, vCores:6>
2015-03-13 10:09:40,920 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0018_01_000003, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=1, numContainers=6 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:40,920 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:40,920 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=1, numContainers=6
2015-03-13 10:09:40,920 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0018_000001 released container container_1426266260362_0018_01_000003 on node: host: 10.1.1.144:60719 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:09:40,931 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0018_01_000002 is : 143
2015-03-13 10:09:40,943 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:09:40,943 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000002
2015-03-13 10:09:40,943 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000002
2015-03-13 10:09:40,944 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000002
2015-03-13 10:09:40,944 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000002
2015-03-13 10:09:40,944 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0018	CONTAINERID=container_1426266260362_0018_01_000002
2015-03-13 10:09:40,944 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:09:40,945 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0018_01_000002 from application application_1426266260362_0018
2015-03-13 10:09:40,945 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:40,945 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0018
2015-03-13 10:09:40,946 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby/_temporary/1/_temporary/attempt_1426266260362_0018_m_000002_0	dst=null	perm=null
2015-03-13 10:09:40,957 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0018_01_000004
2015-03-13 10:09:40,957 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0018	CONTAINERID=container_1426266260362_0018_01_000004
2015-03-13 10:09:40,957 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:09:40,957 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:09:40,958 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0018_01_000002
2015-03-13 10:09:40,959 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:09:40,959 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:40,959 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0018_01_000004
2015-03-13 10:09:40,959 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:09:40,959 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0018_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:09:40,959 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0018	CONTAINERID=container_1426266260362_0018_01_000002
2015-03-13 10:09:40,960 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0018_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:09:40,960 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:09:40,960 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0018_01_000002, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:40,960 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:40,960 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:09:40,960 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0018_000001 released container container_1426266260362_0018_01_000002 on node: host: 10.1.1.144:60719 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:09:40,964 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:09:40,967 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:09:40,972 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62313, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0018_m_000005_0_68992022_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 141000
2015-03-13 10:09:40,975 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0018_01_000004 is : 143
2015-03-13 10:09:40,989 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:09:40,989 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000004
2015-03-13 10:09:40,989 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000004
2015-03-13 10:09:40,990 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000004
2015-03-13 10:09:40,990 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000004
2015-03-13 10:09:40,990 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0018	CONTAINERID=container_1426266260362_0018_01_000004
2015-03-13 10:09:40,990 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:09:40,991 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0018_01_000004 from application application_1426266260362_0018
2015-03-13 10:09:40,991 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:40,991 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0018
2015-03-13 10:09:41,002 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby/_temporary/1/_temporary/attempt_1426266260362_0018_m_000005_0	dst=null	perm=null
2015-03-13 10:09:41,014 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0018_000001 (auth:SIMPLE)
2015-03-13 10:09:41,015 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0018_01_000007
2015-03-13 10:09:41,016 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0018	CONTAINERID=container_1426266260362_0018_01_000007
2015-03-13 10:09:41,016 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000007 transitioned from RUNNING to KILLING
2015-03-13 10:09:41,016 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0018_01_000007
2015-03-13 10:09:41,016 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:41,016 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:09:41,022 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:09:41,028 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0018_01_000007 is : 143
2015-03-13 10:09:41,060 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000007 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:09:41,060 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000007
2015-03-13 10:09:41,061 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000007
2015-03-13 10:09:41,061 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0018	CONTAINERID=container_1426266260362_0018_01_000007
2015-03-13 10:09:41,061 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000007 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:09:41,061 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0018_01_000007 from application application_1426266260362_0018
2015-03-13 10:09:41,061 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:41,061 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0018
2015-03-13 10:09:41,061 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000007
2015-03-13 10:09:41,061 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000007
2015-03-13 10:09:41,068 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:09:41,072 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:09:41,075 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62315, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0018_m_000003_0_-20792857_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 157000
2015-03-13 10:09:41,078 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:09:41,097 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:09:41,101 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:09:41,106 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62316, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0018_m_000004_0_1920819369_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 143000
2015-03-13 10:09:41,110 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby/_temporary/1/_temporary/attempt_1426266260362_0018_m_000003_0	dst=null	perm=null
2015-03-13 10:09:41,119 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0018_01_000005
2015-03-13 10:09:41,119 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0018	CONTAINERID=container_1426266260362_0018_01_000005
2015-03-13 10:09:41,119 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:09:41,119 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:09:41,120 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0018_01_000004
2015-03-13 10:09:41,120 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0018_01_000005
2015-03-13 10:09:41,120 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:09:41,120 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:09:41,120 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0018_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:09:41,121 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0018	CONTAINERID=container_1426266260362_0018_01_000004
2015-03-13 10:09:41,121 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0018_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:09:41,121 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:09:41,121 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0018_01_000004, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:41,121 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:41,121 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:09:41,121 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0018_000001 released container container_1426266260362_0018_01_000004 on node: host: 10.1.1.144:60719 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:09:41,130 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0018_01_000005 is : 143
2015-03-13 10:09:41,134 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby/_temporary/1/_temporary/attempt_1426266260362_0018_m_000004_0	dst=null	perm=null
2015-03-13 10:09:41,139 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:09:41,139 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000005
2015-03-13 10:09:41,140 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000005
2015-03-13 10:09:41,140 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000005
2015-03-13 10:09:41,140 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000005
2015-03-13 10:09:41,140 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0018	CONTAINERID=container_1426266260362_0018_01_000005
2015-03-13 10:09:41,140 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:09:41,140 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0018_01_000005 from application application_1426266260362_0018
2015-03-13 10:09:41,141 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:41,141 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0018
2015-03-13 10:09:41,143 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0018_01_000006
2015-03-13 10:09:41,143 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0018	CONTAINERID=container_1426266260362_0018_01_000006
2015-03-13 10:09:41,143 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:09:41,143 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0018_01_000006
2015-03-13 10:09:41,143 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:09:41,143 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:09:41,144 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0018_01_000007
2015-03-13 10:09:41,144 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000007 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:09:41,144 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0018_01_000007 in state: COMPLETED event:FINISHED
2015-03-13 10:09:41,144 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0018	CONTAINERID=container_1426266260362_0018_01_000007
2015-03-13 10:09:41,144 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0018_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:09:41,144 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:09:41,145 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0018_01_000007, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:41,145 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:41,145 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:09:41,145 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0018_000001 released container container_1426266260362_0018_01_000007 on node: host: 10.1.1.144:60723 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:09:41,152 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0018_01_000006 is : 143
2015-03-13 10:09:41,159 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:09:41,160 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000006
2015-03-13 10:09:41,160 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000006
2015-03-13 10:09:41,160 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000006
2015-03-13 10:09:41,161 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000006
2015-03-13 10:09:41,161 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0018	CONTAINERID=container_1426266260362_0018_01_000006
2015-03-13 10:09:41,162 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:09:41,163 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0018_01_000006 from application application_1426266260362_0018
2015-03-13 10:09:41,163 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:41,163 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0018
2015-03-13 10:09:41,421 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:42,122 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:09:42,122 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0018_01_000005
2015-03-13 10:09:42,123 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:09:42,123 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0018_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:09:42,123 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0018	CONTAINERID=container_1426266260362_0018_01_000005
2015-03-13 10:09:42,123 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0018_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:09:42,123 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:09:42,124 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0018_01_000005, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:42,124 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:42,124 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:09:42,124 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0018_000001 released container container_1426266260362_0018_01_000005 on node: host: 10.1.1.144:60719 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:09:42,147 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:09:42,147 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0018_01_000006
2015-03-13 10:09:42,148 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:09:42,148 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0018_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:09:42,148 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0018	CONTAINERID=container_1426266260362_0018_01_000006
2015-03-13 10:09:42,148 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0018_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:09:42,148 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:09:42,149 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0018_01_000006, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:42,150 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:42,150 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:09:42,150 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0018_000001 released container container_1426266260362_0018_01_000006 on node: host: 10.1.1.144:60723 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:09:42,426 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:43,127 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000008 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:09:43,127 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0018	CONTAINERID=container_1426266260362_0018_01_000008
2015-03-13 10:09:43,127 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0018_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:09:43,128 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0018 container=Container: [ContainerId: container_1426266260362_0018_01_000008, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0018_01_000008 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:43,128 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:09:43,128 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:43,428 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:43,675 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000008 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:09:43,682 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0018_01_000008 by user soberoi
2015-03-13 10:09:43,683 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0018	CONTAINERID=container_1426266260362_0018_01_000008
2015-03-13 10:09:43,683 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0018_01_000008 to application application_1426266260362_0018
2015-03-13 10:09:43,683 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000008 transitioned from NEW to LOCALIZING
2015-03-13 10:09:43,683 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0018
2015-03-13 10:09:43,683 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0018
2015-03-13 10:09:43,683 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:09:43,683 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0018
2015-03-13 10:09:43,684 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000008 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:09:43,708 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000008 transitioned from LOCALIZED to RUNNING
2015-03-13 10:09:43,708 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:43,770 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000008/default_container_executor.sh]
2015-03-13 10:09:44,130 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 8 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:44,131 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000008 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:09:44,434 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:44,680 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:09:45,131 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 8 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:45,438 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:46,133 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 8 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:46,146 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby/_temporary/1/_temporary/attempt_1426266260362_0018_r_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:46,189 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby/_temporary/1/_temporary/attempt_1426266260362_0018_r_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073742038_1214{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:09:46,248 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742038_1214 src: /127.0.0.1:62323 dest: /127.0.0.1:60693
2015-03-13 10:09:46,249 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742038_1214 src: /127.0.0.1:62324 dest: /127.0.0.1:60696
2015-03-13 10:09:46,250 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742038_1214 src: /127.0.0.1:62325 dest: /127.0.0.1:60686
2015-03-13 10:09:46,261 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62325, dest: /127.0.0.1:60686, bytes: 336, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0018_r_000000_0_-1317155055_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742038_1214, duration: 9424000
2015-03-13 10:09:46,261 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742038_1214, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:46,262 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742038_1214{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:09:46,262 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62324, dest: /127.0.0.1:60696, bytes: 336, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0018_r_000000_0_-1317155055_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742038_1214, duration: 10075000
2015-03-13 10:09:46,262 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742038_1214, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:46,262 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742038_1214{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:09:46,263 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62323, dest: /127.0.0.1:60693, bytes: 336, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0018_r_000000_0_-1317155055_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742038_1214, duration: 10942000
2015-03-13 10:09:46,263 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742038_1214, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:46,263 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742038_1214{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:09:46,266 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby/_temporary/1/_temporary/attempt_1426266260362_0018_r_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0018_r_000000_0_-1317155055_1
2015-03-13 10:09:46,274 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby/_temporary/1/_temporary/attempt_1426266260362_0018_r_000000_0	dst=null	perm=null
2015-03-13 10:09:46,280 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby/_temporary/1/_temporary/attempt_1426266260362_0018_r_000000_0	dst=null	perm=null
2015-03-13 10:09:46,281 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby/_temporary/1/task_1426266260362_0018_r_000000	dst=null	perm=null
2015-03-13 10:09:46,283 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby/_temporary/1/_temporary/attempt_1426266260362_0018_r_000000_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby/_temporary/1/task_1426266260362_0018_r_000000	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:09:46,291 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0018_01_000008
2015-03-13 10:09:46,291 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0018	CONTAINERID=container_1426266260362_0018_01_000008
2015-03-13 10:09:46,291 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000008 transitioned from RUNNING to KILLING
2015-03-13 10:09:46,291 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0018_01_000008
2015-03-13 10:09:46,291 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 8 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:09:46,296 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:46,298 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-869631751_1
2015-03-13 10:09:46,301 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0018_01_000008 is : 143
2015-03-13 10:09:46,302 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby/_temporary/1	dst=null	perm=null
2015-03-13 10:09:46,307 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby	dst=null	perm=null
2015-03-13 10:09:46,308 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby	dst=null	perm=null
2015-03-13 10:09:46,309 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby/_temporary/1/task_1426266260362_0018_r_000000	dst=null	perm=null
2015-03-13 10:09:46,310 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby/part-00000	dst=null	perm=null
2015-03-13 10:09:46,310 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000008 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:09:46,311 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000008
2015-03-13 10:09:46,311 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000008
2015-03-13 10:09:46,311 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0018	CONTAINERID=container_1426266260362_0018_01_000008
2015-03-13 10:09:46,311 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000008 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:09:46,311 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0018_01_000008 from application application_1426266260362_0018
2015-03-13 10:09:46,311 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000008
2015-03-13 10:09:46,311 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000008
2015-03-13 10:09:46,311 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:46,312 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0018
2015-03-13 10:09:46,313 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby/_temporary/1/task_1426266260362_0018_r_000000/part-00000	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby/part-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:46,317 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby/_temporary	dst=null	perm=null
2015-03-13 10:09:46,321 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:46,322 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-869631751_1
2015-03-13 10:09:46,324 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:46,325 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-869631751_1
2015-03-13 10:09:46,339 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62310, dest: /127.0.0.1:60696, bytes: 74731, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-869631751_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742037_1213, duration: 5494929000
2015-03-13 10:09:46,339 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742037_1213, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:46,340 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742037_1213{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:46,340 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62309, dest: /127.0.0.1:60686, bytes: 74731, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-869631751_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742037_1213, duration: 5495935000
2015-03-13 10:09:46,340 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742037_1213, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:46,342 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742037_1213{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:46,342 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62308, dest: /127.0.0.1:60689, bytes: 74731, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-869631751_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742037_1213, duration: 5497569000
2015-03-13 10:09:46,342 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742037_1213, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:46,342 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742037_1213{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:46,344 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job_1426266260362_0018_1.jhist is closed by DFSClient_NONMAPREDUCE_-869631751_1
2015-03-13 10:09:46,345 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0018.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:46,347 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0018.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742039_1215{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:09:46,349 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742039_1215 src: /127.0.0.1:62326 dest: /127.0.0.1:60696
2015-03-13 10:09:46,350 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742039_1215 src: /127.0.0.1:62327 dest: /127.0.0.1:60693
2015-03-13 10:09:46,351 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742039_1215 src: /127.0.0.1:62328 dest: /127.0.0.1:60686
2015-03-13 10:09:46,354 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62328, dest: /127.0.0.1:60686, bytes: 451, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-869631751_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742039_1215, duration: 1245000
2015-03-13 10:09:46,354 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742039_1215, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:46,355 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742039_1215{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:09:46,355 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62327, dest: /127.0.0.1:60693, bytes: 451, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-869631751_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742039_1215, duration: 1730000
2015-03-13 10:09:46,355 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742039_1215, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:46,356 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62326, dest: /127.0.0.1:60696, bytes: 451, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-869631751_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742039_1215, duration: 2515000
2015-03-13 10:09:46,356 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742039_1215, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:46,356 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742039_1215{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:09:46,357 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742039_1215{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:09:46,358 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0018.summary_tmp is closed by DFSClient_NONMAPREDUCE_-869631751_1
2015-03-13 10:09:46,361 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0018.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:09:46,366 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job_1426266260362_0018_1.jhist	dst=null	perm=null
2015-03-13 10:09:46,367 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0018-1426266563882-soberoi-%5BCD6FBC07BE1742EBBA4ED3E85D978DBA%2FD4DC90FFC72F4258-1426266586326-6-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:09:46,369 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job_1426266260362_0018_1.jhist	dst=null	perm=null
2015-03-13 10:09:46,370 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0018-1426266563882-soberoi-%5BCD6FBC07BE1742EBBA4ED3E85D978DBA%2FD4DC90FFC72F4258-1426266586326-6-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:09:46,371 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job_1426266260362_0018_1.jhist	dst=null	perm=null
2015-03-13 10:09:46,373 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0018-1426266563882-soberoi-%5BCD6FBC07BE1742EBBA4ED3E85D978DBA%2FD4DC90FFC72F4258-1426266586326-6-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:46,378 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62329, bytes: 75315, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-869631751_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742037_1213, duration: 315000
2015-03-13 10:09:46,380 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0018-1426266563882-soberoi-%5BCD6FBC07BE1742EBBA4ED3E85D978DBA%2FD4DC90FFC72F4258-1426266586326-6-1-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742040_1216{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:09:46,381 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742040_1216 src: /127.0.0.1:62330 dest: /127.0.0.1:60689
2015-03-13 10:09:46,383 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742040_1216 src: /127.0.0.1:62331 dest: /127.0.0.1:60693
2015-03-13 10:09:46,384 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742040_1216 src: /127.0.0.1:62332 dest: /127.0.0.1:60696
2015-03-13 10:09:46,388 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62332, dest: /127.0.0.1:60696, bytes: 74731, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-869631751_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742040_1216, duration: 2017000
2015-03-13 10:09:46,388 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742040_1216, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:46,388 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742040_1216{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:46,389 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62331, dest: /127.0.0.1:60693, bytes: 74731, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-869631751_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742040_1216, duration: 2706000
2015-03-13 10:09:46,389 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742040_1216, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:46,389 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742040_1216{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:46,389 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62330, dest: /127.0.0.1:60689, bytes: 74731, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-869631751_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742040_1216, duration: 3623000
2015-03-13 10:09:46,390 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742040_1216, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:46,390 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742040_1216{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:46,391 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0018-1426266563882-soberoi-%5BCD6FBC07BE1742EBBA4ED3E85D978DBA%2FD4DC90FFC72F4258-1426266586326-6-1-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-869631751_1
2015-03-13 10:09:46,394 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0018-1426266563882-soberoi-%5BCD6FBC07BE1742EBBA4ED3E85D978DBA%2FD4DC90FFC72F4258-1426266586326-6-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:09:46,395 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job_1426266260362_0018_1_conf.xml	dst=null	perm=null
2015-03-13 10:09:46,396 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0018_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:09:46,397 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job_1426266260362_0018_1_conf.xml	dst=null	perm=null
2015-03-13 10:09:46,398 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0018_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:09:46,399 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job_1426266260362_0018_1_conf.xml	dst=null	perm=null
2015-03-13 10:09:46,401 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0018_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:46,403 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62333, bytes: 93574, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-869631751_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742036_1212, duration: 271000
2015-03-13 10:09:46,405 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0018_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742041_1217{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:09:46,407 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742041_1217 src: /127.0.0.1:62334 dest: /127.0.0.1:60693
2015-03-13 10:09:46,408 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742041_1217 src: /127.0.0.1:62335 dest: /127.0.0.1:60696
2015-03-13 10:09:46,410 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742041_1217 src: /127.0.0.1:62336 dest: /127.0.0.1:60689
2015-03-13 10:09:46,413 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62336, dest: /127.0.0.1:60689, bytes: 92846, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-869631751_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742041_1217, duration: 2004000
2015-03-13 10:09:46,413 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742041_1217, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:46,414 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742041_1217{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:09:46,414 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62335, dest: /127.0.0.1:60696, bytes: 92846, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-869631751_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742041_1217, duration: 2675000
2015-03-13 10:09:46,414 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742041_1217, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:46,415 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742041_1217{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:09:46,415 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62334, dest: /127.0.0.1:60693, bytes: 92846, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-869631751_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742041_1217, duration: 3451000
2015-03-13 10:09:46,415 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742041_1217, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:46,415 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742041_1217{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:09:46,417 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0018_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-869631751_1
2015-03-13 10:09:46,418 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0018_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:09:46,420 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0018.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0018.summary	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:09:46,422 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0018_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0018_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:09:46,425 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0018-1426266563882-soberoi-%5BCD6FBC07BE1742EBBA4ED3E85D978DBA%2FD4DC90FFC72F4258-1426266586326-6-1-SUCCEEDED-default.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0018-1426266563882-soberoi-%5BCD6FBC07BE1742EBBA4ED3E85D978DBA%2FD4DC90FFC72F4258-1426266586326-6-1-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:09:46,431 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0018_000001 State change from RUNNING to FINISHING
2015-03-13 10:09:46,431 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0018
2015-03-13 10:09:46,432 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0018 State change from RUNNING to REMOVING
2015-03-13 10:09:46,432 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0018
2015-03-13 10:09:46,432 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0018 State change from REMOVING to FINISHING
2015-03-13 10:09:46,444 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:47,293 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 8 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:09:47,293 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0018_01_000008
2015-03-13 10:09:47,294 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000008 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:09:47,294 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0018_01_000008 in state: COMPLETED event:FINISHED
2015-03-13 10:09:47,294 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0018	CONTAINERID=container_1426266260362_0018_01_000008
2015-03-13 10:09:47,294 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0018_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:09:47,294 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:09:47,294 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0018_01_000008, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:47,295 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:47,295 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:09:47,295 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0018_000001 released container container_1426266260362_0018_01_000008 on node: host: 10.1.1.144:60719 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:09:47,438 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742032_1208 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60689 127.0.0.1:60686 
2015-03-13 10:09:47,439 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742033_1209 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60696 127.0.0.1:60693 
2015-03-13 10:09:47,439 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742034_1210 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60686 
2015-03-13 10:09:47,439 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742035_1211 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60686 
2015-03-13 10:09:47,439 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742037_1213 127.0.0.1:60689 127.0.0.1:60686 127.0.0.1:60696 
2015-03-13 10:09:47,440 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742036_1212 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60686 
2015-03-13 10:09:47,440 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018	dst=null	perm=null
2015-03-13 10:09:47,447 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:47,474 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby	dst=null	perm=null
2015-03-13 10:09:47,474 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby/_temporary
2015-03-13 10:09:47,474 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby/_temporary	dst=null	perm=null
2015-03-13 10:09:47,481 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:09:47,482 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:09:47,482 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:09:47,483 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby	dst=null	perm=null
2015-03-13 10:09:47,483 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby	dst=null	perm=null
2015-03-13 10:09:47,484 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby	dst=null	perm=null
2015-03-13 10:09:47,485 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:09:47,485 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby/part-00000	dst=null	perm=null
2015-03-13 10:09:47,487 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62338, bytes: 340, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742038_1214, duration: 183000
2015-03-13 10:09:47,494 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:09:47,494 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:09:47,494 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:09:47,495 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby	dst=null	perm=null
2015-03-13 10:09:47,496 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby	dst=null	perm=null
2015-03-13 10:09:47,496 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby	dst=null	perm=null
2015-03-13 10:09:47,497 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:09:47,498 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby/part-00000	dst=null	perm=null
2015-03-13 10:09:47,499 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62339, bytes: 340, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742038_1214, duration: 182000
2015-03-13 10:09:47,500 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby
2015-03-13 10:09:47,501 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby	dst=null	perm=null
2015-03-13 10:09:47,501 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby	dst=null	perm=null
2015-03-13 10:09:47,502 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby	dst=null	perm=null
2015-03-13 10:09:47,502 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby	dst=null	perm=null
2015-03-13 10:09:47,503 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby/part-00000	dst=null	perm=null
2015-03-13 10:09:47,503 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby/part-00000	dst=null	perm=null
2015-03-13 10:09:47,505 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62339, bytes: 340, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742038_1214, duration: 164000
2015-03-13 10:09:47,505 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:09:47,506 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:09:47,514 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:09:47,516 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:09:47,516 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:09:47,524 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown	dst=null	perm=null
2015-03-13 10:09:47,525 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting
2015-03-13 10:09:47,526 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt"]
2015-03-13 10:09:47,526 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-03-13 10:09:47,526 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown"]
2015-03-13 10:09:47,526 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  parallel execution is enabled: true
2015-03-13 10:09:47,526 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  starting jobs: 1
2015-03-13 10:09:47,526 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  allocating threads: 1
2015-03-13 10:09:47,527 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (1/1) ...ldedpipesplatform/unknown
2015-03-13 10:09:47,534 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:09:47,542 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:09:47,543 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown	dst=null	perm=null
2015-03-13 10:09:47,544 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:09:47,544 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:09:47,546 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 19
2015-03-13 10:09:47,547 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019	dst=null	perm=null
2015-03-13 10:09:47,548 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019	dst=null	perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:09:47,549 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019	dst=null	perm=soberoi:supergroup:rwx------
2015-03-13 10:09:47,550 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.jar	dst=null	perm=null
2015-03-13 10:09:47,551 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:09:47,553 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073742042_1218{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:09:47,554 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742042_1218 src: /127.0.0.1:62341 dest: /127.0.0.1:60693
2015-03-13 10:09:47,555 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742042_1218 src: /127.0.0.1:62342 dest: /127.0.0.1:60689
2015-03-13 10:09:47,557 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742042_1218 src: /127.0.0.1:62343 dest: /127.0.0.1:60686
2015-03-13 10:09:47,561 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62343, dest: /127.0.0.1:60686, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742042_1218, duration: 1899000
2015-03-13 10:09:47,561 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742042_1218, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:47,561 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742042_1218{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:09:47,562 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62342, dest: /127.0.0.1:60689, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742042_1218, duration: 2903000
2015-03-13 10:09:47,562 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742042_1218, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:47,562 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742042_1218{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:09:47,562 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62341, dest: /127.0.0.1:60693, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742042_1218, duration: 3837000
2015-03-13 10:09:47,563 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742042_1218, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:47,563 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742042_1218{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:09:47,564 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:09:47,565 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.jar
2015-03-13 10:09:47,566 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.jar	dst=null	perm=null
2015-03-13 10:09:47,567 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:09:47,568 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:09:47,569 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:09:47,570 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:09:47,571 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:09:47,571 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:09:47,572 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:09:47,573 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:09:47,573 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:09:47,574 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:09:47,576 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:09:47,576 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:09:47,577 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:09:47,578 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:09:47,580 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:09:47,580 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.split
2015-03-13 10:09:47,581 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.split	dst=null	perm=null
2015-03-13 10:09:47,582 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073742043_1219{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:09:47,583 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742043_1219 src: /127.0.0.1:62344 dest: /127.0.0.1:60686
2015-03-13 10:09:47,584 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742043_1219 src: /127.0.0.1:62345 dest: /127.0.0.1:60693
2015-03-13 10:09:47,585 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742043_1219 src: /127.0.0.1:62346 dest: /127.0.0.1:60696
2015-03-13 10:09:47,587 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742043_1219 src: /127.0.0.1:62347 dest: /127.0.0.1:60689
2015-03-13 10:09:47,590 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62347, dest: /127.0.0.1:60689, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742043_1219, duration: 1347000
2015-03-13 10:09:47,590 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742043_1219, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:47,591 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742043_1219{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:09:47,591 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62346, dest: /127.0.0.1:60696, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742043_1219, duration: 1829000
2015-03-13 10:09:47,591 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742043_1219, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:47,592 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742043_1219{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:09:47,592 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62345, dest: /127.0.0.1:60693, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742043_1219, duration: 3021000
2015-03-13 10:09:47,592 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742043_1219, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:47,592 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742043_1219{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:09:47,593 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62344, dest: /127.0.0.1:60686, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742043_1219, duration: 3575000
2015-03-13 10:09:47,593 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742043_1219, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:47,593 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742043_1219{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:09:47,594 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:09:47,595 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:09:47,597 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:09:47,597 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073742044_1220{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:09:47,599 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742044_1220 src: /127.0.0.1:62348 dest: /127.0.0.1:60686
2015-03-13 10:09:47,600 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742044_1220 src: /127.0.0.1:62349 dest: /127.0.0.1:60693
2015-03-13 10:09:47,601 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742044_1220 src: /127.0.0.1:62350 dest: /127.0.0.1:60696
2015-03-13 10:09:47,604 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62350, dest: /127.0.0.1:60696, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742044_1220, duration: 1106000
2015-03-13 10:09:47,604 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742044_1220, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:47,604 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742044_1220{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:47,604 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62349, dest: /127.0.0.1:60693, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742044_1220, duration: 1516000
2015-03-13 10:09:47,605 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742044_1220, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:47,605 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742044_1220{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:47,605 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62348, dest: /127.0.0.1:60686, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742044_1220, duration: 2381000
2015-03-13 10:09:47,605 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742044_1220, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:47,606 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742044_1220{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:47,607 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:09:47,607 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:09:47,608 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:09:47,610 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:09:47,611 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:09:47,612 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:09:47,612 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:09:47,616 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742045_1221{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:09:47,618 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742045_1221 src: /127.0.0.1:62351 dest: /127.0.0.1:60696
2015-03-13 10:09:47,619 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742045_1221 src: /127.0.0.1:62352 dest: /127.0.0.1:60686
2015-03-13 10:09:47,620 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742045_1221 src: /127.0.0.1:62353 dest: /127.0.0.1:60689
2015-03-13 10:09:47,624 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62353, dest: /127.0.0.1:60689, bytes: 97638, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742045_1221, duration: 1708000
2015-03-13 10:09:47,624 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742045_1221, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:47,624 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742045_1221{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:09:47,624 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62352, dest: /127.0.0.1:60686, bytes: 97638, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742045_1221, duration: 1980000
2015-03-13 10:09:47,625 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742045_1221, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:47,625 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62351, dest: /127.0.0.1:60696, bytes: 97638, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742045_1221, duration: 2809000
2015-03-13 10:09:47,625 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742045_1221{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:09:47,626 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742045_1221, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:47,627 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742045_1221{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:09:47,628 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:09:47,628 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0019
2015-03-13 10:09:47,629 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019	dst=null	perm=null
2015-03-13 10:09:47,630 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.xml	dst=null	perm=null
2015-03-13 10:09:47,631 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.xml	dst=null	perm=null
2015-03-13 10:09:47,631 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.jar	dst=null	perm=null
2015-03-13 10:09:47,632 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.jar	dst=null	perm=null
2015-03-13 10:09:47,633 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.split	dst=null	perm=null
2015-03-13 10:09:47,633 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.split	dst=null	perm=null
2015-03-13 10:09:47,634 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:09:47,634 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:09:47,636 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:09:47,637 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:09:47,637 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:09:47,638 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:09:47,638 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:09:47,639 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:09:47,640 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 19 submitted by user soberoi
2015-03-13 10:09:47,640 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	IP=10.1.1.144	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1426266260362_0019
2015-03-13 10:09:47,640 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0019
2015-03-13 10:09:47,641 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0019 State change from NEW to NEW_SAVING
2015-03-13 10:09:47,641 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0019
2015-03-13 10:09:47,641 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0019 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:09:47,641 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0019_000001
2015-03-13 10:09:47,641 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0019_000001 State change from NEW to SUBMITTED
2015-03-13 10:09:47,641 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0019 from user: soberoi activated in queue: default
2015-03-13 10:09:47,642 INFO  capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0019 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:09:47,642 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0019 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:09:47,642 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0019 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:09:47,642 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0019_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:09:47,642 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0019_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:09:47,643 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0019 State change from SUBMITTED to ACCEPTED
2015-03-13 10:09:47,644 INFO  mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0019/
2015-03-13 10:09:47,644 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1426266260362_0019
2015-03-13 10:09:47,644 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0019/
2015-03-13 10:09:47,818 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742043_1219
2015-03-13 10:09:47,819 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742045_1221
2015-03-13 10:09:47,819 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742041_1217
2015-03-13 10:09:47,820 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742037_1213
2015-03-13 10:09:48,171 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0019_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:09:48,171 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0019	CONTAINERID=container_1426266260362_0019_01_000001
2015-03-13 10:09:48,171 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0019_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:09:48,172 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0019 container=Container: [ContainerId: container_1426266260362_0019_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0019_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:48,172 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:09:48,172 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0019_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:09:48,172 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:48,173 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0019 AttemptId: appattempt_1426266260362_0019_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0019_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ]
2015-03-13 10:09:48,173 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0019_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:09:48,173 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0019_000001
2015-03-13 10:09:48,174 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0019_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:09:48,174 INFO  amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0019_000001
2015-03-13 10:09:48,175 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0019_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] for AM appattempt_1426266260362_0019_000001
2015-03-13 10:09:48,175 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0019_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-03-13 10:09:48,177 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0019_000001 (auth:SIMPLE)
2015-03-13 10:09:48,178 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0019_01_000001 by user soberoi
2015-03-13 10:09:48,178 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0019
2015-03-13 10:09:48,178 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0019	CONTAINERID=container_1426266260362_0019_01_000001
2015-03-13 10:09:48,178 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0019 transitioned from NEW to INITING
2015-03-13 10:09:48,178 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0019_01_000001 to application application_1426266260362_0019
2015-03-13 10:09:48,179 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0019_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] for AM appattempt_1426266260362_0019_000001
2015-03-13 10:09:48,179 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0019 transitioned from INITING to RUNNING
2015-03-13 10:09:48,179 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0019_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:09:48,179 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:09:48,179 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0019
2015-03-13 10:09:48,179 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:09:48,179 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:09:48,179 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:09:48,180 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:09:48,180 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0019_01_000001
2015-03-13 10:09:48,189 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426266260362_0019_01_000001.tokens. Credentials list: 
2015-03-13 10:09:48,204 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:09:48,212 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742038_1214
2015-03-13 10:09:48,213 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742044_1220
2015-03-13 10:09:48,213 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742043_1219
2015-03-13 10:09:48,214 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742042_1218
2015-03-13 10:09:48,220 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742042_1218
2015-03-13 10:09:48,220 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742040_1216
2015-03-13 10:09:48,278 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426266260362_0019_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000001.tokens
2015-03-13 10:09:48,278 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0019 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0019
2015-03-13 10:09:48,334 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.jar	dst=null	perm=null
2015-03-13 10:09:48,335 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.jar	dst=null	perm=null
2015-03-13 10:09:48,335 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.jar	dst=null	perm=null
2015-03-13 10:09:48,342 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62357, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1498248180_9952, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742042_1218, duration: 460000
2015-03-13 10:09:48,360 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:09:48,376 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:09:48,376 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:09:48,377 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:09:48,383 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62358, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1498248180_9952, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742044_1220, duration: 125000
2015-03-13 10:09:48,395 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:09:48,413 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742041_1217
2015-03-13 10:09:48,414 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742040_1216
2015-03-13 10:09:48,414 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742039_1215
2015-03-13 10:09:48,415 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.split	dst=null	perm=null
2015-03-13 10:09:48,416 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.split	dst=null	perm=null
2015-03-13 10:09:48,417 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.split	dst=null	perm=null
2015-03-13 10:09:48,422 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62338, bytes: 1798, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1498248180_9952, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742043_1219, duration: 129000
2015-03-13 10:09:48,435 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:09:48,450 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.xml	dst=null	perm=null
2015-03-13 10:09:48,451 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.xml	dst=null	perm=null
2015-03-13 10:09:48,451 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.xml	dst=null	perm=null
2015-03-13 10:09:48,452 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:48,458 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62358, bytes: 98402, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1498248180_9952, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742045_1221, duration: 221000
2015-03-13 10:09:48,470 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:09:48,470 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:09:48,494 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:09:48,494 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:48,561 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000001/default_container_executor.sh]
2015-03-13 10:09:48,782 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742042_1218
2015-03-13 10:09:48,782 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742044_1220
2015-03-13 10:09:48,783 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742045_1221
2015-03-13 10:09:48,911 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60686 to replicate blk_1073742042_1218 to datanode(s) 127.0.0.1:60696
2015-03-13 10:09:48,911 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073742032_1208, blk_1073742033_1209, blk_1073742034_1210, blk_1073742035_1211, blk_1073742036_1212, blk_1073742037_1213]
2015-03-13 10:09:48,911 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073742032_1208, blk_1073742033_1209, blk_1073742034_1210, blk_1073742035_1211, blk_1073742036_1212, blk_1073742037_1213]
2015-03-13 10:09:48,967 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742045_1221
2015-03-13 10:09:48,968 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742040_1216
2015-03-13 10:09:48,968 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742039_1215
2015-03-13 10:09:48,968 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742043_1219
2015-03-13 10:09:48,969 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742044_1220
2015-03-13 10:09:48,969 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742038_1214
2015-03-13 10:09:48,970 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742037_1213
2015-03-13 10:09:48,983 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742037_1213
2015-03-13 10:09:48,983 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742038_1214
2015-03-13 10:09:48,983 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742039_1215
2015-03-13 10:09:48,984 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742043_1219
2015-03-13 10:09:49,172 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:49,173 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742041_1217
2015-03-13 10:09:49,173 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0019_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:09:49,454 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:49,529 INFO  datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-1907321454-10.1.1.144-60686-1426266259166, infoPort=60687, ipcPort=60688, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073742042_1218 to 127.0.0.1:60696 
2015-03-13 10:09:49,529 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742032_1208 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742032 for deletion
2015-03-13 10:09:49,529 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742033_1209 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742033 for deletion
2015-03-13 10:09:49,530 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742034_1210 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742034 for deletion
2015-03-13 10:09:49,530 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742035_1211 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742035 for deletion
2015-03-13 10:09:49,530 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742032_1208 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742032
2015-03-13 10:09:49,530 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742036_1212 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742036 for deletion
2015-03-13 10:09:49,530 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742037_1213 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742037 for deletion
2015-03-13 10:09:49,530 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742034_1210 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742034
2015-03-13 10:09:49,530 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742033_1209 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742033
2015-03-13 10:09:49,530 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742042_1218 src: /127.0.0.1:62359 dest: /127.0.0.1:60696
2015-03-13 10:09:49,531 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742035_1211 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742035
2015-03-13 10:09:49,530 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742037_1213 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742037
2015-03-13 10:09:49,531 INFO  datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073742042_1218 (numBytes=254067) to /127.0.0.1:60696
2015-03-13 10:09:49,531 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742036_1212 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742036
2015-03-13 10:09:49,532 INFO  datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073742042_1218 src: /127.0.0.1:62359 dest: /127.0.0.1:60696 of size 254067
2015-03-13 10:09:49,533 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742042_1218 size 254067
2015-03-13 10:09:49,898 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742032_1208 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742032 for deletion
2015-03-13 10:09:49,898 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742033_1209 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742033 for deletion
2015-03-13 10:09:49,898 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742034_1210 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742034 for deletion
2015-03-13 10:09:49,898 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742035_1211 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742035 for deletion
2015-03-13 10:09:49,898 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742036_1212 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742036 for deletion
2015-03-13 10:09:49,898 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742032_1208 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742032
2015-03-13 10:09:49,898 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742033_1209 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742033
2015-03-13 10:09:49,899 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742037_1213 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742037 for deletion
2015-03-13 10:09:49,899 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742034_1210 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742034
2015-03-13 10:09:49,899 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742035_1211 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742035
2015-03-13 10:09:49,899 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742036_1212 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742036
2015-03-13 10:09:49,899 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742037_1213 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742037
2015-03-13 10:09:50,144 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:09:50,166 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/COMMIT_STARTED	dst=null	perm=null
2015-03-13 10:09:50,167 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/COMMIT_SUCCESS	dst=null	perm=null
2015-03-13 10:09:50,168 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/COMMIT_FAIL	dst=null	perm=null
2015-03-13 10:09:50,177 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:50,220 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019	dst=null	perm=null
2015-03-13 10:09:50,222 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:09:50,223 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:09:50,459 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:50,513 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:09:50,519 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:09:50,584 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62361, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-602048742_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742044_1220, duration: 184000
2015-03-13 10:09:51,178 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:51,346 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0019_000001 (auth:SIMPLE)
2015-03-13 10:09:51,347 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0019_000001
2015-03-13 10:09:51,347 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi	IP=10.1.1.144	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1426266260362_0019	APPATTEMPTID=appattempt_1426266260362_0019_000001
2015-03-13 10:09:51,348 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0019_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:09:51,348 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0019 State change from ACCEPTED to RUNNING
2015-03-13 10:09:51,369 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job_1426266260362_0019_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:51,375 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:09:51,442 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job_1426266260362_0019_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:51,465 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:51,565 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job_1426266260362_0019_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742046_1222{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:09:51,611 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742046_1222 src: /127.0.0.1:62367 dest: /127.0.0.1:60696
2015-03-13 10:09:51,613 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742046_1222 src: /127.0.0.1:62368 dest: /127.0.0.1:60693
2015-03-13 10:09:51,614 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742046_1222 src: /127.0.0.1:62369 dest: /127.0.0.1:60689
2015-03-13 10:09:51,623 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62369, dest: /127.0.0.1:60689, bytes: 90451, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-602048742_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742046_1222, duration: 6816000
2015-03-13 10:09:51,623 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742046_1222, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:51,624 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742046_1222{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:09:51,624 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62368, dest: /127.0.0.1:60693, bytes: 90451, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-602048742_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742046_1222, duration: 7471000
2015-03-13 10:09:51,624 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742046_1222, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:51,625 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62367, dest: /127.0.0.1:60696, bytes: 90451, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-602048742_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742046_1222, duration: 8506000
2015-03-13 10:09:51,625 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742046_1222{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:09:51,625 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742046_1222, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:51,626 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742046_1222{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:09:51,629 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job_1426266260362_0019_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-602048742_1
2015-03-13 10:09:51,916 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073742032_1208, blk_1073742033_1209, blk_1073742034_1210, blk_1073742037_1213]
2015-03-13 10:09:51,916 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073742032_1208, blk_1073742033_1209, blk_1073742035_1211, blk_1073742036_1212]
2015-03-13 10:09:52,179 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:52,467 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:52,468 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0019_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:09:52,468 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0019	CONTAINERID=container_1426266260362_0019_01_000002
2015-03-13 10:09:52,468 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0019_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:09:52,469 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0019 container=Container: [ContainerId: container_1426266260362_0019_01_000002, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0019_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:52,469 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:09:52,469 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:52,470 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0019_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:09:52,470 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0019	CONTAINERID=container_1426266260362_0019_01_000003
2015-03-13 10:09:52,470 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0019_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available
2015-03-13 10:09:52,470 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0019 container=Container: [ContainerId: container_1426266260362_0019_01_000003, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0019_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:52,470 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:09:52,470 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:52,529 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742032_1208 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742032 for deletion
2015-03-13 10:09:52,529 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742033_1209 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742033 for deletion
2015-03-13 10:09:52,529 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742034_1210 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742034 for deletion
2015-03-13 10:09:52,530 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742037_1213 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742037 for deletion
2015-03-13 10:09:52,530 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742032_1208 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742032
2015-03-13 10:09:52,530 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742033_1209 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742033
2015-03-13 10:09:52,530 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742034_1210 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742034
2015-03-13 10:09:52,530 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742037_1213 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742037
2015-03-13 10:09:52,566 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0019_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:09:52,566 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0019	CONTAINERID=container_1426266260362_0019_01_000004
2015-03-13 10:09:52,566 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0019_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:09:52,566 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0019 container=Container: [ContainerId: container_1426266260362_0019_01_000004, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0019_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:52,567 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:09:52,567 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:52,567 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0019_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:09:52,567 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0019	CONTAINERID=container_1426266260362_0019_01_000005
2015-03-13 10:09:52,567 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0019_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:09:52,567 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0019 container=Container: [ContainerId: container_1426266260362_0019_01_000005, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0019_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:52,568 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:09:52,568 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:52,568 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0019_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:09:52,568 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0019	CONTAINERID=container_1426266260362_0019_01_000006
2015-03-13 10:09:52,568 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0019_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:09:52,568 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0019 container=Container: [ContainerId: container_1426266260362_0019_01_000006, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0019_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:52,569 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7
2015-03-13 10:09:52,569 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0018_01_000001 succeeded 
2015-03-13 10:09:52,569 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:52,569 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:09:52,569 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0018_01_000001
2015-03-13 10:09:52,576 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000001
2015-03-13 10:09:52,576 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0018	CONTAINERID=container_1426266260362_0018_01_000001
2015-03-13 10:09:52,576 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:09:52,576 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000001
2015-03-13 10:09:52,577 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000001
2015-03-13 10:09:52,577 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000001
2015-03-13 10:09:52,576 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0018_01_000001 from application application_1426266260362_0018
2015-03-13 10:09:52,577 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:52,577 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0018
2015-03-13 10:09:52,716 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742032_1208 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742032 for deletion
2015-03-13 10:09:52,716 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742033_1209 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742033 for deletion
2015-03-13 10:09:52,716 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742035_1211 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742035 for deletion
2015-03-13 10:09:52,716 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742032_1208 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742032
2015-03-13 10:09:52,717 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742033_1209 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742033
2015-03-13 10:09:52,717 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742036_1212 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742036 for deletion
2015-03-13 10:09:52,717 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742035_1211 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742035
2015-03-13 10:09:52,718 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742036_1212 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742036
2015-03-13 10:09:53,183 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:53,227 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742046_1222
2015-03-13 10:09:53,385 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0019_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:09:53,385 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0019_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:09:53,385 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0019_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:09:53,385 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0019_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:09:53,386 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0019_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:09:53,412 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.jar	dst=null	perm=null
2015-03-13 10:09:53,413 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.jar	dst=null	perm=null
2015-03-13 10:09:53,417 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742046_1222
2015-03-13 10:09:53,422 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.xml	dst=null	perm=null
2015-03-13 10:09:53,423 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.xml	dst=null	perm=null
2015-03-13 10:09:53,426 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:09:53,427 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:09:53,432 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:09:53,434 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:09:53,436 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:09:53,437 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:09:53,469 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:09:53,469 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0018_01_000001
2015-03-13 10:09:53,470 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:09:53,470 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0018_000001
2015-03-13 10:09:53,470 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0018_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:09:53,470 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0018_000001 State change from FINISHING to FINISHED
2015-03-13 10:09:53,470 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0018	CONTAINERID=container_1426266260362_0018_01_000001
2015-03-13 10:09:53,470 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0018 State change from FINISHING to FINISHED
2015-03-13 10:09:53,470 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0018_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:09:53,471 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:7168, vCores:6> numContainers=6 user=soberoi user-resources=<memory:7168, vCores:6>
2015-03-13 10:09:53,470 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1426266260362_0018
2015-03-13 10:09:53,471 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0018_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:53,471 INFO  amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0018_000001
2015-03-13 10:09:53,471 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:53,471 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6
2015-03-13 10:09:53,471 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0018_000001 released container container_1426266260362_0018_01_000001 on node: host: 10.1.1.144:60715 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:09:53,471 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0018,name=[CD6FBC07BE1742EBBA4ED3E85D978DBA/D4DC90FFC72F4258815AC79ED379D06A] merging/(1/1) ...platform/joinsintogroupby,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0018/jobhistory/job/job_1426266260362_0018,appMasterHost=Edinburgh.local,startTime=1426266563882,finishTime=1426266586432,finalStatus=SUCCEEDED
2015-03-13 10:09:53,471 INFO  capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0018_000001 is done. finalState=FINISHED
2015-03-13 10:09:53,471 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0018 requests cleared
2015-03-13 10:09:53,472 INFO  capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0018 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:09:53,472 INFO  capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0018 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:09:53,473 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0018_000001 (auth:SIMPLE)
2015-03-13 10:09:53,474 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0018_01_000001
2015-03-13 10:09:53,515 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0019_000001 (auth:SIMPLE)
2015-03-13 10:09:53,515 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0019_000001 (auth:SIMPLE)
2015-03-13 10:09:53,518 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0019_01_000002 by user soberoi
2015-03-13 10:09:53,518 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0019
2015-03-13 10:09:53,518 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0019_01_000006 by user soberoi
2015-03-13 10:09:53,519 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0019
2015-03-13 10:09:53,519 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0019_01_000005 by user soberoi
2015-03-13 10:09:53,519 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0019 transitioned from NEW to INITING
2015-03-13 10:09:53,518 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0019_01_000004 by user soberoi
2015-03-13 10:09:53,519 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0019_01_000002 to application application_1426266260362_0019
2015-03-13 10:09:53,519 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0019 transitioned from NEW to INITING
2015-03-13 10:09:53,519 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0019_01_000006 to application application_1426266260362_0019
2015-03-13 10:09:53,519 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0019_01_000005 to application application_1426266260362_0019
2015-03-13 10:09:53,519 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0019	CONTAINERID=container_1426266260362_0019_01_000005
2015-03-13 10:09:53,519 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0019	CONTAINERID=container_1426266260362_0019_01_000006
2015-03-13 10:09:53,519 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0019_01_000003 by user soberoi
2015-03-13 10:09:53,518 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0019	CONTAINERID=container_1426266260362_0019_01_000002
2015-03-13 10:09:53,520 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0019	CONTAINERID=container_1426266260362_0019_01_000003
2015-03-13 10:09:53,519 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0019_01_000004 to application application_1426266260362_0019
2015-03-13 10:09:53,521 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0019 transitioned from INITING to RUNNING
2015-03-13 10:09:53,521 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:09:53,521 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:09:53,519 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0019 transitioned from INITING to RUNNING
2015-03-13 10:09:53,519 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0019	CONTAINERID=container_1426266260362_0019_01_000004
2015-03-13 10:09:53,521 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:09:53,522 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0019_01_000003 to application application_1426266260362_0019
2015-03-13 10:09:53,522 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0019
2015-03-13 10:09:53,522 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0019
2015-03-13 10:09:53,522 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:09:53,522 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0019
2015-03-13 10:09:53,522 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:09:53,521 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:09:53,522 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0019
2015-03-13 10:09:53,522 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0019
2015-03-13 10:09:53,522 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:09:53,522 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0019
2015-03-13 10:09:53,523 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:09:53,523 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:09:53,523 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0019
2015-03-13 10:09:53,523 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0019
2015-03-13 10:09:53,523 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:09:53,523 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0019
2015-03-13 10:09:53,523 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0019
2015-03-13 10:09:53,523 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0019
2015-03-13 10:09:53,523 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:09:53,523 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0019
2015-03-13 10:09:53,523 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0019_01_000005
2015-03-13 10:09:53,522 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:09:53,524 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:09:53,524 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0019_01_000006
2015-03-13 10:09:53,524 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0019_01_000002
2015-03-13 10:09:53,525 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0019_01_000004
2015-03-13 10:09:53,525 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0019
2015-03-13 10:09:53,525 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0019
2015-03-13 10:09:53,525 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:09:53,525 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0019
2015-03-13 10:09:53,525 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0019_01_000003
2015-03-13 10:09:53,548 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0019_01_000002.tokens. Credentials list: 
2015-03-13 10:09:53,549 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0019_01_000005.tokens. Credentials list: 
2015-03-13 10:09:53,550 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0019_01_000003.tokens. Credentials list: 
2015-03-13 10:09:53,551 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0019_01_000004.tokens. Credentials list: 
2015-03-13 10:09:53,551 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0019_01_000006.tokens. Credentials list: 
2015-03-13 10:09:53,567 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:53,567 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:53,567 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:53,567 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0019_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:09:53,568 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0019_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:09:53,568 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0019_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:09:53,571 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:09:53,572 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:09:53,651 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0019_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000002.tokens
2015-03-13 10:09:53,651 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0019_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000005.tokens
2015-03-13 10:09:53,651 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0019 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0019
2015-03-13 10:09:53,651 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0019 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0019
2015-03-13 10:09:53,723 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.jar	dst=null	perm=null
2015-03-13 10:09:53,723 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.jar	dst=null	perm=null
2015-03-13 10:09:53,724 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.jar	dst=null	perm=null
2015-03-13 10:09:53,724 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.jar	dst=null	perm=null
2015-03-13 10:09:53,725 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.jar	dst=null	perm=null
2015-03-13 10:09:53,725 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.jar	dst=null	perm=null
2015-03-13 10:09:53,732 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62377, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1448181493_10100, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742042_1218, duration: 496000
2015-03-13 10:09:53,732 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62378, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_707313140_10099, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742042_1218, duration: 415000
2015-03-13 10:09:53,752 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:09:53,752 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:09:53,773 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.xml	dst=null	perm=null
2015-03-13 10:09:53,774 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.xml	dst=null	perm=null
2015-03-13 10:09:53,774 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.xml	dst=null	perm=null
2015-03-13 10:09:53,775 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.xml	dst=null	perm=null
2015-03-13 10:09:53,775 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.xml	dst=null	perm=null
2015-03-13 10:09:53,776 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.xml	dst=null	perm=null
2015-03-13 10:09:53,782 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62378, bytes: 98402, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1448181493_10100, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742045_1221, duration: 232000
2015-03-13 10:09:53,782 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62379, bytes: 98402, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_707313140_10099, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742045_1221, duration: 353000
2015-03-13 10:09:53,796 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:09:53,796 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:09:53,796 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:09:53,796 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:09:53,796 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:09:53,796 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:09:53,796 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:09:53,840 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:09:53,840 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:53,847 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:09:53,847 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:53,847 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:09:53,847 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:53,848 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:09:53,848 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:53,848 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:09:53,849 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:53,981 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000003/default_container_executor.sh]
2015-03-13 10:09:53,982 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000002/default_container_executor.sh]
2015-03-13 10:09:53,989 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000004/default_container_executor.sh]
2015-03-13 10:09:53,995 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000005/default_container_executor.sh]
2015-03-13 10:09:54,016 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000006/default_container_executor.sh]
2015-03-13 10:09:54,179 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742046_1222
2015-03-13 10:09:54,181 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742042_1218
2015-03-13 10:09:54,184 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:54,185 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0018 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:09:54,185 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0018
2015-03-13 10:09:54,185 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0018
2015-03-13 10:09:54,185 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0018
2015-03-13 10:09:54,185 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0018
2015-03-13 10:09:54,186 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0018
2015-03-13 10:09:54,185 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0018 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:09:54,186 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0018, with delay of 10800 seconds
2015-03-13 10:09:54,312 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0018 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:09:54,313 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0018
2015-03-13 10:09:54,313 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0018
2015-03-13 10:09:54,313 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0018
2015-03-13 10:09:54,314 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0018
2015-03-13 10:09:54,313 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0018
2015-03-13 10:09:54,315 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0018 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:09:54,316 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0018, with delay of 10800 seconds
2015-03-13 10:09:54,403 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:09:54,471 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:54,471 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:54,471 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0018 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:09:54,471 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0019_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:09:54,471 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0019_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:09:54,471 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0018
2015-03-13 10:09:54,472 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0018
2015-03-13 10:09:54,471 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0018
2015-03-13 10:09:54,472 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0018
2015-03-13 10:09:54,472 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0018 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:09:54,472 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0018, with delay of 10800 seconds
2015-03-13 10:09:54,472 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0018
2015-03-13 10:09:54,570 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:54,571 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:54,571 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:54,824 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:09:54,825 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:09:54,968 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0019_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000003.tokens
2015-03-13 10:09:54,968 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0019_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000006.tokens
2015-03-13 10:09:54,968 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0019 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0019
2015-03-13 10:09:54,968 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0019 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0019
2015-03-13 10:09:55,069 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:09:55,188 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:55,191 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0019_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000004.tokens
2015-03-13 10:09:55,191 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0019 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0019
2015-03-13 10:09:55,474 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:55,474 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:55,576 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:55,577 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:55,577 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:56,189 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:56,477 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:56,477 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:56,579 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:56,579 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:56,579 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:57,194 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:57,482 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:57,482 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:57,581 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:57,581 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:57,581 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:58,197 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:58,486 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:58,486 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:58,585 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:58,585 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:58,585 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:59,202 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:59,492 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:59,492 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:59,587 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:59,587 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:59,587 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:00,203 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:00,498 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:00,498 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:00,591 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:00,591 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:00,591 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:01,205 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:01,502 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:01,502 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:01,593 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:01,593 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:01,593 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:01,678 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.split	dst=null	perm=null
2015-03-13 10:10:01,904 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62391, bytes: 1282, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0019_m_000002_0_543333481_1, offset: 512, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742043_1219, duration: 180000
2015-03-13 10:10:01,919 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.split	dst=null	perm=null
2015-03-13 10:10:01,943 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.split	dst=null	perm=null
2015-03-13 10:10:02,031 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.split	dst=null	perm=null
2015-03-13 10:10:02,103 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:10:02,107 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62391, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0019_m_000002_0_543333481_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 140000
2015-03-13 10:10:02,113 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.split	dst=null	perm=null
2015-03-13 10:10:02,122 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62395, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0019_m_000001_0_1288041849_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742043_1219, duration: 155000
2015-03-13 10:10:02,136 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1426266260362_0019_m_000002_0/part-00002	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:02,136 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62396, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0019_m_000000_0_1517633601_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742043_1219, duration: 147000
2015-03-13 10:10:02,184 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62398, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0019_m_000004_0_700671599_1, offset: 1024, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742043_1219, duration: 154000
2015-03-13 10:10:02,209 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:02,256 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62399, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0019_m_000003_0_154307093_1, offset: 1024, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742043_1219, duration: 170000
2015-03-13 10:10:02,274 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:10:02,276 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:10:02,282 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62400, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0019_m_000001_0_1288041849_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 157000
2015-03-13 10:10:02,297 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1426266260362_0019_m_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:02,302 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1426266260362_0019_m_000001_0/part-00001	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:02,320 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:10:02,324 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62401, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0019_m_000004_0_700671599_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 142000
2015-03-13 10:10:02,351 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1426266260362_0019_m_000004_0/part-00004	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:02,372 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:10:02,376 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62402, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0019_m_000003_0_154307093_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 158000
2015-03-13 10:10:02,408 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1426266260362_0019_m_000003_0/part-00003	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:02,505 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:02,506 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:02,536 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:10:02,555 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:10:02,573 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:10:02,577 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62403, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0019_m_000002_0_543333481_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 149000
2015-03-13 10:10:02,598 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:02,598 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:02,598 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:02,607 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1426266260362_0019_m_000002_0/part-00002. BP-1005356445-10.1.1.144-1426266257849 blk_1073742047_1223{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:10:02,648 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742047_1223 src: /127.0.0.1:62404 dest: /127.0.0.1:60689
2015-03-13 10:10:02,649 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742047_1223 src: /127.0.0.1:62405 dest: /127.0.0.1:60693
2015-03-13 10:10:02,651 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742047_1223 src: /127.0.0.1:62406 dest: /127.0.0.1:60696
2015-03-13 10:10:02,659 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62406, dest: /127.0.0.1:60696, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0019_m_000002_0_543333481_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742047_1223, duration: 6857000
2015-03-13 10:10:02,659 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742047_1223, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:02,660 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742047_1223{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:02,660 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62405, dest: /127.0.0.1:60693, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0019_m_000002_0_543333481_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742047_1223, duration: 7488000
2015-03-13 10:10:02,660 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742047_1223, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:02,661 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742047_1223{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:02,661 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62404, dest: /127.0.0.1:60689, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0019_m_000002_0_543333481_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742047_1223, duration: 8368000
2015-03-13 10:10:02,661 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742047_1223, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:02,661 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742047_1223{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:02,666 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1426266260362_0019_m_000002_0/part-00002 is closed by DFSClient_attempt_1426266260362_0019_m_000002_0_543333481_1
2015-03-13 10:10:02,675 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1426266260362_0019_m_000002_0	dst=null	perm=null
2015-03-13 10:10:02,681 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1426266260362_0019_m_000002_0	dst=null	perm=null
2015-03-13 10:10:02,682 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/task_1426266260362_0019_m_000002	dst=null	perm=null
2015-03-13 10:10:02,685 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1426266260362_0019_m_000002_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/task_1426266260362_0019_m_000002	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:10:02,706 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0019_01_000004
2015-03-13 10:10:02,706 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0019	CONTAINERID=container_1426266260362_0019_01_000004
2015-03-13 10:10:02,706 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:10:02,706 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0019_01_000004
2015-03-13 10:10:02,706 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:10:02,706 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:02,707 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:02,719 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0019_01_000004 is : 143
2015-03-13 10:10:02,721 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job_1426266260362_0019_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073742048_1224{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:10:02,722 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742048_1224 src: /127.0.0.1:62407 dest: /127.0.0.1:60696
2015-03-13 10:10:02,724 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742048_1224 src: /127.0.0.1:62408 dest: /127.0.0.1:60689
2015-03-13 10:10:02,725 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742048_1224 src: /127.0.0.1:62409 dest: /127.0.0.1:60693
2015-03-13 10:10:02,730 INFO  hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job_1426266260362_0019_1.jhist for DFSClient_NONMAPREDUCE_-602048742_1
2015-03-13 10:10:02,732 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:10:02,733 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000004
2015-03-13 10:10:02,733 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0019	CONTAINERID=container_1426266260362_0019_01_000004
2015-03-13 10:10:02,733 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:10:02,733 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0019_01_000004 from application application_1426266260362_0019
2015-03-13 10:10:02,733 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:02,733 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0019
2015-03-13 10:10:02,734 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000004
2015-03-13 10:10:02,734 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000004
2015-03-13 10:10:02,734 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000004
2015-03-13 10:10:02,788 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:10:02,796 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:10:02,799 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:10:02,807 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62410, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0019_m_000001_0_1288041849_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 152000
2015-03-13 10:10:02,812 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:10:02,821 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:10:02,824 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:10:02,828 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62396, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0019_m_000000_0_1517633601_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 149000
2015-03-13 10:10:02,834 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1426266260362_0019_m_000001_0/part-00001. BP-1005356445-10.1.1.144-1426266257849 blk_1073742049_1225{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:10:02,835 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62411, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0019_m_000000_0_1517633601_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 137000
2015-03-13 10:10:02,864 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1426266260362_0019_m_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073742050_1226{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:10:02,875 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742049_1225 src: /127.0.0.1:62412 dest: /127.0.0.1:60689
2015-03-13 10:10:02,877 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742049_1225 src: /127.0.0.1:62414 dest: /127.0.0.1:60686
2015-03-13 10:10:02,878 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742049_1225 src: /127.0.0.1:62415 dest: /127.0.0.1:60693
2015-03-13 10:10:02,887 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62415, dest: /127.0.0.1:60693, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0019_m_000001_0_1288041849_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742049_1225, duration: 7312000
2015-03-13 10:10:02,887 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742049_1225, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:02,887 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742049_1225{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:02,888 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62414, dest: /127.0.0.1:60686, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0019_m_000001_0_1288041849_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742049_1225, duration: 8077000
2015-03-13 10:10:02,888 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742049_1225, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:02,888 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742049_1225{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:02,888 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62412, dest: /127.0.0.1:60689, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0019_m_000001_0_1288041849_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742049_1225, duration: 8804000
2015-03-13 10:10:02,889 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742049_1225, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:02,889 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742049_1225{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:02,893 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:10:02,893 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1426266260362_0019_m_000001_0/part-00001 is closed by DFSClient_attempt_1426266260362_0019_m_000001_0_1288041849_1
2015-03-13 10:10:02,900 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1426266260362_0019_m_000001_0	dst=null	perm=null
2015-03-13 10:10:02,903 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:10:02,906 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:10:02,906 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1426266260362_0019_m_000001_0	dst=null	perm=null
2015-03-13 10:10:02,907 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/task_1426266260362_0019_m_000001	dst=null	perm=null
2015-03-13 10:10:02,909 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742050_1226 src: /127.0.0.1:62413 dest: /127.0.0.1:60686
2015-03-13 10:10:02,911 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1426266260362_0019_m_000001_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/task_1426266260362_0019_m_000001	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:10:02,911 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742050_1226 src: /127.0.0.1:62416 dest: /127.0.0.1:60693
2015-03-13 10:10:02,912 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62398, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0019_m_000004_0_700671599_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 157000
2015-03-13 10:10:02,913 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742050_1226 src: /127.0.0.1:62417 dest: /127.0.0.1:60689
2015-03-13 10:10:02,921 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62417, dest: /127.0.0.1:60689, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0019_m_000000_0_1517633601_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742050_1226, duration: 7379000
2015-03-13 10:10:02,922 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742050_1226, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:02,922 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742050_1226{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:02,923 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62416, dest: /127.0.0.1:60693, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0019_m_000000_0_1517633601_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742050_1226, duration: 8344000
2015-03-13 10:10:02,923 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742050_1226, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:02,923 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62413, dest: /127.0.0.1:60686, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0019_m_000000_0_1517633601_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742050_1226, duration: 9311000
2015-03-13 10:10:02,924 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742050_1226, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:02,923 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742050_1226{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:02,924 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742050_1226{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:02,929 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0019_01_000003
2015-03-13 10:10:02,929 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1426266260362_0019_m_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0019_m_000000_0_1517633601_1
2015-03-13 10:10:02,930 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:10:02,929 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0019	CONTAINERID=container_1426266260362_0019_01_000003
2015-03-13 10:10:02,930 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0019_01_000003
2015-03-13 10:10:02,930 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:02,930 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:10:02,942 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0019_01_000003 is : 143
2015-03-13 10:10:02,944 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1426266260362_0019_m_000000_0	dst=null	perm=null
2015-03-13 10:10:02,950 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1426266260362_0019_m_000000_0	dst=null	perm=null
2015-03-13 10:10:02,951 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/task_1426266260362_0019_m_000000	dst=null	perm=null
2015-03-13 10:10:02,954 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:10:02,954 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1426266260362_0019_m_000000_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/task_1426266260362_0019_m_000000	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:10:02,955 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000003
2015-03-13 10:10:02,955 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0019	CONTAINERID=container_1426266260362_0019_01_000003
2015-03-13 10:10:02,955 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000003
2015-03-13 10:10:02,955 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000003
2015-03-13 10:10:02,955 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000003
2015-03-13 10:10:02,955 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:10:02,956 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0019_01_000003 from application application_1426266260362_0019
2015-03-13 10:10:02,956 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:02,956 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0019
2015-03-13 10:10:02,960 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1426266260362_0019_m_000004_0/part-00004 is closed by DFSClient_attempt_1426266260362_0019_m_000004_0_700671599_1
2015-03-13 10:10:02,963 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:10:02,967 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0019_01_000002
2015-03-13 10:10:02,967 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0019	CONTAINERID=container_1426266260362_0019_01_000002
2015-03-13 10:10:02,967 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:10:02,967 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0019_01_000002
2015-03-13 10:10:02,967 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:10:02,967 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:10:02,968 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0019_01_000003
2015-03-13 10:10:02,968 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0019_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:10:02,968 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0019_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:10:02,968 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0019	CONTAINERID=container_1426266260362_0019_01_000003
2015-03-13 10:10:02,968 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0019_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:10:02,968 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:10:02,968 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0019_01_000003, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:02,969 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:02,969 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:10:02,969 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0019_000001 released container container_1426266260362_0019_01_000003 on node: host: 10.1.1.144:60715 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:10:02,977 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1426266260362_0019_m_000004_0	dst=null	perm=null
2015-03-13 10:10:02,978 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:10:02,980 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0019_01_000002 is : 143
2015-03-13 10:10:02,982 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:10:02,983 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1426266260362_0019_m_000004_0	dst=null	perm=null
2015-03-13 10:10:02,984 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/task_1426266260362_0019_m_000004	dst=null	perm=null
2015-03-13 10:10:02,987 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1426266260362_0019_m_000004_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/task_1426266260362_0019_m_000004	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:10:02,988 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62418, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0019_m_000003_0_154307093_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 131000
2015-03-13 10:10:02,992 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:10:02,992 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000002
2015-03-13 10:10:02,992 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000002
2015-03-13 10:10:02,992 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000002
2015-03-13 10:10:02,993 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000002
2015-03-13 10:10:02,993 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0019	CONTAINERID=container_1426266260362_0019_01_000002
2015-03-13 10:10:02,993 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:10:02,993 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0019_01_000002 from application application_1426266260362_0019
2015-03-13 10:10:02,993 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:02,993 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0019
2015-03-13 10:10:02,997 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0019_01_000006
2015-03-13 10:10:02,997 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0019	CONTAINERID=container_1426266260362_0019_01_000006
2015-03-13 10:10:02,997 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:10:02,997 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:10:02,997 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0019_01_000006
2015-03-13 10:10:02,997 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0019_01_000004
2015-03-13 10:10:02,997 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:02,998 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:10:02,998 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0019_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:10:02,998 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0019_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:10:02,998 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0019	CONTAINERID=container_1426266260362_0019_01_000004
2015-03-13 10:10:02,998 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0019_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:10:02,998 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:10:02,999 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0019_01_000004, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:02,999 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:02,999 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:10:02,999 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0019_000001 released container container_1426266260362_0019_01_000004 on node: host: 10.1.1.144:60711 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:10:03,009 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0019_01_000006 is : 143
2015-03-13 10:10:03,016 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1426266260362_0019_m_000003_0/part-00003. BP-1005356445-10.1.1.144-1426266257849 blk_1073742051_1227{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:10:03,020 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:10:03,020 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000006
2015-03-13 10:10:03,020 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000006
2015-03-13 10:10:03,021 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000006
2015-03-13 10:10:03,021 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000006
2015-03-13 10:10:03,021 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0019	CONTAINERID=container_1426266260362_0019_01_000006
2015-03-13 10:10:03,022 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:10:03,023 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0019_01_000006 from application application_1426266260362_0019
2015-03-13 10:10:03,023 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:03,023 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0019
2015-03-13 10:10:03,052 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742051_1227 src: /127.0.0.1:62419 dest: /127.0.0.1:60686
2015-03-13 10:10:03,054 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742051_1227 src: /127.0.0.1:62420 dest: /127.0.0.1:60689
2015-03-13 10:10:03,055 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742051_1227 src: /127.0.0.1:62421 dest: /127.0.0.1:60693
2015-03-13 10:10:03,064 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62421, dest: /127.0.0.1:60693, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0019_m_000003_0_154307093_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742051_1227, duration: 7512000
2015-03-13 10:10:03,065 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742051_1227, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:03,065 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742051_1227{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:03,065 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62420, dest: /127.0.0.1:60689, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0019_m_000003_0_154307093_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742051_1227, duration: 8111000
2015-03-13 10:10:03,065 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742051_1227, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:03,066 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742051_1227{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:03,066 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62419, dest: /127.0.0.1:60686, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0019_m_000003_0_154307093_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742051_1227, duration: 8810000
2015-03-13 10:10:03,066 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742051_1227, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:03,066 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742051_1227{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:03,073 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1426266260362_0019_m_000003_0/part-00003 is closed by DFSClient_attempt_1426266260362_0019_m_000003_0_154307093_1
2015-03-13 10:10:03,080 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1426266260362_0019_m_000003_0	dst=null	perm=null
2015-03-13 10:10:03,084 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1426266260362_0019_m_000003_0	dst=null	perm=null
2015-03-13 10:10:03,085 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/task_1426266260362_0019_m_000003	dst=null	perm=null
2015-03-13 10:10:03,088 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1426266260362_0019_m_000003_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/task_1426266260362_0019_m_000003	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:10:03,096 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0019_01_000005
2015-03-13 10:10:03,096 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0019	CONTAINERID=container_1426266260362_0019_01_000005
2015-03-13 10:10:03,097 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:10:03,097 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0019_01_000005
2015-03-13 10:10:03,097 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:10:03,097 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:10:03,097 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0019_01_000006
2015-03-13 10:10:03,097 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0019_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:10:03,098 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0019_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:10:03,098 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0019	CONTAINERID=container_1426266260362_0019_01_000006
2015-03-13 10:10:03,098 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0019_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:10:03,098 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:10:03,098 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0019_01_000006, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:03,098 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:03,098 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:10:03,098 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0019_000001 released container container_1426266260362_0019_01_000006 on node: host: 10.1.1.144:60711 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:10:03,101 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:03,103 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-602048742_1
2015-03-13 10:10:03,107 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1	dst=null	perm=null
2015-03-13 10:10:03,108 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0019_01_000005 is : 143
2015-03-13 10:10:03,114 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown	dst=null	perm=null
2015-03-13 10:10:03,115 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown	dst=null	perm=null
2015-03-13 10:10:03,116 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/task_1426266260362_0019_m_000000	dst=null	perm=null
2015-03-13 10:10:03,117 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/part-00000	dst=null	perm=null
2015-03-13 10:10:03,120 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:10:03,120 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000005
2015-03-13 10:10:03,120 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000005
2015-03-13 10:10:03,120 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/task_1426266260362_0019_m_000000/part-00000	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/part-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:03,121 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000005
2015-03-13 10:10:03,121 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000005
2015-03-13 10:10:03,121 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0019	CONTAINERID=container_1426266260362_0019_01_000005
2015-03-13 10:10:03,121 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:10:03,122 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0019_01_000005 from application application_1426266260362_0019
2015-03-13 10:10:03,122 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:03,122 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0019
2015-03-13 10:10:03,124 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown	dst=null	perm=null
2015-03-13 10:10:03,125 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown	dst=null	perm=null
2015-03-13 10:10:03,126 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/task_1426266260362_0019_m_000001	dst=null	perm=null
2015-03-13 10:10:03,127 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/part-00001	dst=null	perm=null
2015-03-13 10:10:03,128 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/task_1426266260362_0019_m_000001/part-00001	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/part-00001	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:03,129 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown	dst=null	perm=null
2015-03-13 10:10:03,130 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown	dst=null	perm=null
2015-03-13 10:10:03,130 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/task_1426266260362_0019_m_000002	dst=null	perm=null
2015-03-13 10:10:03,131 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/part-00002	dst=null	perm=null
2015-03-13 10:10:03,135 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/task_1426266260362_0019_m_000002/part-00002	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/part-00002	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:03,136 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown	dst=null	perm=null
2015-03-13 10:10:03,137 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown	dst=null	perm=null
2015-03-13 10:10:03,138 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/task_1426266260362_0019_m_000003	dst=null	perm=null
2015-03-13 10:10:03,139 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/part-00003	dst=null	perm=null
2015-03-13 10:10:03,142 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/task_1426266260362_0019_m_000003/part-00003	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/part-00003	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:03,143 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown	dst=null	perm=null
2015-03-13 10:10:03,144 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown	dst=null	perm=null
2015-03-13 10:10:03,145 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/task_1426266260362_0019_m_000004	dst=null	perm=null
2015-03-13 10:10:03,146 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/part-00004	dst=null	perm=null
2015-03-13 10:10:03,147 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/task_1426266260362_0019_m_000004/part-00004	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/part-00004	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:03,150 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary	dst=null	perm=null
2015-03-13 10:10:03,154 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:03,157 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-602048742_1
2015-03-13 10:10:03,159 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:03,161 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-602048742_1
2015-03-13 10:10:03,176 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62409, dest: /127.0.0.1:60693, bytes: 53280, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-602048742_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742048_1224, duration: 449311000
2015-03-13 10:10:03,176 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742048_1224, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:03,177 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742048_1224{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:03,178 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62408, dest: /127.0.0.1:60689, bytes: 53280, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-602048742_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742048_1224, duration: 450537000
2015-03-13 10:10:03,178 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742048_1224, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:03,179 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742048_1224{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:03,179 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62407, dest: /127.0.0.1:60696, bytes: 53280, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-602048742_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742048_1224, duration: 452096000
2015-03-13 10:10:03,180 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742048_1224, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:03,180 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742048_1224{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:03,181 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job_1426266260362_0019_1.jhist is closed by DFSClient_NONMAPREDUCE_-602048742_1
2015-03-13 10:10:03,184 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0019.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:03,187 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0019.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742052_1228{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:10:03,188 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742052_1228 src: /127.0.0.1:62422 dest: /127.0.0.1:60686
2015-03-13 10:10:03,190 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742052_1228 src: /127.0.0.1:62423 dest: /127.0.0.1:60696
2015-03-13 10:10:03,192 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742052_1228 src: /127.0.0.1:62424 dest: /127.0.0.1:60689
2015-03-13 10:10:03,195 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62424, dest: /127.0.0.1:60689, bytes: 440, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-602048742_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742052_1228, duration: 1248000
2015-03-13 10:10:03,195 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742052_1228, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:03,195 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742052_1228{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:03,196 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62423, dest: /127.0.0.1:60696, bytes: 440, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-602048742_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742052_1228, duration: 1658000
2015-03-13 10:10:03,196 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742052_1228, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:03,196 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742052_1228{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:03,196 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62422, dest: /127.0.0.1:60686, bytes: 440, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-602048742_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742052_1228, duration: 2423000
2015-03-13 10:10:03,196 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742052_1228, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:03,197 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742052_1228{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:03,198 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0019.summary_tmp is closed by DFSClient_NONMAPREDUCE_-602048742_1
2015-03-13 10:10:03,203 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0019.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:03,209 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job_1426266260362_0019_1.jhist	dst=null	perm=null
2015-03-13 10:10:03,210 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0019-1426266587640-soberoi-%5BB7ACEFEF0218423EB65E6E148EB627C7%2F2A3F31AD6A62450C-1426266603162-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:10:03,212 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:03,214 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job_1426266260362_0019_1.jhist	dst=null	perm=null
2015-03-13 10:10:03,215 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0019-1426266587640-soberoi-%5BB7ACEFEF0218423EB65E6E148EB627C7%2F2A3F31AD6A62450C-1426266603162-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:10:03,216 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job_1426266260362_0019_1.jhist	dst=null	perm=null
2015-03-13 10:10:03,219 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0019-1426266587640-soberoi-%5BB7ACEFEF0218423EB65E6E148EB627C7%2F2A3F31AD6A62450C-1426266603162-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:03,221 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62425, bytes: 53700, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-602048742_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742048_1224, duration: 195000
2015-03-13 10:10:03,223 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0019-1426266587640-soberoi-%5BB7ACEFEF0218423EB65E6E148EB627C7%2F2A3F31AD6A62450C-1426266603162-5-0-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742053_1229{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:10:03,225 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742053_1229 src: /127.0.0.1:62426 dest: /127.0.0.1:60693
2015-03-13 10:10:03,227 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742053_1229 src: /127.0.0.1:62427 dest: /127.0.0.1:60696
2015-03-13 10:10:03,228 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742053_1229 src: /127.0.0.1:62428 dest: /127.0.0.1:60689
2015-03-13 10:10:03,235 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62428, dest: /127.0.0.1:60689, bytes: 53280, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-602048742_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742053_1229, duration: 5292000
2015-03-13 10:10:03,235 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742048_1224
2015-03-13 10:10:03,235 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742053_1229, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:03,236 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742053_1229{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:03,236 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742053_1229
2015-03-13 10:10:03,236 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62427, dest: /127.0.0.1:60696, bytes: 53280, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-602048742_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742053_1229, duration: 5256000
2015-03-13 10:10:03,236 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742053_1229, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:03,236 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742049_1225
2015-03-13 10:10:03,237 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62426, dest: /127.0.0.1:60693, bytes: 53280, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-602048742_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742053_1229, duration: 5871000
2015-03-13 10:10:03,237 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742050_1226
2015-03-13 10:10:03,237 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742053_1229, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:03,238 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742051_1227
2015-03-13 10:10:03,238 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742047_1223
2015-03-13 10:10:03,238 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742053_1229{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:03,238 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742052_1228
2015-03-13 10:10:03,239 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742053_1229{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:03,240 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0019-1426266587640-soberoi-%5BB7ACEFEF0218423EB65E6E148EB627C7%2F2A3F31AD6A62450C-1426266603162-5-0-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-602048742_1
2015-03-13 10:10:03,242 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0019-1426266587640-soberoi-%5BB7ACEFEF0218423EB65E6E148EB627C7%2F2A3F31AD6A62450C-1426266603162-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:03,243 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job_1426266260362_0019_1_conf.xml	dst=null	perm=null
2015-03-13 10:10:03,244 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0019_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:10:03,244 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job_1426266260362_0019_1_conf.xml	dst=null	perm=null
2015-03-13 10:10:03,245 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0019_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:10:03,246 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job_1426266260362_0019_1_conf.xml	dst=null	perm=null
2015-03-13 10:10:03,248 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0019_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:03,254 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62429, bytes: 91159, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-602048742_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742046_1222, duration: 265000
2015-03-13 10:10:03,256 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0019_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742054_1230{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:10:03,257 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742054_1230 src: /127.0.0.1:62430 dest: /127.0.0.1:60693
2015-03-13 10:10:03,259 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742054_1230 src: /127.0.0.1:62431 dest: /127.0.0.1:60689
2015-03-13 10:10:03,260 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742054_1230 src: /127.0.0.1:62432 dest: /127.0.0.1:60696
2015-03-13 10:10:03,264 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62432, dest: /127.0.0.1:60696, bytes: 90451, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-602048742_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742054_1230, duration: 1830000
2015-03-13 10:10:03,264 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742054_1230, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:03,265 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742054_1230{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:03,265 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62431, dest: /127.0.0.1:60689, bytes: 90451, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-602048742_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742054_1230, duration: 2657000
2015-03-13 10:10:03,265 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742054_1230, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:03,266 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742054_1230{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:03,267 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62430, dest: /127.0.0.1:60693, bytes: 90451, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-602048742_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742054_1230, duration: 4181000
2015-03-13 10:10:03,267 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742054_1230, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:03,267 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742054_1230{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:03,269 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0019_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-602048742_1
2015-03-13 10:10:03,270 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0019_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:03,272 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0019.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0019.summary	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:03,274 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0019_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0019_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:03,277 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0019-1426266587640-soberoi-%5BB7ACEFEF0218423EB65E6E148EB627C7%2F2A3F31AD6A62450C-1426266603162-5-0-SUCCEEDED-default.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0019-1426266587640-soberoi-%5BB7ACEFEF0218423EB65E6E148EB627C7%2F2A3F31AD6A62450C-1426266603162-5-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:03,284 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0019_000001 State change from RUNNING to FINISHING
2015-03-13 10:10:03,284 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0019
2015-03-13 10:10:03,285 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0019 State change from RUNNING to REMOVING
2015-03-13 10:10:03,285 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0019
2015-03-13 10:10:03,285 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0019 State change from REMOVING to FINISHING
2015-03-13 10:10:03,426 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742054_1230
2015-03-13 10:10:03,426 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742047_1223
2015-03-13 10:10:03,427 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742053_1229
2015-03-13 10:10:03,427 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742050_1226
2015-03-13 10:10:03,428 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742051_1227
2015-03-13 10:10:03,428 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742049_1225
2015-03-13 10:10:03,428 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742048_1224
2015-03-13 10:10:03,972 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:10:03,972 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0019_01_000002
2015-03-13 10:10:03,973 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0019_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:10:03,973 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0019_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:10:03,973 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0019	CONTAINERID=container_1426266260362_0019_01_000002
2015-03-13 10:10:03,974 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0019_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:10:03,974 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:10:03,974 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0019_01_000002, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:03,974 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:03,974 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:10:03,975 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0019_000001 released container container_1426266260362_0019_01_000002 on node: host: 10.1.1.144:60715 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:10:03,990 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742050_1226
2015-03-13 10:10:03,990 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742051_1227
2015-03-13 10:10:03,991 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742052_1228
2015-03-13 10:10:03,991 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742049_1225
2015-03-13 10:10:04,102 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:10:04,103 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0019_01_000005
2015-03-13 10:10:04,103 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0019_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:10:04,103 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0019_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:10:04,103 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0019	CONTAINERID=container_1426266260362_0019_01_000005
2015-03-13 10:10:04,104 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0019_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:10:04,104 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:10:04,104 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0019_01_000005, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:04,104 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:04,104 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:10:04,104 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0019_000001 released container container_1426266260362_0019_01_000005 on node: host: 10.1.1.144:60711 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:10:04,189 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742054_1230
2015-03-13 10:10:04,189 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742053_1229
2015-03-13 10:10:04,190 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742052_1228
2015-03-13 10:10:04,190 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742048_1224
2015-03-13 10:10:04,190 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742047_1223
2015-03-13 10:10:04,213 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:04,296 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742042_1218 127.0.0.1:60693 127.0.0.1:60689 127.0.0.1:60686 127.0.0.1:60696 
2015-03-13 10:10:04,296 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742043_1219 127.0.0.1:60686 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60689 
2015-03-13 10:10:04,296 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742044_1220 127.0.0.1:60686 127.0.0.1:60693 127.0.0.1:60696 
2015-03-13 10:10:04,296 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742045_1221 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60689 
2015-03-13 10:10:04,296 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742048_1224 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60693 
2015-03-13 10:10:04,297 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742046_1222 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60689 
2015-03-13 10:10:04,297 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019	dst=null	perm=null
2015-03-13 10:10:04,334 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown	dst=null	perm=null
2015-03-13 10:10:04,334 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary
2015-03-13 10:10:04,334 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary	dst=null	perm=null
2015-03-13 10:10:04,341 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:10:04,341 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:10:04,342 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:10:04,342 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown	dst=null	perm=null
2015-03-13 10:10:04,343 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown	dst=null	perm=null
2015-03-13 10:10:04,344 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown	dst=null	perm=null
2015-03-13 10:10:04,345 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:10:04,346 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/part-00000	dst=null	perm=null
2015-03-13 10:10:04,348 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62434, bytes: 20, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742050_1226, duration: 154000
2015-03-13 10:10:04,348 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/part-00001	dst=null	perm=null
2015-03-13 10:10:04,350 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62435, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742049_1225, duration: 170000
2015-03-13 10:10:04,351 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/part-00002	dst=null	perm=null
2015-03-13 10:10:04,352 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62434, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742047_1223, duration: 168000
2015-03-13 10:10:04,353 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/part-00003	dst=null	perm=null
2015-03-13 10:10:04,354 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62435, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742051_1227, duration: 173000
2015-03-13 10:10:04,354 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/part-00004	dst=null	perm=null
2015-03-13 10:10:04,361 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:10:04,361 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:10:04,362 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:10:04,363 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown	dst=null	perm=null
2015-03-13 10:10:04,363 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown	dst=null	perm=null
2015-03-13 10:10:04,364 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown	dst=null	perm=null
2015-03-13 10:10:04,365 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:10:04,366 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/part-00000	dst=null	perm=null
2015-03-13 10:10:04,368 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62436, bytes: 20, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742050_1226, duration: 187000
2015-03-13 10:10:04,368 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/part-00001	dst=null	perm=null
2015-03-13 10:10:04,369 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62435, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742049_1225, duration: 127000
2015-03-13 10:10:04,370 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/part-00002	dst=null	perm=null
2015-03-13 10:10:04,372 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62437, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742047_1223, duration: 174000
2015-03-13 10:10:04,373 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/part-00003	dst=null	perm=null
2015-03-13 10:10:04,374 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62436, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742051_1227, duration: 155000
2015-03-13 10:10:04,374 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/part-00004	dst=null	perm=null
2015-03-13 10:10:04,375 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/unknown
2015-03-13 10:10:04,375 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown	dst=null	perm=null
2015-03-13 10:10:04,375 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown	dst=null	perm=null
2015-03-13 10:10:04,376 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown	dst=null	perm=null
2015-03-13 10:10:04,376 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown	dst=null	perm=null
2015-03-13 10:10:04,377 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/part-00000	dst=null	perm=null
2015-03-13 10:10:04,378 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/part-00000	dst=null	perm=null
2015-03-13 10:10:04,379 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62436, bytes: 20, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742050_1226, duration: 161000
2015-03-13 10:10:04,379 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/part-00001	dst=null	perm=null
2015-03-13 10:10:04,380 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/part-00001	dst=null	perm=null
2015-03-13 10:10:04,381 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62435, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742049_1225, duration: 156000
2015-03-13 10:10:04,382 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/part-00002	dst=null	perm=null
2015-03-13 10:10:04,382 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/part-00002	dst=null	perm=null
2015-03-13 10:10:04,383 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62434, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742047_1223, duration: 123000
2015-03-13 10:10:04,384 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/part-00003	dst=null	perm=null
2015-03-13 10:10:04,384 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/part-00003	dst=null	perm=null
2015-03-13 10:10:04,385 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62436, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742051_1227, duration: 111000
2015-03-13 10:10:04,386 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/part-00004	dst=null	perm=null
2015-03-13 10:10:04,386 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/part-00004	dst=null	perm=null
2015-03-13 10:10:04,388 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:10:04,388 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:10:04,396 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:10:04,397 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:10:04,397 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:10:04,414 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost	dst=null	perm=null
2015-03-13 10:10:04,415 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper1*upper2] starting
2015-03-13 10:10:04,416 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper1*upper2]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt"]
2015-03-13 10:10:04,416 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper1*upper2]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-03-13 10:10:04,416 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper1*upper2]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt"]
2015-03-13 10:10:04,416 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper1*upper2]  sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost"]
2015-03-13 10:10:04,416 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper1*upper2]  parallel execution is enabled: true
2015-03-13 10:10:04,416 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper1*upper2]  starting jobs: 1
2015-03-13 10:10:04,416 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper1*upper2]  allocating threads: 1
2015-03-13 10:10:04,419 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper1*upper2] starting step: (1/1) ...m/joinaroundjoinrightmost
2015-03-13 10:10:04,425 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:10:04,435 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:10:04,437 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost	dst=null	perm=null
2015-03-13 10:10:04,437 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:10:04,438 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:10:04,440 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 20
2015-03-13 10:10:04,441 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020	dst=null	perm=null
2015-03-13 10:10:04,443 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020	dst=null	perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:10:04,444 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020	dst=null	perm=soberoi:supergroup:rwx------
2015-03-13 10:10:04,444 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.jar	dst=null	perm=null
2015-03-13 10:10:04,446 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:04,448 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073742055_1231{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:10:04,449 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742055_1231 src: /127.0.0.1:62439 dest: /127.0.0.1:60693
2015-03-13 10:10:04,450 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742055_1231 src: /127.0.0.1:62440 dest: /127.0.0.1:60689
2015-03-13 10:10:04,451 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742055_1231 src: /127.0.0.1:62441 dest: /127.0.0.1:60686
2015-03-13 10:10:04,457 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62441, dest: /127.0.0.1:60686, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742055_1231, duration: 4199000
2015-03-13 10:10:04,457 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742055_1231, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:04,457 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742055_1231{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:10:04,458 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62440, dest: /127.0.0.1:60689, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742055_1231, duration: 2264000
2015-03-13 10:10:04,458 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742055_1231, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:04,458 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742055_1231{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:10:04,458 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62439, dest: /127.0.0.1:60693, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742055_1231, duration: 5691000
2015-03-13 10:10:04,459 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742055_1231, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:04,460 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742055_1231{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:10:04,460 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:10:04,461 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.jar
2015-03-13 10:10:04,462 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.jar	dst=null	perm=null
2015-03-13 10:10:04,463 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:04,464 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:10:04,465 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:10:04,466 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:10:04,467 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:10:04,468 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:10:04,468 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:10:04,469 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:10:04,470 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:10:04,471 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:10:04,473 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:10:04,473 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:10:04,474 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:10:04,475 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:04,477 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:04,477 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.split
2015-03-13 10:10:04,477 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.split	dst=null	perm=null
2015-03-13 10:10:04,478 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073742056_1232{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:10:04,480 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742056_1232 src: /127.0.0.1:62442 dest: /127.0.0.1:60689
2015-03-13 10:10:04,481 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742056_1232 src: /127.0.0.1:62443 dest: /127.0.0.1:60696
2015-03-13 10:10:04,482 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742056_1232 src: /127.0.0.1:62444 dest: /127.0.0.1:60686
2015-03-13 10:10:04,483 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742056_1232 src: /127.0.0.1:62445 dest: /127.0.0.1:60693
2015-03-13 10:10:04,485 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62445, dest: /127.0.0.1:60693, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742056_1232, duration: 1665000
2015-03-13 10:10:04,485 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742056_1232, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:04,486 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742056_1232{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:04,486 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62444, dest: /127.0.0.1:60686, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742056_1232, duration: 1988000
2015-03-13 10:10:04,486 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742056_1232, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:04,486 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742056_1232{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:04,487 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62443, dest: /127.0.0.1:60696, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742056_1232, duration: 2772000
2015-03-13 10:10:04,487 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742056_1232, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:04,487 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742056_1232{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:04,487 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62442, dest: /127.0.0.1:60689, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742056_1232, duration: 3207000
2015-03-13 10:10:04,487 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742056_1232, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:04,488 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742056_1232{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:04,489 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:10:04,490 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:04,491 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:04,492 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073742057_1233{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:10:04,493 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742057_1233 src: /127.0.0.1:62446 dest: /127.0.0.1:60689
2015-03-13 10:10:04,495 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742057_1233 src: /127.0.0.1:62447 dest: /127.0.0.1:60693
2015-03-13 10:10:04,496 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742057_1233 src: /127.0.0.1:62448 dest: /127.0.0.1:60686
2015-03-13 10:10:04,498 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62448, dest: /127.0.0.1:60686, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742057_1233, duration: 1278000
2015-03-13 10:10:04,498 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742057_1233, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:04,498 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742057_1233{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:10:04,499 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62447, dest: /127.0.0.1:60693, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742057_1233, duration: 1782000
2015-03-13 10:10:04,499 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742057_1233, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:04,499 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742057_1233{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:10:04,499 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62446, dest: /127.0.0.1:60689, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742057_1233, duration: 2667000
2015-03-13 10:10:04,500 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742057_1233, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:04,501 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742057_1233{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:10:04,502 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:10:04,502 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:10:04,503 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:04,505 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:04,506 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:10:04,506 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:10:04,506 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:10:04,511 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742058_1234{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:10:04,512 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742058_1234 src: /127.0.0.1:62449 dest: /127.0.0.1:60689
2015-03-13 10:10:04,514 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742058_1234 src: /127.0.0.1:62450 dest: /127.0.0.1:60693
2015-03-13 10:10:04,515 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742058_1234 src: /127.0.0.1:62451 dest: /127.0.0.1:60696
2015-03-13 10:10:04,518 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62451, dest: /127.0.0.1:60696, bytes: 98190, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742058_1234, duration: 1499000
2015-03-13 10:10:04,518 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742058_1234, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:04,519 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742058_1234{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:04,519 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62450, dest: /127.0.0.1:60693, bytes: 98190, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742058_1234, duration: 1911000
2015-03-13 10:10:04,519 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742058_1234, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:04,519 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742058_1234{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:04,520 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62449, dest: /127.0.0.1:60689, bytes: 98190, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742058_1234, duration: 2742000
2015-03-13 10:10:04,520 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742058_1234, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:04,520 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742058_1234{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:04,521 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:10:04,521 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0020
2015-03-13 10:10:04,522 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020	dst=null	perm=null
2015-03-13 10:10:04,523 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.xml	dst=null	perm=null
2015-03-13 10:10:04,524 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.xml	dst=null	perm=null
2015-03-13 10:10:04,525 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.jar	dst=null	perm=null
2015-03-13 10:10:04,525 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.jar	dst=null	perm=null
2015-03-13 10:10:04,526 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.split	dst=null	perm=null
2015-03-13 10:10:04,527 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.split	dst=null	perm=null
2015-03-13 10:10:04,528 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:10:04,528 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:10:04,530 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:10:04,530 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:10:04,531 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:10:04,531 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:10:04,532 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:10:04,532 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:10:04,533 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 20 submitted by user soberoi
2015-03-13 10:10:04,533 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0020
2015-03-13 10:10:04,534 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	IP=10.1.1.144	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1426266260362_0020
2015-03-13 10:10:04,534 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0020
2015-03-13 10:10:04,534 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0020 State change from NEW to NEW_SAVING
2015-03-13 10:10:04,534 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0020 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:10:04,534 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0020_000001
2015-03-13 10:10:04,534 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0020_000001 State change from NEW to SUBMITTED
2015-03-13 10:10:04,534 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0020 from user: soberoi activated in queue: default
2015-03-13 10:10:04,535 INFO  capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0020 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:10:04,535 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0020 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:10:04,535 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0020 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:10:04,535 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0020_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:10:04,535 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0020_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:10:04,539 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0020 State change from SUBMITTED to ACCEPTED
2015-03-13 10:10:04,541 INFO  mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0020/
2015-03-13 10:10:04,541 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper1*upper2] submitted hadoop job: job_1426266260362_0020
2015-03-13 10:10:04,541 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper1*upper2] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0020/
2015-03-13 10:10:04,978 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0020_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:10:04,978 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0020	CONTAINERID=container_1426266260362_0020_01_000001
2015-03-13 10:10:04,978 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0020_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:10:04,979 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0020 container=Container: [ContainerId: container_1426266260362_0020_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0020_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:04,979 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:10:04,979 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0020_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:10:04,979 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:04,980 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0020 AttemptId: appattempt_1426266260362_0020_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0020_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ]
2015-03-13 10:10:04,980 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0020_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:10:04,980 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0020_000001
2015-03-13 10:10:04,981 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0020_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:10:04,981 INFO  amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0020_000001
2015-03-13 10:10:04,981 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0020_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] for AM appattempt_1426266260362_0020_000001
2015-03-13 10:10:04,981 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0020_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-03-13 10:10:04,983 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0020_000001 (auth:SIMPLE)
2015-03-13 10:10:04,985 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0020_01_000001 by user soberoi
2015-03-13 10:10:04,985 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0020
2015-03-13 10:10:04,985 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0020	CONTAINERID=container_1426266260362_0020_01_000001
2015-03-13 10:10:04,985 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0020 transitioned from NEW to INITING
2015-03-13 10:10:04,985 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0020_01_000001 to application application_1426266260362_0020
2015-03-13 10:10:04,985 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0020 transitioned from INITING to RUNNING
2015-03-13 10:10:04,985 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0020_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] for AM appattempt_1426266260362_0020_000001
2015-03-13 10:10:04,986 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0020_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:10:04,986 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:10:04,986 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0020
2015-03-13 10:10:04,986 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:10:04,986 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:10:04,986 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:10:04,986 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:10:04,986 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0020_01_000001
2015-03-13 10:10:04,996 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426266260362_0020_01_000001.tokens. Credentials list: 
2015-03-13 10:10:05,014 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:10:05,084 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426266260362_0020_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000001.tokens
2015-03-13 10:10:05,084 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0020 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0020
2015-03-13 10:10:05,142 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.jar	dst=null	perm=null
2015-03-13 10:10:05,143 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.jar	dst=null	perm=null
2015-03-13 10:10:05,144 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.jar	dst=null	perm=null
2015-03-13 10:10:05,150 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62435, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1037748226_10503, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742055_1231, duration: 459000
2015-03-13 10:10:05,173 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:05,189 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:10:05,189 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:10:05,190 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:10:05,196 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62436, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1037748226_10503, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742057_1233, duration: 170000
2015-03-13 10:10:05,208 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:05,218 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:05,224 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.split	dst=null	perm=null
2015-03-13 10:10:05,225 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.split	dst=null	perm=null
2015-03-13 10:10:05,225 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.split	dst=null	perm=null
2015-03-13 10:10:05,231 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62437, bytes: 1798, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1037748226_10503, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742056_1232, duration: 167000
2015-03-13 10:10:05,242 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:05,261 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.xml	dst=null	perm=null
2015-03-13 10:10:05,262 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.xml	dst=null	perm=null
2015-03-13 10:10:05,262 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.xml	dst=null	perm=null
2015-03-13 10:10:05,270 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62434, bytes: 98958, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1037748226_10503, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742058_1234, duration: 252000
2015-03-13 10:10:05,284 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:05,284 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:10:05,307 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:10:05,307 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:05,381 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000001/default_container_executor.sh]
2015-03-13 10:10:05,978 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:05,978 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0020_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:10:06,219 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:06,931 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60686 to replicate blk_1073742055_1231 to datanode(s) 127.0.0.1:60696
2015-03-13 10:10:06,931 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073742048_1224, blk_1073742042_1218, blk_1073742043_1219, blk_1073742044_1220, blk_1073742045_1221, blk_1073742046_1222]
2015-03-13 10:10:06,931 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073742048_1224, blk_1073742042_1218, blk_1073742043_1219, blk_1073742044_1220, blk_1073742046_1222]
2015-03-13 10:10:06,939 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:10:06,959 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/COMMIT_STARTED	dst=null	perm=null
2015-03-13 10:10:06,961 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/COMMIT_SUCCESS	dst=null	perm=null
2015-03-13 10:10:06,961 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/COMMIT_FAIL	dst=null	perm=null
2015-03-13 10:10:06,982 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:07,012 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020	dst=null	perm=null
2015-03-13 10:10:07,013 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:10:07,014 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:10:07,220 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:07,278 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:10:07,284 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:10:07,337 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62456, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-2134179526_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742057_1233, duration: 139000
2015-03-13 10:10:07,542 INFO  datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-1907321454-10.1.1.144-60686-1426266259166, infoPort=60687, ipcPort=60688, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073742055_1231 to 127.0.0.1:60696 
2015-03-13 10:10:07,544 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742055_1231 src: /127.0.0.1:62459 dest: /127.0.0.1:60696
2015-03-13 10:10:07,544 INFO  datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073742055_1231 (numBytes=254067) to /127.0.0.1:60696
2015-03-13 10:10:07,546 INFO  datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073742055_1231 src: /127.0.0.1:62459 dest: /127.0.0.1:60696 of size 254067
2015-03-13 10:10:07,547 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742055_1231 size 254067
2015-03-13 10:10:07,733 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742048_1224 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742048 for deletion
2015-03-13 10:10:07,733 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742042_1218 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742042 for deletion
2015-03-13 10:10:07,733 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742043_1219 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742043 for deletion
2015-03-13 10:10:07,733 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742044_1220 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742044 for deletion
2015-03-13 10:10:07,733 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742046_1222 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742046 for deletion
2015-03-13 10:10:07,734 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742048_1224 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742048
2015-03-13 10:10:07,734 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742043_1219 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742043
2015-03-13 10:10:07,734 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742046_1222 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742046
2015-03-13 10:10:07,735 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742042_1218 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742042
2015-03-13 10:10:07,735 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742044_1220 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742044
2015-03-13 10:10:07,915 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742048_1224 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742048 for deletion
2015-03-13 10:10:07,915 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742042_1218 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742042 for deletion
2015-03-13 10:10:07,915 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742043_1219 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742043 for deletion
2015-03-13 10:10:07,915 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742044_1220 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742044 for deletion
2015-03-13 10:10:07,915 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742045_1221 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742045 for deletion
2015-03-13 10:10:07,916 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742046_1222 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742046 for deletion
2015-03-13 10:10:07,915 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742048_1224 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742048
2015-03-13 10:10:07,916 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742042_1218 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742042
2015-03-13 10:10:07,916 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742043_1219 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742043
2015-03-13 10:10:07,916 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742044_1220 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742044
2015-03-13 10:10:07,916 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742045_1221 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742045
2015-03-13 10:10:07,916 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742046_1222 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742046
2015-03-13 10:10:07,984 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:08,079 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0020_000001 (auth:SIMPLE)
2015-03-13 10:10:08,080 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0020_000001
2015-03-13 10:10:08,080 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi	IP=10.1.1.144	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1426266260362_0020	APPATTEMPTID=appattempt_1426266260362_0020_000001
2015-03-13 10:10:08,080 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0020_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:10:08,080 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0020 State change from ACCEPTED to RUNNING
2015-03-13 10:10:08,100 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job_1426266260362_0020_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:08,102 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:10:08,169 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job_1426266260362_0020_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:08,223 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:08,243 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742058_1234
2015-03-13 10:10:08,243 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742056_1232
2015-03-13 10:10:08,243 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742057_1233
2015-03-13 10:10:08,291 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job_1426266260362_0020_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742059_1235{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:10:08,330 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742059_1235 src: /127.0.0.1:62463 dest: /127.0.0.1:60686
2015-03-13 10:10:08,332 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742059_1235 src: /127.0.0.1:62464 dest: /127.0.0.1:60689
2015-03-13 10:10:08,334 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742059_1235 src: /127.0.0.1:62465 dest: /127.0.0.1:60696
2015-03-13 10:10:08,341 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62465, dest: /127.0.0.1:60696, bytes: 90979, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2134179526_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742059_1235, duration: 6268000
2015-03-13 10:10:08,342 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742059_1235, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:08,342 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62464, dest: /127.0.0.1:60689, bytes: 90979, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2134179526_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742059_1235, duration: 6629000
2015-03-13 10:10:08,343 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742059_1235, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:08,343 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742059_1235{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:08,344 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62463, dest: /127.0.0.1:60686, bytes: 90979, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2134179526_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742059_1235, duration: 7772000
2015-03-13 10:10:08,344 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742059_1235, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:08,344 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742059_1235{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:08,345 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742059_1235{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:08,349 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job_1426266260362_0020_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-2134179526_1
2015-03-13 10:10:08,436 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742055_1231
2015-03-13 10:10:08,437 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742058_1234
2015-03-13 10:10:08,437 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742057_1233
2015-03-13 10:10:08,438 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742056_1232
2015-03-13 10:10:08,449 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742055_1231
2015-03-13 10:10:08,449 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742059_1235
2015-03-13 10:10:08,648 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742054_1230
2015-03-13 10:10:08,985 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:08,999 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742057_1233
2015-03-13 10:10:09,000 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742059_1235
2015-03-13 10:10:09,002 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742055_1231
2015-03-13 10:10:09,002 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742056_1232
2015-03-13 10:10:09,115 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0020_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:10:09,115 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0020	CONTAINERID=container_1426266260362_0020_01_000002
2015-03-13 10:10:09,115 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0020_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:10:09,115 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0020 container=Container: [ContainerId: container_1426266260362_0020_01_000002, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0020_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:09,115 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:10:09,115 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:09,116 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0020_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:10:09,116 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0020	CONTAINERID=container_1426266260362_0020_01_000003
2015-03-13 10:10:09,116 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0020_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:10:09,116 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0020 container=Container: [ContainerId: container_1426266260362_0020_01_000003, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0020_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:09,116 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:10:09,116 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:09,117 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0020_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:10:09,117 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0020	CONTAINERID=container_1426266260362_0020_01_000004
2015-03-13 10:10:09,117 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0020_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:10:09,117 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0020 container=Container: [ContainerId: container_1426266260362_0020_01_000004, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0020_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:09,117 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:10:09,117 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:09,117 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0020_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:10:09,117 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0020	CONTAINERID=container_1426266260362_0020_01_000005
2015-03-13 10:10:09,118 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0020_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:10:09,118 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0020 container=Container: [ContainerId: container_1426266260362_0020_01_000005, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0020_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:09,118 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:10:09,118 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:09,199 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742058_1234
2015-03-13 10:10:09,200 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742059_1235
2015-03-13 10:10:09,228 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:09,228 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0020_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:10:09,229 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0020	CONTAINERID=container_1426266260362_0020_01_000006
2015-03-13 10:10:09,229 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0020_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:10:09,229 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0020 container=Container: [ContainerId: container_1426266260362_0020_01_000006, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0020_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:09,229 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7
2015-03-13 10:10:09,229 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:09,403 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742055_1231
2015-03-13 10:10:09,404 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742056_1232
2015-03-13 10:10:09,431 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0019_01_000001 succeeded 
2015-03-13 10:10:09,431 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:10:09,431 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0019_01_000001
2015-03-13 10:10:09,438 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000001
2015-03-13 10:10:09,438 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000001
2015-03-13 10:10:09,438 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000001
2015-03-13 10:10:09,438 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000001
2015-03-13 10:10:09,438 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0019	CONTAINERID=container_1426266260362_0019_01_000001
2015-03-13 10:10:09,439 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:10:09,439 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0019_01_000001 from application application_1426266260362_0019
2015-03-13 10:10:09,439 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:09,439 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0019
2015-03-13 10:10:09,936 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073742048_1224, blk_1073742042_1218, blk_1073742043_1219, blk_1073742045_1221, blk_1073742046_1222]
2015-03-13 10:10:09,936 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073742042_1218, blk_1073742043_1219, blk_1073742044_1220, blk_1073742045_1221]
2015-03-13 10:10:09,986 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:10,119 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0020_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:10:10,119 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0020_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:10:10,119 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0020_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:10:10,120 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0020_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:10:10,120 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0020_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:10:10,146 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.jar	dst=null	perm=null
2015-03-13 10:10:10,147 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.jar	dst=null	perm=null
2015-03-13 10:10:10,155 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.xml	dst=null	perm=null
2015-03-13 10:10:10,156 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.xml	dst=null	perm=null
2015-03-13 10:10:10,158 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:10:10,159 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:10:10,164 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:10:10,166 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:10:10,167 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:10:10,168 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:10:10,229 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:10:10,229 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0019_01_000001
2015-03-13 10:10:10,229 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0019_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:10:10,229 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0019_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:10:10,229 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0019_000001
2015-03-13 10:10:10,230 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0019	CONTAINERID=container_1426266260362_0019_01_000001
2015-03-13 10:10:10,230 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0019_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:10:10,230 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:7168, vCores:6> numContainers=6 user=soberoi user-resources=<memory:7168, vCores:6>
2015-03-13 10:10:10,230 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0019_000001 State change from FINISHING to FINISHED
2015-03-13 10:10:10,230 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0019 State change from FINISHING to FINISHED
2015-03-13 10:10:10,230 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0019_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:10,230 INFO  amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0019_000001
2015-03-13 10:10:10,230 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:10,230 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1426266260362_0019
2015-03-13 10:10:10,231 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0019,name=[B7ACEFEF0218423EB65E6E148EB627C7/2A3F31AD6A62450CB825E66F41825487] lower*upper/(1/1) ...ldedpipesplatform/unknown,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0019/jobhistory/job/job_1426266260362_0019,appMasterHost=Edinburgh.local,startTime=1426266587640,finishTime=1426266603285,finalStatus=SUCCEEDED
2015-03-13 10:10:10,230 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6
2015-03-13 10:10:10,231 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0019_000001 released container container_1426266260362_0019_01_000001 on node: host: 10.1.1.144:60723 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:10:10,231 INFO  capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0019_000001 is done. finalState=FINISHED
2015-03-13 10:10:10,231 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0019 requests cleared
2015-03-13 10:10:10,231 INFO  capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0019 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:10:10,231 INFO  capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0019 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:10:10,233 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0019_000001 (auth:SIMPLE)
2015-03-13 10:10:10,234 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0019_01_000001
2015-03-13 10:10:10,244 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0020_000001 (auth:SIMPLE)
2015-03-13 10:10:10,244 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0020_000001 (auth:SIMPLE)
2015-03-13 10:10:10,247 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0020_01_000002 by user soberoi
2015-03-13 10:10:10,248 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0020
2015-03-13 10:10:10,248 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0020_01_000006 by user soberoi
2015-03-13 10:10:10,248 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0020_01_000004 by user soberoi
2015-03-13 10:10:10,248 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0020
2015-03-13 10:10:10,248 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0020	CONTAINERID=container_1426266260362_0020_01_000004
2015-03-13 10:10:10,248 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0020 transitioned from NEW to INITING
2015-03-13 10:10:10,248 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0020_01_000002 to application application_1426266260362_0020
2015-03-13 10:10:10,248 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0020_01_000004 to application application_1426266260362_0020
2015-03-13 10:10:10,248 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0020_01_000005 by user soberoi
2015-03-13 10:10:10,248 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0020 transitioned from NEW to INITING
2015-03-13 10:10:10,249 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0020_01_000006 to application application_1426266260362_0020
2015-03-13 10:10:10,249 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0020	CONTAINERID=container_1426266260362_0020_01_000005
2015-03-13 10:10:10,249 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0020 transitioned from INITING to RUNNING
2015-03-13 10:10:10,249 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:10:10,249 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0020
2015-03-13 10:10:10,249 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0020
2015-03-13 10:10:10,249 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:10:10,249 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0020
2015-03-13 10:10:10,249 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:10:10,248 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0020	CONTAINERID=container_1426266260362_0020_01_000002
2015-03-13 10:10:10,249 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:10:10,250 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0020_01_000006
2015-03-13 10:10:10,248 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0020 transitioned from INITING to RUNNING
2015-03-13 10:10:10,248 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0020_01_000003 by user soberoi
2015-03-13 10:10:10,248 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0020	CONTAINERID=container_1426266260362_0020_01_000006
2015-03-13 10:10:10,251 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0020	CONTAINERID=container_1426266260362_0020_01_000003
2015-03-13 10:10:10,251 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:10:10,254 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:10:10,254 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0020_01_000005 to application application_1426266260362_0020
2015-03-13 10:10:10,254 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0020
2015-03-13 10:10:10,254 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0020
2015-03-13 10:10:10,254 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:10:10,254 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0020
2015-03-13 10:10:10,254 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:10:10,254 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:10:10,254 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0020_01_000003 to application application_1426266260362_0020
2015-03-13 10:10:10,255 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0020
2015-03-13 10:10:10,255 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0020
2015-03-13 10:10:10,255 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:10:10,255 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0020
2015-03-13 10:10:10,255 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:10:10,255 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0020_01_000002
2015-03-13 10:10:10,256 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:10:10,256 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0020_01_000004
2015-03-13 10:10:10,256 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0020
2015-03-13 10:10:10,256 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0020
2015-03-13 10:10:10,256 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:10:10,257 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0020
2015-03-13 10:10:10,257 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0020
2015-03-13 10:10:10,257 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0020
2015-03-13 10:10:10,257 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:10:10,257 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0020
2015-03-13 10:10:10,258 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0020_01_000005
2015-03-13 10:10:10,259 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0020_01_000003
2015-03-13 10:10:10,276 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426266260362_0020_01_000006.tokens. Credentials list: 
2015-03-13 10:10:10,276 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1426266260362_0020_01_000002.tokens. Credentials list: 
2015-03-13 10:10:10,277 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1426266260362_0020_01_000004.tokens. Credentials list: 
2015-03-13 10:10:10,277 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0020_01_000005.tokens. Credentials list: 
2015-03-13 10:10:10,277 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1426266260362_0020_01_000003.tokens. Credentials list: 
2015-03-13 10:10:10,297 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:10:10,298 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:10:10,384 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426266260362_0020_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000006.tokens
2015-03-13 10:10:10,384 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1426266260362_0020_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000002.tokens
2015-03-13 10:10:10,384 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0020 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0020
2015-03-13 10:10:10,384 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0020 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0020
2015-03-13 10:10:10,452 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.jar	dst=null	perm=null
2015-03-13 10:10:10,453 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.jar	dst=null	perm=null
2015-03-13 10:10:10,453 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.jar	dst=null	perm=null
2015-03-13 10:10:10,453 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.jar	dst=null	perm=null
2015-03-13 10:10:10,454 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.jar	dst=null	perm=null
2015-03-13 10:10:10,454 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.jar	dst=null	perm=null
2015-03-13 10:10:10,463 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62473, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1551528518_10648, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742055_1231, duration: 485000
2015-03-13 10:10:10,463 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62474, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1678865852_10649, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742055_1231, duration: 533000
2015-03-13 10:10:10,483 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:10,483 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:10,501 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.xml	dst=null	perm=null
2015-03-13 10:10:10,501 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.xml	dst=null	perm=null
2015-03-13 10:10:10,502 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.xml	dst=null	perm=null
2015-03-13 10:10:10,502 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.xml	dst=null	perm=null
2015-03-13 10:10:10,503 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.xml	dst=null	perm=null
2015-03-13 10:10:10,504 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.xml	dst=null	perm=null
2015-03-13 10:10:10,509 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62476, bytes: 98958, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1551528518_10648, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742058_1234, duration: 237000
2015-03-13 10:10:10,509 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62475, bytes: 98958, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1678865852_10649, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742058_1234, duration: 294000
2015-03-13 10:10:10,524 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:10,524 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:10:10,524 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:10:10,524 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:10:10,524 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:10,524 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:10:10,524 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:10:10,546 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742048_1224 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742048 for deletion
2015-03-13 10:10:10,546 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742042_1218 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742042 for deletion
2015-03-13 10:10:10,547 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742043_1219 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742043 for deletion
2015-03-13 10:10:10,547 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742045_1221 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742045 for deletion
2015-03-13 10:10:10,547 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742046_1222 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742046 for deletion
2015-03-13 10:10:10,547 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742048_1224 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742048
2015-03-13 10:10:10,548 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742042_1218 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742042
2015-03-13 10:10:10,548 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742045_1221 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742045
2015-03-13 10:10:10,548 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742043_1219 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742043
2015-03-13 10:10:10,549 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742046_1222 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742046
2015-03-13 10:10:10,549 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742042_1218 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742042 for deletion
2015-03-13 10:10:10,549 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742043_1219 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742043 for deletion
2015-03-13 10:10:10,550 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742044_1220 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742044 for deletion
2015-03-13 10:10:10,550 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742045_1221 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742045 for deletion
2015-03-13 10:10:10,550 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742042_1218 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742042
2015-03-13 10:10:10,550 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742043_1219 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742043
2015-03-13 10:10:10,550 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742044_1220 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742044
2015-03-13 10:10:10,551 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742045_1221 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742045
2015-03-13 10:10:10,574 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:10:10,574 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:10,575 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:10:10,575 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:10,575 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:10:10,575 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:10,579 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:10:10,580 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:10,594 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:10:10,594 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:10,701 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000006/default_container_executor.sh]
2015-03-13 10:10:10,706 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000002/default_container_executor.sh]
2015-03-13 10:10:10,724 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000005/default_container_executor.sh]
2015-03-13 10:10:10,729 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000004/default_container_executor.sh]
2015-03-13 10:10:10,752 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000003/default_container_executor.sh]
2015-03-13 10:10:10,988 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:10,989 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0019 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:10:10,990 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0019
2015-03-13 10:10:10,990 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0019 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:10:10,990 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0019, with delay of 10800 seconds
2015-03-13 10:10:10,990 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0019
2015-03-13 10:10:10,991 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0019
2015-03-13 10:10:10,992 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0019
2015-03-13 10:10:10,992 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0019
2015-03-13 10:10:11,119 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:11,119 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:11,119 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:11,119 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:11,120 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0019 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:10:11,120 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0020_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:10:11,120 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0020_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:10:11,120 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0019
2015-03-13 10:10:11,120 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0019
2015-03-13 10:10:11,120 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0019
2015-03-13 10:10:11,120 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0020_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:10:11,120 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0020_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:10:11,120 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0019
2015-03-13 10:10:11,120 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0019 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:10:11,121 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0019, with delay of 10800 seconds
2015-03-13 10:10:11,120 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0019
2015-03-13 10:10:11,136 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:10:11,231 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:11,231 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0019 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:10:11,231 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0020_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:10:11,231 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0019
2015-03-13 10:10:11,231 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0019
2015-03-13 10:10:11,232 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0019
2015-03-13 10:10:11,232 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0019
2015-03-13 10:10:11,232 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0019
2015-03-13 10:10:11,232 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0019 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:10:11,232 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0019, with delay of 10800 seconds
2015-03-13 10:10:11,557 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:10:11,674 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1426266260362_0020_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000003.tokens
2015-03-13 10:10:11,674 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0020 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0020
2015-03-13 10:10:11,786 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:10:11,921 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0020_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000005.tokens
2015-03-13 10:10:11,921 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0020 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0020
2015-03-13 10:10:11,990 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:12,041 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:10:12,120 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:12,120 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:12,120 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:12,121 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:12,179 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1426266260362_0020_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000004.tokens
2015-03-13 10:10:12,180 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0020 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0020
2015-03-13 10:10:12,232 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:12,996 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:13,125 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:13,125 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:13,125 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:13,126 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:13,237 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:13,998 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:14,128 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:14,128 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:14,128 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:14,128 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:14,238 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:15,003 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:15,130 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:15,130 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:15,131 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:15,131 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:15,242 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:16,006 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:16,134 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:16,134 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:16,134 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:16,135 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:16,246 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:17,013 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:17,137 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:17,137 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:17,137 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:17,137 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:17,248 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:18,018 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:18,142 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:18,142 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:18,143 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:18,143 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:18,253 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:18,400 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.split	dst=null	perm=null
2015-03-13 10:10:18,473 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.split	dst=null	perm=null
2015-03-13 10:10:18,500 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.split	dst=null	perm=null
2015-03-13 10:10:18,501 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.split	dst=null	perm=null
2015-03-13 10:10:18,549 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.split	dst=null	perm=null
2015-03-13 10:10:18,592 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62490, bytes: 1282, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0020_m_000002_0_174688487_1, offset: 512, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742056_1232, duration: 151000
2015-03-13 10:10:18,667 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62491, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0020_m_000004_0_1227176988_1, offset: 1024, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742056_1232, duration: 177000
2015-03-13 10:10:18,669 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62492, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0020_m_000001_0_-1228934246_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742056_1232, duration: 151000
2015-03-13 10:10:18,691 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62493, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0020_m_000003_0_464453710_1, offset: 1024, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742056_1232, duration: 177000
2015-03-13 10:10:18,726 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62494, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0020_m_000000_0_803283296_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742056_1232, duration: 170000
2015-03-13 10:10:18,740 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:10:18,746 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62495, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0020_m_000002_0_174688487_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 168000
2015-03-13 10:10:18,773 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/_temporary/attempt_1426266260362_0020_m_000002_0/part-00002	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:18,788 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:10:18,788 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:10:18,793 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62497, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0020_m_000003_0_464453710_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 93000
2015-03-13 10:10:18,793 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62496, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0020_m_000004_0_1227176988_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 137000
2015-03-13 10:10:18,805 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:10:18,808 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/_temporary/attempt_1426266260362_0020_m_000003_0/part-00003	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:18,809 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62498, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0020_m_000001_0_-1228934246_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 143000
2015-03-13 10:10:18,824 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/_temporary/attempt_1426266260362_0020_m_000004_0/part-00004	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:18,827 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/_temporary/attempt_1426266260362_0020_m_000001_0/part-00001	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:18,861 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:10:18,878 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/_temporary/attempt_1426266260362_0020_m_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:19,021 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:19,144 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:19,144 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:19,144 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:19,144 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:19,175 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:10:19,193 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:10:19,197 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:10:19,202 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62499, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0020_m_000002_0_174688487_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 175000
2015-03-13 10:10:19,247 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:10:19,249 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:10:19,253 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/_temporary/attempt_1426266260362_0020_m_000002_0/part-00002. BP-1005356445-10.1.1.144-1426266257849 blk_1073742060_1236{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:10:19,256 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:19,260 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:10:19,261 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:10:19,264 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:10:19,264 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:10:19,274 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:10:19,278 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62502, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0020_m_000004_0_1227176988_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 159000
2015-03-13 10:10:19,279 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62501, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0020_m_000001_0_-1228934246_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 131000
2015-03-13 10:10:19,283 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:10:19,287 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:10:19,295 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/_temporary/attempt_1426266260362_0020_m_000004_0/part-00004 is closed by DFSClient_attempt_1426266260362_0020_m_000004_0_1227176988_1
2015-03-13 10:10:19,297 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742060_1236 src: /127.0.0.1:62500 dest: /127.0.0.1:60686
2015-03-13 10:10:19,299 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62503, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0020_m_000003_0_464453710_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 150000
2015-03-13 10:10:19,299 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742060_1236 src: /127.0.0.1:62504 dest: /127.0.0.1:60689
2015-03-13 10:10:19,300 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742060_1236 src: /127.0.0.1:62505 dest: /127.0.0.1:60696
2015-03-13 10:10:19,306 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:10:19,308 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62505, dest: /127.0.0.1:60696, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0020_m_000002_0_174688487_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742060_1236, duration: 5922000
2015-03-13 10:10:19,308 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742060_1236, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:19,308 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/_temporary/attempt_1426266260362_0020_m_000004_0	dst=null	perm=null
2015-03-13 10:10:19,308 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62504, dest: /127.0.0.1:60689, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0020_m_000002_0_174688487_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742060_1236, duration: 6669000
2015-03-13 10:10:19,309 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742060_1236, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:19,308 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742060_1236{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:19,309 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742060_1236{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:19,310 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62500, dest: /127.0.0.1:60686, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0020_m_000002_0_174688487_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742060_1236, duration: 8096000
2015-03-13 10:10:19,310 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742060_1236, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:19,311 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742060_1236{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:19,315 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/_temporary/attempt_1426266260362_0020_m_000002_0/part-00002 is closed by DFSClient_attempt_1426266260362_0020_m_000002_0_174688487_1
2015-03-13 10:10:19,321 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/_temporary/attempt_1426266260362_0020_m_000004_0	dst=null	perm=null
2015-03-13 10:10:19,322 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/task_1426266260362_0020_m_000004	dst=null	perm=null
2015-03-13 10:10:19,325 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:10:19,325 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/_temporary/attempt_1426266260362_0020_m_000004_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/task_1426266260362_0020_m_000004	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:10:19,325 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/_temporary/attempt_1426266260362_0020_m_000002_0	dst=null	perm=null
2015-03-13 10:10:19,331 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/_temporary/attempt_1426266260362_0020_m_000002_0	dst=null	perm=null
2015-03-13 10:10:19,333 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:10:19,333 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/task_1426266260362_0020_m_000002	dst=null	perm=null
2015-03-13 10:10:19,337 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/_temporary/attempt_1426266260362_0020_m_000002_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/task_1426266260362_0020_m_000002	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:10:19,348 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0020_01_000006
2015-03-13 10:10:19,349 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0020	CONTAINERID=container_1426266260362_0020_01_000006
2015-03-13 10:10:19,349 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:10:19,349 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0020_01_000006
2015-03-13 10:10:19,349 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:10:19,353 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0020_01_000004
2015-03-13 10:10:19,353 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0020	CONTAINERID=container_1426266260362_0020_01_000004
2015-03-13 10:10:19,354 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:10:19,354 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0020_01_000004
2015-03-13 10:10:19,354 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:19,354 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:19,354 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:10:19,354 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:19,356 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/_temporary/attempt_1426266260362_0020_m_000001_0/part-00001. BP-1005356445-10.1.1.144-1426266257849 blk_1073742061_1237{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:10:19,363 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job_1426266260362_0020_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073742062_1238{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:10:19,366 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742062_1238 src: /127.0.0.1:62507 dest: /127.0.0.1:60689
2015-03-13 10:10:19,368 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0020_01_000004 is : 143
2015-03-13 10:10:19,368 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0020_01_000006 is : 143
2015-03-13 10:10:19,368 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742062_1238 src: /127.0.0.1:62508 dest: /127.0.0.1:60696
2015-03-13 10:10:19,370 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742062_1238 src: /127.0.0.1:62509 dest: /127.0.0.1:60693
2015-03-13 10:10:19,374 INFO  hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job_1426266260362_0020_1.jhist for DFSClient_NONMAPREDUCE_-2134179526_1
2015-03-13 10:10:19,380 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:10:19,381 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000004
2015-03-13 10:10:19,381 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000004
2015-03-13 10:10:19,382 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000004
2015-03-13 10:10:19,382 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000004
2015-03-13 10:10:19,383 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0020	CONTAINERID=container_1426266260362_0020_01_000004
2015-03-13 10:10:19,383 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:10:19,383 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0020_01_000004 from application application_1426266260362_0020
2015-03-13 10:10:19,383 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:19,384 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0020
2015-03-13 10:10:19,384 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:10:19,385 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000006
2015-03-13 10:10:19,385 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000006
2015-03-13 10:10:19,385 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000006
2015-03-13 10:10:19,385 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000006
2015-03-13 10:10:19,386 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0020	CONTAINERID=container_1426266260362_0020_01_000006
2015-03-13 10:10:19,386 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:10:19,387 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0020_01_000006 from application application_1426266260362_0020
2015-03-13 10:10:19,388 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:19,388 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0020
2015-03-13 10:10:19,395 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62506, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0020_m_000000_0_803283296_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 155000
2015-03-13 10:10:19,408 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62506, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0020_m_000000_0_803283296_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 180000
2015-03-13 10:10:19,413 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742060_1236
2015-03-13 10:10:19,416 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/_temporary/attempt_1426266260362_0020_m_000003_0/part-00003. BP-1005356445-10.1.1.144-1426266257849 blk_1073742063_1239{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:10:19,435 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/_temporary/attempt_1426266260362_0020_m_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073742064_1240{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:10:19,442 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742061_1237 src: /127.0.0.1:62510 dest: /127.0.0.1:60686
2015-03-13 10:10:19,444 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742061_1237 src: /127.0.0.1:62513 dest: /127.0.0.1:60689
2015-03-13 10:10:19,445 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742061_1237 src: /127.0.0.1:62514 dest: /127.0.0.1:60693
2015-03-13 10:10:19,464 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62514, dest: /127.0.0.1:60693, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0020_m_000001_0_-1228934246_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742061_1237, duration: 17468000
2015-03-13 10:10:19,465 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742061_1237, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:19,465 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742061_1237{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:19,465 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62513, dest: /127.0.0.1:60689, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0020_m_000001_0_-1228934246_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742061_1237, duration: 18186000
2015-03-13 10:10:19,465 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742061_1237, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:19,466 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742061_1237{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:19,466 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62510, dest: /127.0.0.1:60686, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0020_m_000001_0_-1228934246_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742061_1237, duration: 19047000
2015-03-13 10:10:19,466 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742061_1237, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:19,466 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742061_1237{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:19,481 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742064_1240 src: /127.0.0.1:62512 dest: /127.0.0.1:60689
2015-03-13 10:10:19,483 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742064_1240 src: /127.0.0.1:62515 dest: /127.0.0.1:60686
2015-03-13 10:10:19,484 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742064_1240 src: /127.0.0.1:62516 dest: /127.0.0.1:60693
2015-03-13 10:10:19,486 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742063_1239 src: /127.0.0.1:62511 dest: /127.0.0.1:60693
2015-03-13 10:10:19,488 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742063_1239 src: /127.0.0.1:62517 dest: /127.0.0.1:60689
2015-03-13 10:10:19,489 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742063_1239 src: /127.0.0.1:62518 dest: /127.0.0.1:60696
2015-03-13 10:10:19,494 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62516, dest: /127.0.0.1:60693, bytes: 24, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0020_m_000000_0_803283296_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742064_1240, duration: 8344000
2015-03-13 10:10:19,494 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742064_1240, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:19,494 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742064_1240{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:19,495 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62515, dest: /127.0.0.1:60686, bytes: 24, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0020_m_000000_0_803283296_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742064_1240, duration: 8948000
2015-03-13 10:10:19,495 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742064_1240, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:19,495 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742064_1240{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:19,495 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62512, dest: /127.0.0.1:60689, bytes: 24, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0020_m_000000_0_803283296_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742064_1240, duration: 9822000
2015-03-13 10:10:19,496 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742064_1240, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:19,496 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742064_1240{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:19,497 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62518, dest: /127.0.0.1:60696, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0020_m_000003_0_464453710_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742063_1239, duration: 6788000
2015-03-13 10:10:19,498 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742063_1239, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:19,498 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742063_1239{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:19,498 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62517, dest: /127.0.0.1:60689, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0020_m_000003_0_464453710_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742063_1239, duration: 7480000
2015-03-13 10:10:19,498 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742063_1239, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:19,499 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742063_1239{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:19,499 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62511, dest: /127.0.0.1:60693, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0020_m_000003_0_464453710_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742063_1239, duration: 8566000
2015-03-13 10:10:19,499 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742063_1239, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:19,500 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742063_1239{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:19,504 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/_temporary/attempt_1426266260362_0020_m_000001_0/part-00001 is closed by DFSClient_attempt_1426266260362_0020_m_000001_0_-1228934246_1
2015-03-13 10:10:19,513 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/_temporary/attempt_1426266260362_0020_m_000001_0	dst=null	perm=null
2015-03-13 10:10:19,519 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/_temporary/attempt_1426266260362_0020_m_000001_0	dst=null	perm=null
2015-03-13 10:10:19,520 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/task_1426266260362_0020_m_000001	dst=null	perm=null
2015-03-13 10:10:19,524 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/_temporary/attempt_1426266260362_0020_m_000001_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/task_1426266260362_0020_m_000001	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:10:19,532 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/_temporary/attempt_1426266260362_0020_m_000003_0/part-00003 is closed by DFSClient_attempt_1426266260362_0020_m_000003_0_464453710_1
2015-03-13 10:10:19,535 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0020_01_000003
2015-03-13 10:10:19,535 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0020	CONTAINERID=container_1426266260362_0020_01_000003
2015-03-13 10:10:19,535 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:19,535 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:19,536 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:10:19,536 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0020_01_000004
2015-03-13 10:10:19,536 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:19,536 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:10:19,536 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0020_01_000003
2015-03-13 10:10:19,536 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0020_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:10:19,536 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0020_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:10:19,537 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0020	CONTAINERID=container_1426266260362_0020_01_000004
2015-03-13 10:10:19,537 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0020_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:10:19,537 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:10:19,537 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0020_01_000004, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:19,537 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:19,537 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:10:19,537 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0020_000001 released container container_1426266260362_0020_01_000004 on node: host: 10.1.1.144:60711 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:10:19,549 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0020_01_000003 is : 143
2015-03-13 10:10:19,551 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/_temporary/attempt_1426266260362_0020_m_000003_0	dst=null	perm=null
2015-03-13 10:10:19,561 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:10:19,561 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000003
2015-03-13 10:10:19,561 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000003
2015-03-13 10:10:19,562 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000003
2015-03-13 10:10:19,562 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000003
2015-03-13 10:10:19,563 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0020	CONTAINERID=container_1426266260362_0020_01_000003
2015-03-13 10:10:19,563 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:10:19,563 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0020_01_000003 from application application_1426266260362_0020
2015-03-13 10:10:19,563 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:19,564 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0020
2015-03-13 10:10:19,579 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/_temporary/attempt_1426266260362_0020_m_000003_0	dst=null	perm=null
2015-03-13 10:10:19,580 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/task_1426266260362_0020_m_000003	dst=null	perm=null
2015-03-13 10:10:19,580 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/_temporary/attempt_1426266260362_0020_m_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0020_m_000000_0_803283296_1
2015-03-13 10:10:19,583 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/_temporary/attempt_1426266260362_0020_m_000003_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/task_1426266260362_0020_m_000003	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:10:19,589 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/_temporary/attempt_1426266260362_0020_m_000000_0	dst=null	perm=null
2015-03-13 10:10:19,592 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0020_01_000005
2015-03-13 10:10:19,593 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0020	CONTAINERID=container_1426266260362_0020_01_000005
2015-03-13 10:10:19,593 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:10:19,593 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0020_01_000005
2015-03-13 10:10:19,593 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:19,593 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:10:19,593 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0020_01_000003
2015-03-13 10:10:19,593 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:10:19,594 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0020_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:10:19,594 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0020_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:10:19,594 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0020	CONTAINERID=container_1426266260362_0020_01_000003
2015-03-13 10:10:19,594 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0020_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:10:19,594 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:10:19,594 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0020_01_000003, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:19,594 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:19,595 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:10:19,595 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0020_000001 released container container_1426266260362_0020_01_000003 on node: host: 10.1.1.144:60711 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:10:19,596 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/_temporary/attempt_1426266260362_0020_m_000000_0	dst=null	perm=null
2015-03-13 10:10:19,597 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/task_1426266260362_0020_m_000000	dst=null	perm=null
2015-03-13 10:10:19,604 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/_temporary/attempt_1426266260362_0020_m_000000_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/task_1426266260362_0020_m_000000	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:10:19,605 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0020_01_000005 is : 143
2015-03-13 10:10:19,617 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:10:19,617 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000005
2015-03-13 10:10:19,617 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000005
2015-03-13 10:10:19,618 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000005
2015-03-13 10:10:19,618 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000005
2015-03-13 10:10:19,618 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0020	CONTAINERID=container_1426266260362_0020_01_000005
2015-03-13 10:10:19,619 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:10:19,619 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0020_01_000005 from application application_1426266260362_0020
2015-03-13 10:10:19,619 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:19,619 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0020
2015-03-13 10:10:19,633 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0020_01_000002
2015-03-13 10:10:19,633 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0020	CONTAINERID=container_1426266260362_0020_01_000002
2015-03-13 10:10:19,633 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:10:19,634 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0020_01_000002
2015-03-13 10:10:19,634 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:10:19,634 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:10:19,634 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0020_01_000005
2015-03-13 10:10:19,634 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0020_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:10:19,635 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0020_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:10:19,635 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0020	CONTAINERID=container_1426266260362_0020_01_000005
2015-03-13 10:10:19,635 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0020_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:10:19,635 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:10:19,635 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0020_01_000005, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:19,635 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:19,635 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:10:19,635 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0020_000001 released container container_1426266260362_0020_01_000005 on node: host: 10.1.1.144:60711 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:10:19,638 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:19,640 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-2134179526_1
2015-03-13 10:10:19,644 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1	dst=null	perm=null
2015-03-13 10:10:19,646 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0020_01_000002 is : 143
2015-03-13 10:10:19,652 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost	dst=null	perm=null
2015-03-13 10:10:19,653 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost	dst=null	perm=null
2015-03-13 10:10:19,654 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/task_1426266260362_0020_m_000000	dst=null	perm=null
2015-03-13 10:10:19,656 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00000	dst=null	perm=null
2015-03-13 10:10:19,659 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/task_1426266260362_0020_m_000000/part-00000	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:19,661 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:10:19,662 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000002
2015-03-13 10:10:19,662 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000002
2015-03-13 10:10:19,663 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost	dst=null	perm=null
2015-03-13 10:10:19,663 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000002
2015-03-13 10:10:19,663 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000002
2015-03-13 10:10:19,664 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0020	CONTAINERID=container_1426266260362_0020_01_000002
2015-03-13 10:10:19,664 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:10:19,664 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost	dst=null	perm=null
2015-03-13 10:10:19,664 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0020_01_000002 from application application_1426266260362_0020
2015-03-13 10:10:19,664 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:19,664 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0020
2015-03-13 10:10:19,665 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/task_1426266260362_0020_m_000001	dst=null	perm=null
2015-03-13 10:10:19,666 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00001	dst=null	perm=null
2015-03-13 10:10:19,668 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/task_1426266260362_0020_m_000001/part-00001	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00001	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:19,669 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost	dst=null	perm=null
2015-03-13 10:10:19,670 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost	dst=null	perm=null
2015-03-13 10:10:19,671 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/task_1426266260362_0020_m_000002	dst=null	perm=null
2015-03-13 10:10:19,673 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00002	dst=null	perm=null
2015-03-13 10:10:19,675 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/task_1426266260362_0020_m_000002/part-00002	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00002	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:19,676 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost	dst=null	perm=null
2015-03-13 10:10:19,677 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost	dst=null	perm=null
2015-03-13 10:10:19,678 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/task_1426266260362_0020_m_000003	dst=null	perm=null
2015-03-13 10:10:19,679 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00003	dst=null	perm=null
2015-03-13 10:10:19,681 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/task_1426266260362_0020_m_000003/part-00003	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00003	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:19,682 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost	dst=null	perm=null
2015-03-13 10:10:19,682 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost	dst=null	perm=null
2015-03-13 10:10:19,683 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/task_1426266260362_0020_m_000004	dst=null	perm=null
2015-03-13 10:10:19,684 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00004	dst=null	perm=null
2015-03-13 10:10:19,685 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/task_1426266260362_0020_m_000004/part-00004	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00004	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:19,688 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary	dst=null	perm=null
2015-03-13 10:10:19,691 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:19,694 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-2134179526_1
2015-03-13 10:10:19,696 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:19,697 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-2134179526_1
2015-03-13 10:10:19,711 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62509, dest: /127.0.0.1:60693, bytes: 53330, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2134179526_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742062_1238, duration: 339542000
2015-03-13 10:10:19,711 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742062_1238, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:19,712 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742062_1238{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:19,712 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62508, dest: /127.0.0.1:60696, bytes: 53330, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2134179526_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742062_1238, duration: 340528000
2015-03-13 10:10:19,713 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742062_1238, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:19,713 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742062_1238{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:19,714 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62507, dest: /127.0.0.1:60689, bytes: 53330, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2134179526_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742062_1238, duration: 342180000
2015-03-13 10:10:19,714 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742062_1238, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:19,714 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742062_1238{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:19,716 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job_1426266260362_0020_1.jhist is closed by DFSClient_NONMAPREDUCE_-2134179526_1
2015-03-13 10:10:19,718 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0020.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:19,720 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0020.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742065_1241{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:10:19,722 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742065_1241 src: /127.0.0.1:62519 dest: /127.0.0.1:60696
2015-03-13 10:10:19,724 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742065_1241 src: /127.0.0.1:62520 dest: /127.0.0.1:60689
2015-03-13 10:10:19,725 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742065_1241 src: /127.0.0.1:62521 dest: /127.0.0.1:60686
2015-03-13 10:10:19,728 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62521, dest: /127.0.0.1:60686, bytes: 448, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2134179526_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742065_1241, duration: 1297000
2015-03-13 10:10:19,728 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742065_1241, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:19,729 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742065_1241{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:10:19,729 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62520, dest: /127.0.0.1:60689, bytes: 448, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2134179526_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742065_1241, duration: 1690000
2015-03-13 10:10:19,729 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742065_1241, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:19,729 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742065_1241{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:10:19,730 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62519, dest: /127.0.0.1:60696, bytes: 448, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2134179526_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742065_1241, duration: 2450000
2015-03-13 10:10:19,730 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742065_1241, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:19,730 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742065_1241{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:10:19,732 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0020.summary_tmp is closed by DFSClient_NONMAPREDUCE_-2134179526_1
2015-03-13 10:10:19,736 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0020.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:19,740 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job_1426266260362_0020_1.jhist	dst=null	perm=null
2015-03-13 10:10:19,741 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0020-1426266604533-soberoi-%5BE6523EE1541F4C2199F3EC42AB5499B5%2F0A2AB8927DF243BD-1426266619698-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:10:19,745 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job_1426266260362_0020_1.jhist	dst=null	perm=null
2015-03-13 10:10:19,746 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0020-1426266604533-soberoi-%5BE6523EE1541F4C2199F3EC42AB5499B5%2F0A2AB8927DF243BD-1426266619698-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:10:19,747 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job_1426266260362_0020_1.jhist	dst=null	perm=null
2015-03-13 10:10:19,749 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0020-1426266604533-soberoi-%5BE6523EE1541F4C2199F3EC42AB5499B5%2F0A2AB8927DF243BD-1426266619698-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:19,751 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62522, bytes: 53750, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-2134179526_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742062_1238, duration: 190000
2015-03-13 10:10:19,753 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0020-1426266604533-soberoi-%5BE6523EE1541F4C2199F3EC42AB5499B5%2F0A2AB8927DF243BD-1426266619698-5-0-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742066_1242{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:10:19,755 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742066_1242 src: /127.0.0.1:62523 dest: /127.0.0.1:60693
2015-03-13 10:10:19,757 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742066_1242 src: /127.0.0.1:62524 dest: /127.0.0.1:60696
2015-03-13 10:10:19,758 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742066_1242 src: /127.0.0.1:62525 dest: /127.0.0.1:60686
2015-03-13 10:10:19,761 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62525, dest: /127.0.0.1:60686, bytes: 53330, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2134179526_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742066_1242, duration: 1760000
2015-03-13 10:10:19,762 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742066_1242, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:19,762 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742066_1242{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:10:19,762 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62524, dest: /127.0.0.1:60696, bytes: 53330, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2134179526_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742066_1242, duration: 2446000
2015-03-13 10:10:19,762 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742066_1242, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:19,763 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742066_1242{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:10:19,763 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62523, dest: /127.0.0.1:60693, bytes: 53330, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2134179526_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742066_1242, duration: 3177000
2015-03-13 10:10:19,763 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742066_1242, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:19,764 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742066_1242{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:10:19,765 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0020-1426266604533-soberoi-%5BE6523EE1541F4C2199F3EC42AB5499B5%2F0A2AB8927DF243BD-1426266619698-5-0-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-2134179526_1
2015-03-13 10:10:19,767 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0020-1426266604533-soberoi-%5BE6523EE1541F4C2199F3EC42AB5499B5%2F0A2AB8927DF243BD-1426266619698-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:19,768 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job_1426266260362_0020_1_conf.xml	dst=null	perm=null
2015-03-13 10:10:19,769 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0020_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:10:19,770 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job_1426266260362_0020_1_conf.xml	dst=null	perm=null
2015-03-13 10:10:19,771 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0020_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:10:19,772 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job_1426266260362_0020_1_conf.xml	dst=null	perm=null
2015-03-13 10:10:19,775 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0020_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:19,777 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62522, bytes: 91691, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-2134179526_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742059_1235, duration: 258000
2015-03-13 10:10:19,779 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0020_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742067_1243{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:10:19,781 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742067_1243 src: /127.0.0.1:62526 dest: /127.0.0.1:60696
2015-03-13 10:10:19,782 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742067_1243 src: /127.0.0.1:62527 dest: /127.0.0.1:60686
2015-03-13 10:10:19,783 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742067_1243 src: /127.0.0.1:62528 dest: /127.0.0.1:60693
2015-03-13 10:10:19,787 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62528, dest: /127.0.0.1:60693, bytes: 90979, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2134179526_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742067_1243, duration: 2191000
2015-03-13 10:10:19,787 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742067_1243, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:19,787 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742067_1243{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:19,787 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62527, dest: /127.0.0.1:60686, bytes: 90979, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2134179526_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742067_1243, duration: 2895000
2015-03-13 10:10:19,788 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742067_1243, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:19,788 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742067_1243{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:19,788 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62526, dest: /127.0.0.1:60696, bytes: 90979, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2134179526_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742067_1243, duration: 3616000
2015-03-13 10:10:19,789 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742067_1243, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:19,789 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742067_1243{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:19,790 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0020_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-2134179526_1
2015-03-13 10:10:19,792 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0020_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:19,793 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0020.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0020.summary	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:19,795 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0020_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0020_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:19,797 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0020-1426266604533-soberoi-%5BE6523EE1541F4C2199F3EC42AB5499B5%2F0A2AB8927DF243BD-1426266619698-5-0-SUCCEEDED-default.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0020-1426266604533-soberoi-%5BE6523EE1541F4C2199F3EC42AB5499B5%2F0A2AB8927DF243BD-1426266619698-5-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:19,804 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0020_000001 State change from RUNNING to FINISHING
2015-03-13 10:10:19,804 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0020
2015-03-13 10:10:19,804 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0020 State change from RUNNING to REMOVING
2015-03-13 10:10:19,804 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0020
2015-03-13 10:10:19,805 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0020 State change from REMOVING to FINISHING
2015-03-13 10:10:20,027 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:20,353 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:10:20,353 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0020_01_000006
2015-03-13 10:10:20,354 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0020_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:10:20,354 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0020_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:10:20,354 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0020	CONTAINERID=container_1426266260362_0020_01_000006
2015-03-13 10:10:20,354 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0020_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:10:20,354 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:10:20,355 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0020_01_000006, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:20,355 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:20,355 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:10:20,355 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0020_000001 released container container_1426266260362_0020_01_000006 on node: host: 10.1.1.144:60723 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:10:20,640 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:10:20,640 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0020_01_000002
2015-03-13 10:10:20,641 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0020_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:10:20,641 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0020_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:10:20,641 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0020	CONTAINERID=container_1426266260362_0020_01_000002
2015-03-13 10:10:20,641 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0020_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:10:20,641 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:10:20,642 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0020_01_000002, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:20,642 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:20,642 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:10:20,642 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0020_000001 released container container_1426266260362_0020_01_000002 on node: host: 10.1.1.144:60711 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:10:20,814 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742055_1231 127.0.0.1:60693 127.0.0.1:60689 127.0.0.1:60686 127.0.0.1:60696 
2015-03-13 10:10:20,814 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742056_1232 127.0.0.1:60689 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60693 
2015-03-13 10:10:20,814 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742057_1233 127.0.0.1:60689 127.0.0.1:60693 127.0.0.1:60686 
2015-03-13 10:10:20,814 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742058_1234 127.0.0.1:60689 127.0.0.1:60693 127.0.0.1:60696 
2015-03-13 10:10:20,815 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742062_1238 127.0.0.1:60689 127.0.0.1:60696 127.0.0.1:60693 
2015-03-13 10:10:20,815 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742059_1235 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60696 
2015-03-13 10:10:20,815 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020	dst=null	perm=null
2015-03-13 10:10:20,856 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost	dst=null	perm=null
2015-03-13 10:10:20,857 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary
2015-03-13 10:10:20,857 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary	dst=null	perm=null
2015-03-13 10:10:20,864 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:10:20,865 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:10:20,866 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:10:20,867 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost	dst=null	perm=null
2015-03-13 10:10:20,867 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost	dst=null	perm=null
2015-03-13 10:10:20,868 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost	dst=null	perm=null
2015-03-13 10:10:20,869 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:10:20,870 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00000	dst=null	perm=null
2015-03-13 10:10:20,872 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62530, bytes: 28, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742064_1240, duration: 189000
2015-03-13 10:10:20,873 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00001	dst=null	perm=null
2015-03-13 10:10:20,874 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62531, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742061_1237, duration: 166000
2015-03-13 10:10:20,875 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00002	dst=null	perm=null
2015-03-13 10:10:20,876 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62531, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742060_1236, duration: 156000
2015-03-13 10:10:20,877 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00003	dst=null	perm=null
2015-03-13 10:10:20,879 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62532, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742063_1239, duration: 184000
2015-03-13 10:10:20,879 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00004	dst=null	perm=null
2015-03-13 10:10:20,886 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:10:20,887 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:10:20,887 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:10:20,888 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost	dst=null	perm=null
2015-03-13 10:10:20,888 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost	dst=null	perm=null
2015-03-13 10:10:20,889 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost	dst=null	perm=null
2015-03-13 10:10:20,890 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:10:20,891 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00000	dst=null	perm=null
2015-03-13 10:10:20,892 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62531, bytes: 28, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742064_1240, duration: 167000
2015-03-13 10:10:20,892 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00001	dst=null	perm=null
2015-03-13 10:10:20,893 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62531, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742061_1237, duration: 156000
2015-03-13 10:10:20,894 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00002	dst=null	perm=null
2015-03-13 10:10:20,895 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62530, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742060_1236, duration: 142000
2015-03-13 10:10:20,896 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00003	dst=null	perm=null
2015-03-13 10:10:20,897 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62533, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742063_1239, duration: 166000
2015-03-13 10:10:20,898 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00004	dst=null	perm=null
2015-03-13 10:10:20,898 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost
2015-03-13 10:10:20,899 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost	dst=null	perm=null
2015-03-13 10:10:20,899 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost	dst=null	perm=null
2015-03-13 10:10:20,900 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost	dst=null	perm=null
2015-03-13 10:10:20,900 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost	dst=null	perm=null
2015-03-13 10:10:20,901 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00000	dst=null	perm=null
2015-03-13 10:10:20,902 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00000	dst=null	perm=null
2015-03-13 10:10:20,903 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62531, bytes: 28, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742064_1240, duration: 113000
2015-03-13 10:10:20,904 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00001	dst=null	perm=null
2015-03-13 10:10:20,904 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00001	dst=null	perm=null
2015-03-13 10:10:20,905 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62530, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742061_1237, duration: 114000
2015-03-13 10:10:20,906 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00002	dst=null	perm=null
2015-03-13 10:10:20,907 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00002	dst=null	perm=null
2015-03-13 10:10:20,908 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62532, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742060_1236, duration: 170000
2015-03-13 10:10:20,908 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00003	dst=null	perm=null
2015-03-13 10:10:20,909 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00003	dst=null	perm=null
2015-03-13 10:10:20,910 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62532, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742063_1239, duration: 166000
2015-03-13 10:10:20,911 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00004	dst=null	perm=null
2015-03-13 10:10:20,911 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00004	dst=null	perm=null
2015-03-13 10:10:20,913 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:10:20,914 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:10:20,924 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:10:20,925 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:10:20,925 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:10:20,933 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone	dst=null	perm=null
2015-03-13 10:10:20,934 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting
2015-03-13 10:10:20,934 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt"]
2015-03-13 10:10:20,935 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-03-13 10:10:20,935 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone"]
2015-03-13 10:10:20,935 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  parallel execution is enabled: true
2015-03-13 10:10:20,935 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  starting jobs: 1
2015-03-13 10:10:20,935 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  allocating threads: 1
2015-03-13 10:10:20,936 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (1/1) ...dedpipesplatform/joinnone
2015-03-13 10:10:20,942 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:10:20,949 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:10:20,951 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone	dst=null	perm=null
2015-03-13 10:10:20,951 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:10:20,952 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:10:20,954 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 21
2015-03-13 10:10:20,955 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021	dst=null	perm=null
2015-03-13 10:10:20,956 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021	dst=null	perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:10:20,956 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021	dst=null	perm=soberoi:supergroup:rwx------
2015-03-13 10:10:20,957 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.jar	dst=null	perm=null
2015-03-13 10:10:20,958 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:20,960 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073742068_1244{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:10:20,962 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742068_1244 src: /127.0.0.1:62535 dest: /127.0.0.1:60693
2015-03-13 10:10:20,963 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742068_1244 src: /127.0.0.1:62536 dest: /127.0.0.1:60696
2015-03-13 10:10:20,964 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742068_1244 src: /127.0.0.1:62537 dest: /127.0.0.1:60686
2015-03-13 10:10:20,968 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62537, dest: /127.0.0.1:60686, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742068_1244, duration: 1936000
2015-03-13 10:10:20,968 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742068_1244, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:20,968 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742068_1244{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:10:20,968 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62536, dest: /127.0.0.1:60696, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742068_1244, duration: 2586000
2015-03-13 10:10:20,968 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742068_1244, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:20,969 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742068_1244{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:10:20,969 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62535, dest: /127.0.0.1:60693, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742068_1244, duration: 3599000
2015-03-13 10:10:20,969 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742068_1244, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:20,970 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742068_1244{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:10:20,971 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:10:20,972 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.jar
2015-03-13 10:10:20,972 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.jar	dst=null	perm=null
2015-03-13 10:10:20,973 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:20,974 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:10:20,975 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:10:20,976 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:10:20,977 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:10:20,978 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:10:20,978 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:10:20,979 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:10:20,979 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:10:20,980 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:10:20,981 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:10:20,981 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:10:20,982 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:10:20,984 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:20,985 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:20,986 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.split
2015-03-13 10:10:20,986 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.split	dst=null	perm=null
2015-03-13 10:10:20,987 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073742069_1245{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:10:20,988 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742069_1245 src: /127.0.0.1:62538 dest: /127.0.0.1:60696
2015-03-13 10:10:20,989 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742069_1245 src: /127.0.0.1:62539 dest: /127.0.0.1:60689
2015-03-13 10:10:20,990 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742069_1245 src: /127.0.0.1:62540 dest: /127.0.0.1:60693
2015-03-13 10:10:20,992 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742069_1245 src: /127.0.0.1:62541 dest: /127.0.0.1:60686
2015-03-13 10:10:20,995 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62541, dest: /127.0.0.1:60686, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742069_1245, duration: 1590000
2015-03-13 10:10:20,995 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742069_1245, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:20,995 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742069_1245{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:10:20,995 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62540, dest: /127.0.0.1:60693, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742069_1245, duration: 1799000
2015-03-13 10:10:20,996 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742069_1245, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:20,996 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742069_1245{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:10:20,996 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62539, dest: /127.0.0.1:60689, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742069_1245, duration: 2762000
2015-03-13 10:10:20,996 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742069_1245, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:20,997 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742069_1245{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:10:20,997 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62538, dest: /127.0.0.1:60696, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742069_1245, duration: 3731000
2015-03-13 10:10:20,997 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742069_1245, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:20,998 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742069_1245{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:10:20,999 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:10:21,000 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:21,001 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:21,002 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073742070_1246{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:10:21,004 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742070_1246 src: /127.0.0.1:62542 dest: /127.0.0.1:60686
2015-03-13 10:10:21,005 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742070_1246 src: /127.0.0.1:62543 dest: /127.0.0.1:60693
2015-03-13 10:10:21,007 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742070_1246 src: /127.0.0.1:62544 dest: /127.0.0.1:60696
2015-03-13 10:10:21,009 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62544, dest: /127.0.0.1:60696, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742070_1246, duration: 1135000
2015-03-13 10:10:21,009 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742070_1246, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:21,010 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742070_1246{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:21,010 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62543, dest: /127.0.0.1:60693, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742070_1246, duration: 1754000
2015-03-13 10:10:21,010 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742070_1246, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:21,011 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62542, dest: /127.0.0.1:60686, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742070_1246, duration: 2736000
2015-03-13 10:10:21,011 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742070_1246, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:21,011 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742070_1246{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:21,015 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742070_1246{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:21,016 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:10:21,016 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:10:21,017 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:21,019 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:21,020 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:10:21,020 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:10:21,021 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:10:21,025 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742071_1247{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:10:21,027 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742071_1247 src: /127.0.0.1:62545 dest: /127.0.0.1:60689
2015-03-13 10:10:21,028 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:21,028 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742071_1247 src: /127.0.0.1:62546 dest: /127.0.0.1:60693
2015-03-13 10:10:21,030 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742071_1247 src: /127.0.0.1:62547 dest: /127.0.0.1:60686
2015-03-13 10:10:21,032 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62547, dest: /127.0.0.1:60686, bytes: 97640, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742071_1247, duration: 1534000
2015-03-13 10:10:21,033 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742071_1247, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:21,033 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742071_1247{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:10:21,033 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62546, dest: /127.0.0.1:60693, bytes: 97640, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742071_1247, duration: 1964000
2015-03-13 10:10:21,033 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742071_1247, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:21,034 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742071_1247{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:10:21,034 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62545, dest: /127.0.0.1:60689, bytes: 97640, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742071_1247, duration: 2831000
2015-03-13 10:10:21,034 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742071_1247, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:21,035 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742071_1247{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:10:21,036 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:10:21,036 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0021
2015-03-13 10:10:21,037 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021	dst=null	perm=null
2015-03-13 10:10:21,037 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.xml	dst=null	perm=null
2015-03-13 10:10:21,038 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.xml	dst=null	perm=null
2015-03-13 10:10:21,038 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.jar	dst=null	perm=null
2015-03-13 10:10:21,039 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.jar	dst=null	perm=null
2015-03-13 10:10:21,039 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.split	dst=null	perm=null
2015-03-13 10:10:21,040 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.split	dst=null	perm=null
2015-03-13 10:10:21,040 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:10:21,041 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:10:21,042 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:10:21,043 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:10:21,043 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:10:21,044 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:10:21,045 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:10:21,045 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:10:21,046 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 21 submitted by user soberoi
2015-03-13 10:10:21,046 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0021
2015-03-13 10:10:21,046 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	IP=10.1.1.144	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1426266260362_0021
2015-03-13 10:10:21,046 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0021
2015-03-13 10:10:21,046 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0021 State change from NEW to NEW_SAVING
2015-03-13 10:10:21,047 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0021 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:10:21,047 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0021_000001
2015-03-13 10:10:21,047 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0021_000001 State change from NEW to SUBMITTED
2015-03-13 10:10:21,047 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0021 from user: soberoi activated in queue: default
2015-03-13 10:10:21,047 INFO  capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0021 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:10:21,047 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0021 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:10:21,047 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0021 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:10:21,047 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0021_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:10:21,048 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0021_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:10:21,048 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0021 State change from SUBMITTED to ACCEPTED
2015-03-13 10:10:21,050 INFO  mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0021/
2015-03-13 10:10:21,050 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1426266260362_0021
2015-03-13 10:10:21,050 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0021/
2015-03-13 10:10:21,357 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0021_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:10:21,358 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0021	CONTAINERID=container_1426266260362_0021_01_000001
2015-03-13 10:10:21,358 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0021_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:10:21,358 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0021 container=Container: [ContainerId: container_1426266260362_0021_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0021_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:21,358 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:10:21,358 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0021_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:10:21,358 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:21,359 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0021 AttemptId: appattempt_1426266260362_0021_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0021_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ]
2015-03-13 10:10:21,360 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0021_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:10:21,360 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0021_000001
2015-03-13 10:10:21,360 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0021_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:10:21,360 INFO  amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0021_000001
2015-03-13 10:10:21,361 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0021_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] for AM appattempt_1426266260362_0021_000001
2015-03-13 10:10:21,361 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0021_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-03-13 10:10:21,363 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0021_000001 (auth:SIMPLE)
2015-03-13 10:10:21,364 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0021_01_000001 by user soberoi
2015-03-13 10:10:21,364 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0021
2015-03-13 10:10:21,365 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0021	CONTAINERID=container_1426266260362_0021_01_000001
2015-03-13 10:10:21,365 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0021 transitioned from NEW to INITING
2015-03-13 10:10:21,365 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0021_01_000001 to application application_1426266260362_0021
2015-03-13 10:10:21,365 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0021 transitioned from INITING to RUNNING
2015-03-13 10:10:21,365 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0021_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] for AM appattempt_1426266260362_0021_000001
2015-03-13 10:10:21,365 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0021_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:10:21,365 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:10:21,365 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0021
2015-03-13 10:10:21,366 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:10:21,366 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:10:21,366 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:10:21,366 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:10:21,366 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0021_01_000001
2015-03-13 10:10:21,376 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1426266260362_0021_01_000001.tokens. Credentials list: 
2015-03-13 10:10:21,391 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:10:21,470 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1426266260362_0021_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000001.tokens
2015-03-13 10:10:21,471 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0021 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0021
2015-03-13 10:10:21,529 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.jar	dst=null	perm=null
2015-03-13 10:10:21,530 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.jar	dst=null	perm=null
2015-03-13 10:10:21,530 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.jar	dst=null	perm=null
2015-03-13 10:10:21,536 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62533, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1557208892_11054, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742068_1244, duration: 509000
2015-03-13 10:10:21,554 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:21,571 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:10:21,571 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:10:21,572 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:10:21,579 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62531, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1557208892_11054, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742070_1246, duration: 155000
2015-03-13 10:10:21,591 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:21,608 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.split	dst=null	perm=null
2015-03-13 10:10:21,609 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.split	dst=null	perm=null
2015-03-13 10:10:21,610 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.split	dst=null	perm=null
2015-03-13 10:10:21,616 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62533, bytes: 1798, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1557208892_11054, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742069_1245, duration: 170000
2015-03-13 10:10:21,628 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:21,645 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.xml	dst=null	perm=null
2015-03-13 10:10:21,645 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.xml	dst=null	perm=null
2015-03-13 10:10:21,646 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.xml	dst=null	perm=null
2015-03-13 10:10:21,652 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62533, bytes: 98404, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1557208892_11054, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742071_1247, duration: 330000
2015-03-13 10:10:21,665 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:21,665 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:10:21,693 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:10:21,693 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:21,770 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000001/default_container_executor.sh]
2015-03-13 10:10:21,948 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60686 to replicate blk_1073742068_1244 to datanode(s) 127.0.0.1:60689
2015-03-13 10:10:21,948 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073742055_1231, blk_1073742056_1232, blk_1073742058_1234, blk_1073742059_1235, blk_1073742062_1238]
2015-03-13 10:10:21,948 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073742055_1231, blk_1073742056_1232, blk_1073742057_1233, blk_1073742058_1234, blk_1073742062_1238]
2015-03-13 10:10:22,034 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:22,357 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:22,358 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0021_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:10:22,554 INFO  datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-1907321454-10.1.1.144-60686-1426266259166, infoPort=60687, ipcPort=60688, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073742068_1244 to 127.0.0.1:60689 
2015-03-13 10:10:22,556 INFO  datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073742068_1244 (numBytes=254067) to /127.0.0.1:60689
2015-03-13 10:10:22,556 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742068_1244 src: /127.0.0.1:62551 dest: /127.0.0.1:60689
2015-03-13 10:10:22,558 INFO  datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073742068_1244 src: /127.0.0.1:62551 dest: /127.0.0.1:60689 of size 254067
2015-03-13 10:10:22,559 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742068_1244 size 254067
2015-03-13 10:10:22,750 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742055_1231 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742055 for deletion
2015-03-13 10:10:22,750 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742056_1232 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742056 for deletion
2015-03-13 10:10:22,750 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742057_1233 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742057 for deletion
2015-03-13 10:10:22,750 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742058_1234 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742058 for deletion
2015-03-13 10:10:22,750 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742062_1238 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742062 for deletion
2015-03-13 10:10:22,751 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742055_1231 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742055
2015-03-13 10:10:22,751 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742057_1233 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742057
2015-03-13 10:10:22,751 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742056_1232 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742056
2015-03-13 10:10:22,751 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742062_1238 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742062
2015-03-13 10:10:22,752 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742058_1234 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742058
2015-03-13 10:10:22,927 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742055_1231 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742055 for deletion
2015-03-13 10:10:22,927 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742056_1232 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742056 for deletion
2015-03-13 10:10:22,927 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742058_1234 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742058 for deletion
2015-03-13 10:10:22,927 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742059_1235 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742059 for deletion
2015-03-13 10:10:22,928 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742062_1238 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742062 for deletion
2015-03-13 10:10:22,928 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742055_1231 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742055
2015-03-13 10:10:22,928 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742056_1232 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742056
2015-03-13 10:10:22,929 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742058_1234 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742058
2015-03-13 10:10:22,929 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742059_1235 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742059
2015-03-13 10:10:22,929 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742062_1238 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742062
2015-03-13 10:10:23,039 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:23,317 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:10:23,338 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/COMMIT_STARTED	dst=null	perm=null
2015-03-13 10:10:23,339 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/COMMIT_SUCCESS	dst=null	perm=null
2015-03-13 10:10:23,340 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/COMMIT_FAIL	dst=null	perm=null
2015-03-13 10:10:23,362 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:23,392 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021	dst=null	perm=null
2015-03-13 10:10:23,394 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:10:23,395 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:10:23,457 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742063_1239
2015-03-13 10:10:23,458 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742071_1247
2015-03-13 10:10:23,459 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742067_1243
2015-03-13 10:10:23,459 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742064_1240
2015-03-13 10:10:23,460 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742066_1242
2015-03-13 10:10:23,460 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742069_1245
2015-03-13 10:10:23,460 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742061_1237
2015-03-13 10:10:23,661 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742071_1247
2015-03-13 10:10:23,661 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742065_1241
2015-03-13 10:10:23,662 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742060_1236
2015-03-13 10:10:23,662 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742069_1245
2015-03-13 10:10:23,662 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742063_1239
2015-03-13 10:10:23,664 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742068_1244
2015-03-13 10:10:23,682 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:10:23,689 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:10:23,744 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62553, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-2029422546_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742070_1246, duration: 126000
2015-03-13 10:10:23,859 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742068_1244
2015-03-13 10:10:23,859 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742070_1246
2015-03-13 10:10:23,864 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742062_1238
2015-03-13 10:10:23,864 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742064_1240
2015-03-13 10:10:23,864 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742061_1237
2015-03-13 10:10:24,015 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742060_1236
2015-03-13 10:10:24,017 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742068_1244
2015-03-13 10:10:24,017 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742070_1246
2015-03-13 10:10:24,018 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742064_1240
2015-03-13 10:10:24,018 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742069_1245
2015-03-13 10:10:24,018 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742061_1237
2015-03-13 10:10:24,042 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:24,221 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742071_1247
2015-03-13 10:10:24,222 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742065_1241
2015-03-13 10:10:24,222 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742067_1243
2015-03-13 10:10:24,363 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:24,417 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742066_1242
2015-03-13 10:10:24,504 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0021_000001 (auth:SIMPLE)
2015-03-13 10:10:24,506 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0021_000001
2015-03-13 10:10:24,506 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi	IP=10.1.1.144	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1426266260362_0021	APPATTEMPTID=appattempt_1426266260362_0021_000001
2015-03-13 10:10:24,506 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0021_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:10:24,506 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0021 State change from ACCEPTED to RUNNING
2015-03-13 10:10:24,529 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:10:24,529 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job_1426266260362_0021_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:24,600 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job_1426266260362_0021_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:24,617 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742068_1244
2015-03-13 10:10:24,618 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742063_1239
2015-03-13 10:10:24,619 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742067_1243
2015-03-13 10:10:24,619 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742069_1245
2015-03-13 10:10:24,619 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742070_1246
2015-03-13 10:10:24,619 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742065_1241
2015-03-13 10:10:24,620 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742066_1242
2015-03-13 10:10:24,715 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job_1426266260362_0021_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742072_1248{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:10:24,751 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742072_1248 src: /127.0.0.1:62559 dest: /127.0.0.1:60686
2015-03-13 10:10:24,752 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742072_1248 src: /127.0.0.1:62560 dest: /127.0.0.1:60693
2015-03-13 10:10:24,753 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742072_1248 src: /127.0.0.1:62561 dest: /127.0.0.1:60689
2015-03-13 10:10:24,761 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62561, dest: /127.0.0.1:60689, bytes: 90452, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2029422546_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742072_1248, duration: 6140000
2015-03-13 10:10:24,761 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742072_1248, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:24,762 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742072_1248{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:24,762 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62560, dest: /127.0.0.1:60693, bytes: 90452, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2029422546_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742072_1248, duration: 6704000
2015-03-13 10:10:24,762 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742072_1248, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:24,763 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742072_1248{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:24,763 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62559, dest: /127.0.0.1:60686, bytes: 90452, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2029422546_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742072_1248, duration: 7656000
2015-03-13 10:10:24,763 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742072_1248{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:24,763 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742072_1248, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:24,767 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job_1426266260362_0021_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-2029422546_1
2015-03-13 10:10:24,953 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073742055_1231, blk_1073742056_1232, blk_1073742057_1233, blk_1073742059_1235]
2015-03-13 10:10:24,953 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073742055_1231, blk_1073742056_1232, blk_1073742057_1233, blk_1073742058_1234, blk_1073742059_1235, blk_1073742062_1238]
2015-03-13 10:10:25,047 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:25,368 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:25,554 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742055_1231 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742055 for deletion
2015-03-13 10:10:25,555 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742056_1232 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742056 for deletion
2015-03-13 10:10:25,555 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742057_1233 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742057 for deletion
2015-03-13 10:10:25,555 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742055_1231 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742055
2015-03-13 10:10:25,555 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742056_1232 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742056
2015-03-13 10:10:25,555 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742058_1234 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742058 for deletion
2015-03-13 10:10:25,555 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742057_1233 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742057
2015-03-13 10:10:25,556 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742059_1235 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742059 for deletion
2015-03-13 10:10:25,556 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742062_1238 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742062 for deletion
2015-03-13 10:10:25,556 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742058_1234 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742058
2015-03-13 10:10:25,556 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742059_1235 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742059
2015-03-13 10:10:25,557 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742062_1238 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742062
2015-03-13 10:10:25,557 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742055_1231 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742055 for deletion
2015-03-13 10:10:25,557 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742056_1232 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742056 for deletion
2015-03-13 10:10:25,558 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742055_1231 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742055
2015-03-13 10:10:25,558 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742057_1233 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742057 for deletion
2015-03-13 10:10:25,558 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742059_1235 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742059 for deletion
2015-03-13 10:10:25,558 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742056_1232 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742056
2015-03-13 10:10:25,558 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742057_1233 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742057
2015-03-13 10:10:25,558 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742059_1235 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742059
2015-03-13 10:10:25,654 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0021_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:10:25,655 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0021	CONTAINERID=container_1426266260362_0021_01_000002
2015-03-13 10:10:25,655 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0021_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:10:25,655 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0021 container=Container: [ContainerId: container_1426266260362_0021_01_000002, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0021_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:25,655 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:10:25,655 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:25,656 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0021_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:10:25,656 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0021	CONTAINERID=container_1426266260362_0021_01_000003
2015-03-13 10:10:25,656 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0021_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:10:25,656 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0021 container=Container: [ContainerId: container_1426266260362_0021_01_000003, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0021_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:25,657 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:10:25,657 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:25,657 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0021_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:10:25,657 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0021	CONTAINERID=container_1426266260362_0021_01_000004
2015-03-13 10:10:25,657 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0021_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:10:25,657 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0021 container=Container: [ContainerId: container_1426266260362_0021_01_000004, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0021_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:25,657 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:10:25,658 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:25,658 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0021_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:10:25,658 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0021	CONTAINERID=container_1426266260362_0021_01_000005
2015-03-13 10:10:25,658 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0021_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:10:25,658 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0021 container=Container: [ContainerId: container_1426266260362_0021_01_000005, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0021_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:25,658 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:10:25,658 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:25,949 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0020_01_000001 succeeded 
2015-03-13 10:10:25,949 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:10:25,949 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0020_01_000001
2015-03-13 10:10:25,957 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000001
2015-03-13 10:10:25,957 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000001
2015-03-13 10:10:25,957 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000001
2015-03-13 10:10:25,957 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0020	CONTAINERID=container_1426266260362_0020_01_000001
2015-03-13 10:10:25,958 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:10:25,958 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0020_01_000001 from application application_1426266260362_0020
2015-03-13 10:10:25,958 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:25,959 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0020
2015-03-13 10:10:25,957 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000001
2015-03-13 10:10:26,049 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:10:26,049 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0020_01_000001
2015-03-13 10:10:26,050 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0020_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:10:26,050 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0020_000001
2015-03-13 10:10:26,050 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0020_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:10:26,050 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0020	CONTAINERID=container_1426266260362_0020_01_000001
2015-03-13 10:10:26,050 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0020_000001 State change from FINISHING to FINISHED
2015-03-13 10:10:26,051 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0020_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60715, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:10:26,051 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0020 State change from FINISHING to FINISHED
2015-03-13 10:10:26,051 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:10:26,051 INFO  amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0020_000001
2015-03-13 10:10:26,051 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0020_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:26,051 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1426266260362_0020
2015-03-13 10:10:26,051 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:26,052 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0020,name=[E6523EE1541F4C2199F3EC42AB5499B5/0A2AB8927DF243BD907C69BD6B859EF6] lower*upper1*upper2/(1/1) ...m/joinaroundjoinrightmost,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0020/jobhistory/job/job_1426266260362_0020,appMasterHost=Edinburgh.local,startTime=1426266604533,finishTime=1426266619805,finalStatus=SUCCEEDED
2015-03-13 10:10:26,052 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=5
2015-03-13 10:10:26,052 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0020_000001 released container container_1426266260362_0020_01_000001 on node: host: 10.1.1.144:60715 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:10:26,053 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0021_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:10:26,053 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0021	CONTAINERID=container_1426266260362_0021_01_000006
2015-03-13 10:10:26,053 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0021_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:10:26,053 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0021 container=Container: [ContainerId: container_1426266260362_0021_01_000006, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0021_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:26,053 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6
2015-03-13 10:10:26,053 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:26,053 INFO  capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0020_000001 is done. finalState=FINISHED
2015-03-13 10:10:26,054 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0020 requests cleared
2015-03-13 10:10:26,054 INFO  capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0020 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:10:26,054 INFO  capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0020 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:10:26,054 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0020_000001 (auth:SIMPLE)
2015-03-13 10:10:26,055 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0020_01_000001
2015-03-13 10:10:26,369 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:26,369 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0020 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:10:26,370 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0020
2015-03-13 10:10:26,370 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0020
2015-03-13 10:10:26,370 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0020
2015-03-13 10:10:26,370 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0020
2015-03-13 10:10:26,370 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0020
2015-03-13 10:10:26,371 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0020 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:10:26,371 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0020, with delay of 10800 seconds
2015-03-13 10:10:26,543 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0021_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:10:26,543 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0021_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:10:26,543 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0021_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:10:26,543 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0021_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:10:26,543 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0021_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:10:26,570 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.jar	dst=null	perm=null
2015-03-13 10:10:26,571 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.jar	dst=null	perm=null
2015-03-13 10:10:26,579 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.xml	dst=null	perm=null
2015-03-13 10:10:26,580 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.xml	dst=null	perm=null
2015-03-13 10:10:26,582 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:10:26,583 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:10:26,588 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:10:26,590 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:10:26,591 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:10:26,592 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:10:26,655 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0020 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:10:26,655 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0020
2015-03-13 10:10:26,655 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0020
2015-03-13 10:10:26,655 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0020
2015-03-13 10:10:26,655 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0020 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:10:26,655 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0020, with delay of 10800 seconds
2015-03-13 10:10:26,655 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0020
2015-03-13 10:10:26,656 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0020
2015-03-13 10:10:26,669 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0021_000001 (auth:SIMPLE)
2015-03-13 10:10:26,669 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0021_000001 (auth:SIMPLE)
2015-03-13 10:10:26,673 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0021_01_000006 by user soberoi
2015-03-13 10:10:26,673 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0021
2015-03-13 10:10:26,673 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0021	CONTAINERID=container_1426266260362_0021_01_000006
2015-03-13 10:10:26,673 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0021 transitioned from NEW to INITING
2015-03-13 10:10:26,673 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0021_01_000006 to application application_1426266260362_0021
2015-03-13 10:10:26,674 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0021 transitioned from INITING to RUNNING
2015-03-13 10:10:26,674 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0021_01_000005 by user soberoi
2015-03-13 10:10:26,674 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0021
2015-03-13 10:10:26,674 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0021	CONTAINERID=container_1426266260362_0021_01_000005
2015-03-13 10:10:26,675 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0021_01_000003 by user soberoi
2015-03-13 10:10:26,675 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0021 transitioned from NEW to INITING
2015-03-13 10:10:26,674 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:10:26,675 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0021
2015-03-13 10:10:26,675 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0021
2015-03-13 10:10:26,675 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:10:26,675 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0021
2015-03-13 10:10:26,675 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:10:26,675 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:10:26,676 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0021_01_000006
2015-03-13 10:10:26,675 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0021_01_000005 to application application_1426266260362_0021
2015-03-13 10:10:26,676 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0021_01_000003 to application application_1426266260362_0021
2015-03-13 10:10:26,676 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0021 transitioned from INITING to RUNNING
2015-03-13 10:10:26,676 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:10:26,677 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:10:26,677 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0021
2015-03-13 10:10:26,677 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0021
2015-03-13 10:10:26,677 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:10:26,677 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0021
2015-03-13 10:10:26,677 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:10:26,677 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:10:26,677 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0021
2015-03-13 10:10:26,677 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0021
2015-03-13 10:10:26,677 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:10:26,677 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0021
2015-03-13 10:10:26,678 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0021_01_000005
2015-03-13 10:10:26,675 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0021	CONTAINERID=container_1426266260362_0021_01_000003
2015-03-13 10:10:26,675 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0021_01_000002 by user soberoi
2015-03-13 10:10:26,678 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0021_01_000003
2015-03-13 10:10:26,678 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0021	CONTAINERID=container_1426266260362_0021_01_000002
2015-03-13 10:10:26,679 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0021_01_000002 to application application_1426266260362_0021
2015-03-13 10:10:26,679 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:10:26,679 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0021
2015-03-13 10:10:26,679 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0021
2015-03-13 10:10:26,679 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:10:26,679 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0021
2015-03-13 10:10:26,679 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0021_01_000002
2015-03-13 10:10:26,682 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0021_01_000004 by user soberoi
2015-03-13 10:10:26,682 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0021	CONTAINERID=container_1426266260362_0021_01_000004
2015-03-13 10:10:26,682 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0021_01_000004 to application application_1426266260362_0021
2015-03-13 10:10:26,683 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:10:26,683 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0021
2015-03-13 10:10:26,683 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0021
2015-03-13 10:10:26,683 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:10:26,683 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0021
2015-03-13 10:10:26,683 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0021_01_000004
2015-03-13 10:10:26,696 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1426266260362_0021_01_000006.tokens. Credentials list: 
2015-03-13 10:10:26,699 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0021_01_000003.tokens. Credentials list: 
2015-03-13 10:10:26,699 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0021_01_000005.tokens. Credentials list: 
2015-03-13 10:10:26,700 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0021_01_000002.tokens. Credentials list: 
2015-03-13 10:10:26,701 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0021_01_000004.tokens. Credentials list: 
2015-03-13 10:10:26,703 INFO  hs.JobHistory (JobHistory.java:run(178)) - Starting scan to move intermediate done files
2015-03-13 10:10:26,703 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:10:26,704 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:10:26,707 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0013.summary	dst=null	perm=null
2015-03-13 10:10:26,708 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0012.summary	dst=null	perm=null
2015-03-13 10:10:26,707 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0011.summary	dst=null	perm=null
2015-03-13 10:10:26,710 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62566, bytes: 458, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741969_1145, duration: 156000
2015-03-13 10:10:26,710 INFO  jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0012,submitTime=1426266462037,launchTime=1426266465337,firstMapTaskLaunchTime=1426266467501,firstReduceTaskLaunchTime=1426266479436,finishTime=1426266482378,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=5,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=48,reduceSlotSeconds=2,jobName=[65C1F8B7B9BE47B0A23DAB67E3AF740D/2BC7D8F0414F4AAC967872FE1A0F4420] cogrouping/(1/2) ...tform/joinsintocogrouprhs
2015-03-13 10:10:26,711 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0012.summary]
2015-03-13 10:10:26,711 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62565, bytes: 444, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741982_1158, duration: 210000
2015-03-13 10:10:26,712 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62567, bytes: 414, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741959_1135, duration: 120000
2015-03-13 10:10:26,712 INFO  jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0013,submitTime=1426266483799,launchTime=1426266487399,firstMapTaskLaunchTime=1426266489591,firstReduceTaskLaunchTime=0,finishTime=1426266500368,resourcesPerMap=1024,resourcesPerReduce=0,numMaps=5,numReduces=0,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=50,reduceSlotSeconds=0,jobName=[66292338870B4E96BCA2C279F2316D18/1DA395B3D9054135BCD4DF3C5499AF7E] lower*upper/(1/1) ...dpipesplatform/joinhasher
2015-03-13 10:10:26,712 INFO  jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0011,submitTime=1426266445118,launchTime=1426266448756,firstMapTaskLaunchTime=1426266450919,firstReduceTaskLaunchTime=0,finishTime=1426266460776,resourcesPerMap=1024,resourcesPerReduce=0,numMaps=5,numReduces=0,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=47,reduceSlotSeconds=0,jobName=[65C1F8B7B9BE47B0A23DAB67E3AF740D/3CA34A330FF64917AFF7341793394779] cogrouping/(2/2)
2015-03-13 10:10:26,712 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0011.summary]
2015-03-13 10:10:26,712 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741969_1145 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60689 
2015-03-13 10:10:26,712 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0012.summary	dst=null	perm=null
2015-03-13 10:10:26,712 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0013.summary]
2015-03-13 10:10:26,714 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741959_1135 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60693 
2015-03-13 10:10:26,714 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741982_1158 127.0.0.1:60689 127.0.0.1:60693 127.0.0.1:60696 
2015-03-13 10:10:26,714 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0011.summary	dst=null	perm=null
2015-03-13 10:10:26,715 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000	dst=null	perm=null
2015-03-13 10:10:26,715 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0013.summary	dst=null	perm=null
2015-03-13 10:10:26,716 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0012-1426266462037-soberoi-%5B65C1F8B7B9BE47B0A23DAB67E3AF740D%2F2BC7D8F0414F4AAC-1426266482378-5-1-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0012-1426266462037-soberoi-%5B65C1F8B7B9BE47B0A23DAB67E3AF740D%2F2BC7D8F0414F4AAC-1426266482378-5-1-SUCCEEDED-default.jhist
2015-03-13 10:10:26,717 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000	dst=null	perm=null
2015-03-13 10:10:26,717 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000	dst=null	perm=null
2015-03-13 10:10:26,718 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0013-1426266483799-soberoi-%5B66292338870B4E96BCA2C279F2316D18%2F1DA395B3D9054135-1426266500368-5-0-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0013-1426266483799-soberoi-%5B66292338870B4E96BCA2C279F2316D18%2F1DA395B3D9054135-1426266500368-5-0-SUCCEEDED-default.jhist
2015-03-13 10:10:26,718 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0011-1426266445118-soberoi-%5B65C1F8B7B9BE47B0A23DAB67E3AF740D%2F3CA34A330FF64917-1426266460776-5-0-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0011-1426266445118-soberoi-%5B65C1F8B7B9BE47B0A23DAB67E3AF740D%2F3CA34A330FF64917-1426266460776-5-0-SUCCEEDED-default.jhist
2015-03-13 10:10:26,719 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0012-1426266462037-soberoi-%5B65C1F8B7B9BE47B0A23DAB67E3AF740D%2F2BC7D8F0414F4AAC-1426266482378-5-1-SUCCEEDED-default.jhist	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0012-1426266462037-soberoi-%5B65C1F8B7B9BE47B0A23DAB67E3AF740D%2F2BC7D8F0414F4AAC-1426266482378-5-1-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:26,719 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0012_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0012_conf.xml
2015-03-13 10:10:26,720 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0013-1426266483799-soberoi-%5B66292338870B4E96BCA2C279F2316D18%2F1DA395B3D9054135-1426266500368-5-0-SUCCEEDED-default.jhist	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0013-1426266483799-soberoi-%5B66292338870B4E96BCA2C279F2316D18%2F1DA395B3D9054135-1426266500368-5-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:26,720 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0013_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0013_conf.xml
2015-03-13 10:10:26,720 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0011-1426266445118-soberoi-%5B65C1F8B7B9BE47B0A23DAB67E3AF740D%2F3CA34A330FF64917-1426266460776-5-0-SUCCEEDED-default.jhist	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0011-1426266445118-soberoi-%5B65C1F8B7B9BE47B0A23DAB67E3AF740D%2F3CA34A330FF64917-1426266460776-5-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:26,721 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0012_conf.xml	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0012_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:26,721 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0011_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0011_conf.xml
2015-03-13 10:10:26,722 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0014.summary	dst=null	perm=null
2015-03-13 10:10:26,722 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0013_conf.xml	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0013_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:26,722 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0011_conf.xml	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0011_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:26,723 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0015.summary	dst=null	perm=null
2015-03-13 10:10:26,723 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62567, bytes: 437, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741993_1169, duration: 153000
2015-03-13 10:10:26,723 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0016.summary	dst=null	perm=null
2015-03-13 10:10:26,724 INFO  jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0014,submitTime=1426266501740,launchTime=1426266505521,firstMapTaskLaunchTime=1426266507674,firstReduceTaskLaunchTime=1426266519609,finishTime=1426266522144,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=5,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=46,reduceSlotSeconds=2,jobName=[6DC799D3695A41EDB24861BDF4BA2FF4/561BA7C30D2E4E9290533DB9645A592A] lower*upper*joined/(2/2)
2015-03-13 10:10:26,724 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0014.summary]
2015-03-13 10:10:26,725 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62566, bytes: 450, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742003_1179, duration: 121000
2015-03-13 10:10:26,725 INFO  jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0015,submitTime=1426266523400,launchTime=1426266526617,firstMapTaskLaunchTime=1426266528752,firstReduceTaskLaunchTime=0,finishTime=1426266531660,resourcesPerMap=1024,resourcesPerReduce=0,numMaps=1,numReduces=0,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=2,reduceSlotSeconds=0,jobName=[6DC799D3695A41EDB24861BDF4BA2FF4/3066B2C3CE37414884C03F0C08B36832] lower*upper*joined/(1/2) ...splatform/joingroupbyjoin
2015-03-13 10:10:26,725 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0015.summary]
2015-03-13 10:10:26,725 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741993_1169 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60686 
2015-03-13 10:10:26,725 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0014.summary	dst=null	perm=null
2015-03-13 10:10:26,726 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62568, bytes: 440, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742016_1192, duration: 159000
2015-03-13 10:10:26,727 INFO  jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0016,submitTime=1426266532975,launchTime=1426266536303,firstMapTaskLaunchTime=1426266538457,firstReduceTaskLaunchTime=0,finishTime=1426266546259,resourcesPerMap=1024,resourcesPerReduce=0,numMaps=4,numReduces=0,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=30,reduceSlotSeconds=0,jobName=[E7F6D5868D024899941007FA966EB2C9/DF3D800AAAC346239F59A15452AAF080] lhs*rhs/(1/1) ...ieldedpipesplatform/cross
2015-03-13 10:10:26,727 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0016.summary]
2015-03-13 10:10:26,727 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:10:26,728 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742003_1179 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60693 
2015-03-13 10:10:26,728 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:10:26,728 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0015.summary	dst=null	perm=null
2015-03-13 10:10:26,729 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742016_1192 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60696 
2015-03-13 10:10:26,730 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0016.summary	dst=null	perm=null
2015-03-13 10:10:26,730 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000	dst=null	perm=null
2015-03-13 10:10:26,730 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000	dst=null	perm=null
2015-03-13 10:10:26,731 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0015-1426266523400-soberoi-%5B6DC799D3695A41EDB24861BDF4BA2FF4%2F3066B2C3CE374148-1426266531660-1-0-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0015-1426266523400-soberoi-%5B6DC799D3695A41EDB24861BDF4BA2FF4%2F3066B2C3CE374148-1426266531660-1-0-SUCCEEDED-default.jhist
2015-03-13 10:10:26,731 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0014-1426266501740-soberoi-%5B6DC799D3695A41EDB24861BDF4BA2FF4%2F561BA7C30D2E4E92-1426266522144-5-1-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0014-1426266501740-soberoi-%5B6DC799D3695A41EDB24861BDF4BA2FF4%2F561BA7C30D2E4E92-1426266522144-5-1-SUCCEEDED-default.jhist
2015-03-13 10:10:26,732 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000	dst=null	perm=null
2015-03-13 10:10:26,733 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0016-1426266532975-soberoi-%5BE7F6D5868D024899941007FA966EB2C9%2FDF3D800AAAC34623-1426266546259-4-0-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0016-1426266532975-soberoi-%5BE7F6D5868D024899941007FA966EB2C9%2FDF3D800AAAC34623-1426266546259-4-0-SUCCEEDED-default.jhist
2015-03-13 10:10:26,733 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0014-1426266501740-soberoi-%5B6DC799D3695A41EDB24861BDF4BA2FF4%2F561BA7C30D2E4E92-1426266522144-5-1-SUCCEEDED-default.jhist	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0014-1426266501740-soberoi-%5B6DC799D3695A41EDB24861BDF4BA2FF4%2F561BA7C30D2E4E92-1426266522144-5-1-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:26,734 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0014_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0014_conf.xml
2015-03-13 10:10:26,734 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0016-1426266532975-soberoi-%5BE7F6D5868D024899941007FA966EB2C9%2FDF3D800AAAC34623-1426266546259-4-0-SUCCEEDED-default.jhist	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0016-1426266532975-soberoi-%5BE7F6D5868D024899941007FA966EB2C9%2FDF3D800AAAC34623-1426266546259-4-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:26,735 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0016_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0016_conf.xml
2015-03-13 10:10:26,735 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0015-1426266523400-soberoi-%5B6DC799D3695A41EDB24861BDF4BA2FF4%2F3066B2C3CE374148-1426266531660-1-0-SUCCEEDED-default.jhist	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0015-1426266523400-soberoi-%5B6DC799D3695A41EDB24861BDF4BA2FF4%2F3066B2C3CE374148-1426266531660-1-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:26,736 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0015_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0015_conf.xml
2015-03-13 10:10:26,736 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0016_conf.xml	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0016_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:26,736 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0014_conf.xml	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0014_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:26,737 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0017.summary	dst=null	perm=null
2015-03-13 10:10:26,737 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0015_conf.xml	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0015_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:26,737 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0018.summary	dst=null	perm=null
2015-03-13 10:10:26,738 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0019.summary	dst=null	perm=null
2015-03-13 10:10:26,739 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62566, bytes: 455, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742039_1215, duration: 151000
2015-03-13 10:10:26,739 INFO  jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0018,submitTime=1426266563882,launchTime=1426266567567,firstMapTaskLaunchTime=1426266569726,firstReduceTaskLaunchTime=1426266583684,finishTime=1426266586326,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=6,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=67,reduceSlotSeconds=2,jobName=[CD6FBC07BE1742EBBA4ED3E85D978DBA/D4DC90FFC72F4258815AC79ED379D06A] merging/(1/1) ...platform/joinsintogroupby
2015-03-13 10:10:26,739 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0018.summary]
2015-03-13 10:10:26,740 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62567, bytes: 444, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742052_1228, duration: 113000
2015-03-13 10:10:26,740 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62569, bytes: 444, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742029_1205, duration: 100000
2015-03-13 10:10:26,740 INFO  jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0019,submitTime=1426266587640,launchTime=1426266591360,firstMapTaskLaunchTime=1426266593528,firstReduceTaskLaunchTime=0,finishTime=1426266603162,resourcesPerMap=1024,resourcesPerReduce=0,numMaps=5,numReduces=0,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=47,reduceSlotSeconds=0,jobName=[B7ACEFEF0218423EB65E6E148EB627C7/2A3F31AD6A62450CB825E66F41825487] lower*upper/(1/1) ...ldedpipesplatform/unknown
2015-03-13 10:10:26,741 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0019.summary]
2015-03-13 10:10:26,741 INFO  jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0017,submitTime=1426266547587,launchTime=1426266550919,firstMapTaskLaunchTime=1426266553099,firstReduceTaskLaunchTime=0,finishTime=1426266562540,resourcesPerMap=1024,resourcesPerReduce=0,numMaps=5,numReduces=0,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=46,reduceSlotSeconds=0,jobName=[E8F7ECEBD6AF435181C0FE297F64D1A5/DF54CDC6A1544804917CE472FDCAAAEE] lower*upper/(1/1) ...fieldedpipesplatform/join
2015-03-13 10:10:26,741 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0017.summary]
2015-03-13 10:10:26,742 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742039_1215 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60686 
2015-03-13 10:10:26,742 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0018.summary	dst=null	perm=null
2015-03-13 10:10:26,742 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742052_1228 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60689 
2015-03-13 10:10:26,742 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0019.summary	dst=null	perm=null
2015-03-13 10:10:26,742 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742029_1205 127.0.0.1:60693 127.0.0.1:60689 127.0.0.1:60696 
2015-03-13 10:10:26,743 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0017.summary	dst=null	perm=null
2015-03-13 10:10:26,745 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000	dst=null	perm=null
2015-03-13 10:10:26,745 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000	dst=null	perm=null
2015-03-13 10:10:26,746 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000	dst=null	perm=null
2015-03-13 10:10:26,746 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0018-1426266563882-soberoi-%5BCD6FBC07BE1742EBBA4ED3E85D978DBA%2FD4DC90FFC72F4258-1426266586326-6-1-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0018-1426266563882-soberoi-%5BCD6FBC07BE1742EBBA4ED3E85D978DBA%2FD4DC90FFC72F4258-1426266586326-6-1-SUCCEEDED-default.jhist
2015-03-13 10:10:26,746 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0019-1426266587640-soberoi-%5BB7ACEFEF0218423EB65E6E148EB627C7%2F2A3F31AD6A62450C-1426266603162-5-0-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0019-1426266587640-soberoi-%5BB7ACEFEF0218423EB65E6E148EB627C7%2F2A3F31AD6A62450C-1426266603162-5-0-SUCCEEDED-default.jhist
2015-03-13 10:10:26,746 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0017-1426266547587-soberoi-%5BE8F7ECEBD6AF435181C0FE297F64D1A5%2FDF54CDC6A1544804-1426266562540-5-0-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0017-1426266547587-soberoi-%5BE8F7ECEBD6AF435181C0FE297F64D1A5%2FDF54CDC6A1544804-1426266562540-5-0-SUCCEEDED-default.jhist
2015-03-13 10:10:26,747 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0018-1426266563882-soberoi-%5BCD6FBC07BE1742EBBA4ED3E85D978DBA%2FD4DC90FFC72F4258-1426266586326-6-1-SUCCEEDED-default.jhist	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0018-1426266563882-soberoi-%5BCD6FBC07BE1742EBBA4ED3E85D978DBA%2FD4DC90FFC72F4258-1426266586326-6-1-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:26,748 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0018_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0018_conf.xml
2015-03-13 10:10:26,748 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0017-1426266547587-soberoi-%5BE8F7ECEBD6AF435181C0FE297F64D1A5%2FDF54CDC6A1544804-1426266562540-5-0-SUCCEEDED-default.jhist	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0017-1426266547587-soberoi-%5BE8F7ECEBD6AF435181C0FE297F64D1A5%2FDF54CDC6A1544804-1426266562540-5-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:26,748 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0019-1426266587640-soberoi-%5BB7ACEFEF0218423EB65E6E148EB627C7%2F2A3F31AD6A62450C-1426266603162-5-0-SUCCEEDED-default.jhist	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0019-1426266587640-soberoi-%5BB7ACEFEF0218423EB65E6E148EB627C7%2F2A3F31AD6A62450C-1426266603162-5-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:26,748 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0017_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0017_conf.xml
2015-03-13 10:10:26,748 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0019_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0019_conf.xml
2015-03-13 10:10:26,749 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0018_conf.xml	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0018_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:26,749 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0019_conf.xml	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0019_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:26,749 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0017_conf.xml	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0017_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:26,750 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0020.summary	dst=null	perm=null
2015-03-13 10:10:26,752 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62568, bytes: 452, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742065_1241, duration: 316000
2015-03-13 10:10:26,752 INFO  jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0020,submitTime=1426266604533,launchTime=1426266608090,firstMapTaskLaunchTime=1426266610256,firstReduceTaskLaunchTime=0,finishTime=1426266619698,resourcesPerMap=1024,resourcesPerReduce=0,numMaps=5,numReduces=0,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=46,reduceSlotSeconds=0,jobName=[E6523EE1541F4C2199F3EC42AB5499B5/0A2AB8927DF243BD907C69BD6B859EF6] lower*upper1*upper2/(1/1) ...m/joinaroundjoinrightmost
2015-03-13 10:10:26,752 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0020.summary]
2015-03-13 10:10:26,753 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742065_1241 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60686 
2015-03-13 10:10:26,753 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0020.summary	dst=null	perm=null
2015-03-13 10:10:26,757 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000	dst=null	perm=null
2015-03-13 10:10:26,758 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0020-1426266604533-soberoi-%5BE6523EE1541F4C2199F3EC42AB5499B5%2F0A2AB8927DF243BD-1426266619698-5-0-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0020-1426266604533-soberoi-%5BE6523EE1541F4C2199F3EC42AB5499B5%2F0A2AB8927DF243BD-1426266619698-5-0-SUCCEEDED-default.jhist
2015-03-13 10:10:26,759 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0020-1426266604533-soberoi-%5BE6523EE1541F4C2199F3EC42AB5499B5%2F0A2AB8927DF243BD-1426266619698-5-0-SUCCEEDED-default.jhist	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0020-1426266604533-soberoi-%5BE6523EE1541F4C2199F3EC42AB5499B5%2F0A2AB8927DF243BD-1426266619698-5-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:26,759 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0020_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0020_conf.xml
2015-03-13 10:10:26,760 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0020_conf.xml	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0020_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:26,823 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0021_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000003.tokens
2015-03-13 10:10:26,823 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1426266260362_0021_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000006.tokens
2015-03-13 10:10:26,824 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0021 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0021
2015-03-13 10:10:26,824 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0021 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0021
2015-03-13 10:10:26,894 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.jar	dst=null	perm=null
2015-03-13 10:10:26,895 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.jar	dst=null	perm=null
2015-03-13 10:10:26,895 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.jar	dst=null	perm=null
2015-03-13 10:10:26,895 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.jar	dst=null	perm=null
2015-03-13 10:10:26,896 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.jar	dst=null	perm=null
2015-03-13 10:10:26,896 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.jar	dst=null	perm=null
2015-03-13 10:10:26,903 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62565, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_508868064_11204, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742068_1244, duration: 488000
2015-03-13 10:10:26,903 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62569, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1107203517_11205, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742068_1244, duration: 512000
2015-03-13 10:10:26,923 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:26,924 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:26,942 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.xml	dst=null	perm=null
2015-03-13 10:10:26,942 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.xml	dst=null	perm=null
2015-03-13 10:10:26,943 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.xml	dst=null	perm=null
2015-03-13 10:10:26,943 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.xml	dst=null	perm=null
2015-03-13 10:10:26,943 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.xml	dst=null	perm=null
2015-03-13 10:10:26,944 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.xml	dst=null	perm=null
2015-03-13 10:10:26,950 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62569, bytes: 98404, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_508868064_11204, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742071_1247, duration: 267000
2015-03-13 10:10:26,950 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62567, bytes: 98404, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1107203517_11205, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742071_1247, duration: 283000
2015-03-13 10:10:26,965 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:26,965 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:10:26,965 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:10:26,966 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:10:26,965 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:26,966 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:10:26,966 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:10:27,010 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:10:27,011 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:10:27,011 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:27,011 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:27,022 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:10:27,023 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:27,023 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:10:27,023 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:27,028 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:10:27,028 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:27,056 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:27,057 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0020 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:10:27,057 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0021_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:10:27,057 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0020
2015-03-13 10:10:27,057 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0020
2015-03-13 10:10:27,057 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0020
2015-03-13 10:10:27,057 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0020 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:10:27,057 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0020, with delay of 10800 seconds
2015-03-13 10:10:27,057 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0020
2015-03-13 10:10:27,058 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0020
2015-03-13 10:10:27,157 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000004/default_container_executor.sh]
2015-03-13 10:10:27,163 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000002/default_container_executor.sh]
2015-03-13 10:10:27,172 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000006/default_container_executor.sh]
2015-03-13 10:10:27,173 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000005/default_container_executor.sh]
2015-03-13 10:10:27,188 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000003/default_container_executor.sh]
2015-03-13 10:10:27,370 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:27,557 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:10:27,655 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:27,656 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:27,656 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:27,656 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:27,656 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0021_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:10:27,656 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0021_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:10:27,657 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0021_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:10:27,657 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0021_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:10:27,954 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073742016_1192, blk_1073742065_1241, blk_1073742052_1228, blk_1073742039_1215, blk_1073741959_1135, blk_1073741993_1169]
2015-03-13 10:10:27,954 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073741969_1145, blk_1073742003_1179, blk_1073742039_1215, blk_1073741959_1135, blk_1073742029_1205, blk_1073741982_1158]
2015-03-13 10:10:27,993 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:10:28,058 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:28,107 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0021_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000004.tokens
2015-03-13 10:10:28,107 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0021 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0021
2015-03-13 10:10:28,217 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:10:28,353 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0021_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000002.tokens
2015-03-13 10:10:28,353 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0021 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0021
2015-03-13 10:10:28,373 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:28,459 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:10:28,557 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742016_1192 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742016 for deletion
2015-03-13 10:10:28,557 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742065_1241 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742065 for deletion
2015-03-13 10:10:28,558 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742052_1228 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742052 for deletion
2015-03-13 10:10:28,558 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741959_1135 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741959 for deletion
2015-03-13 10:10:28,558 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742016_1192 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742016
2015-03-13 10:10:28,558 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742065_1241 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742065
2015-03-13 10:10:28,558 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741959_1135 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741959
2015-03-13 10:10:28,558 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742052_1228 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742052
2015-03-13 10:10:28,558 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742039_1215 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742039 for deletion
2015-03-13 10:10:28,558 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741993_1169 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741993 for deletion
2015-03-13 10:10:28,558 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742039_1215 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742039
2015-03-13 10:10:28,559 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741993_1169 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741993
2015-03-13 10:10:28,595 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0021_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000005.tokens
2015-03-13 10:10:28,596 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0021 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0021
2015-03-13 10:10:28,657 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:28,657 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:28,657 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:28,657 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:28,759 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741969_1145 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741969 for deletion
2015-03-13 10:10:28,759 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742003_1179 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742003 for deletion
2015-03-13 10:10:28,759 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741959_1135 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741959 for deletion
2015-03-13 10:10:28,760 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742039_1215 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742039 for deletion
2015-03-13 10:10:28,760 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741969_1145 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741969
2015-03-13 10:10:28,760 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742029_1205 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742029 for deletion
2015-03-13 10:10:28,760 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742003_1179 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742003
2015-03-13 10:10:28,760 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741982_1158 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741982 for deletion
2015-03-13 10:10:28,760 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742039_1215 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742039
2015-03-13 10:10:28,760 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741959_1135 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741959
2015-03-13 10:10:28,760 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742029_1205 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742029
2015-03-13 10:10:28,760 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741982_1158 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741982
2015-03-13 10:10:28,868 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742072_1248
2015-03-13 10:10:28,869 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742072_1248
2015-03-13 10:10:29,059 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:29,378 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:29,419 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742072_1248
2015-03-13 10:10:29,658 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:29,658 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:29,658 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:29,658 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:30,062 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:30,379 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:30,659 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:30,659 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:30,659 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:30,659 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:30,958 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073742016_1192, blk_1073742065_1241, blk_1073741969_1145, blk_1073742003_1179, blk_1073742052_1228, blk_1073742039_1215, blk_1073741959_1135, blk_1073741993_1169, blk_1073742029_1205, blk_1073741982_1158]
2015-03-13 10:10:30,958 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073742016_1192, blk_1073742065_1241, blk_1073741969_1145, blk_1073742003_1179, blk_1073742052_1228, blk_1073741993_1169, blk_1073742029_1205, blk_1073741982_1158]
2015-03-13 10:10:31,067 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:31,380 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:31,561 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742016_1192 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742016 for deletion
2015-03-13 10:10:31,561 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741969_1145 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741969 for deletion
2015-03-13 10:10:31,561 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742065_1241 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742065 for deletion
2015-03-13 10:10:31,561 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742016_1192 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742016
2015-03-13 10:10:31,561 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742003_1179 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742003 for deletion
2015-03-13 10:10:31,561 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742052_1228 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742052 for deletion
2015-03-13 10:10:31,561 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741993_1169 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741993 for deletion
2015-03-13 10:10:31,561 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741969_1145 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741969
2015-03-13 10:10:31,562 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742029_1205 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742029 for deletion
2015-03-13 10:10:31,562 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742052_1228 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742052
2015-03-13 10:10:31,562 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742065_1241 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742065
2015-03-13 10:10:31,562 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741982_1158 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741982 for deletion
2015-03-13 10:10:31,562 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742003_1179 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742003
2015-03-13 10:10:31,562 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741993_1169 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741993
2015-03-13 10:10:31,562 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742029_1205 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742029
2015-03-13 10:10:31,563 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741982_1158 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741982
2015-03-13 10:10:31,665 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:31,665 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:31,665 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:31,666 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:31,933 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742016_1192 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742016 for deletion
2015-03-13 10:10:31,933 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741969_1145 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741969 for deletion
2015-03-13 10:10:31,933 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742065_1241 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742065 for deletion
2015-03-13 10:10:31,933 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742003_1179 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742003 for deletion
2015-03-13 10:10:31,933 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742016_1192 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742016
2015-03-13 10:10:31,934 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741969_1145 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741969
2015-03-13 10:10:31,933 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742052_1228 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742052 for deletion
2015-03-13 10:10:31,934 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742003_1179 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742003
2015-03-13 10:10:31,934 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742065_1241 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742065
2015-03-13 10:10:31,934 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741959_1135 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741959 for deletion
2015-03-13 10:10:31,934 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742039_1215 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742039 for deletion
2015-03-13 10:10:31,934 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742052_1228 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742052
2015-03-13 10:10:31,934 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741993_1169 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741993 for deletion
2015-03-13 10:10:31,934 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742029_1205 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742029 for deletion
2015-03-13 10:10:31,934 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741959_1135 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741959
2015-03-13 10:10:31,934 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741982_1158 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741982 for deletion
2015-03-13 10:10:31,935 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742039_1215 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742039
2015-03-13 10:10:31,935 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741993_1169 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741993
2015-03-13 10:10:31,935 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742029_1205 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742029
2015-03-13 10:10:31,935 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741982_1158 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741982
2015-03-13 10:10:32,072 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:32,381 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:32,667 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:32,668 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:32,668 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:32,668 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:33,074 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:33,387 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:33,674 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:33,674 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:33,674 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:33,674 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:34,079 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:34,388 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:34,679 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:34,679 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:34,679 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:34,679 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:34,948 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.split	dst=null	perm=null
2015-03-13 10:10:35,054 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.split	dst=null	perm=null
2015-03-13 10:10:35,056 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.split	dst=null	perm=null
2015-03-13 10:10:35,082 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:35,106 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.split	dst=null	perm=null
2015-03-13 10:10:35,152 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62586, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0021_m_000004_0_-978846826_1, offset: 1024, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742069_1245, duration: 170000
2015-03-13 10:10:35,154 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.split	dst=null	perm=null
2015-03-13 10:10:35,235 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62589, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0021_m_000000_0_-1492391439_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742069_1245, duration: 171000
2015-03-13 10:10:35,242 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62588, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0021_m_000001_0_237217636_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742069_1245, duration: 161000
2015-03-13 10:10:35,262 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62590, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0021_m_000003_0_387821991_1, offset: 1024, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742069_1245, duration: 174000
2015-03-13 10:10:35,308 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62591, bytes: 1282, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0021_m_000002_0_-2026454953_1, offset: 512, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742069_1245, duration: 189000
2015-03-13 10:10:35,314 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:10:35,320 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62592, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0021_m_000004_0_-978846826_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 171000
2015-03-13 10:10:35,339 INFO  namenode.FSEditLog (FSEditLog.java:printStatistics(663)) - Number of transactions: 2102 Total time for transactions(ms): 103 Number of transactions batched in Syncs: 5 Number of syncs: 1201 SyncTimes(ms): 341 263 
2015-03-13 10:10:35,340 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1426266260362_0021_m_000004_0/part-00004	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:35,349 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:10:35,364 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:10:35,369 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:10:35,369 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62593, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0021_m_000001_0_237217636_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 255000
2015-03-13 10:10:35,373 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62594, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0021_m_000003_0_387821991_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 189000
2015-03-13 10:10:35,386 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1426266260362_0021_m_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:35,389 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:35,395 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1426266260362_0021_m_000001_0/part-00001	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:35,403 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1426266260362_0021_m_000003_0/part-00003	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:35,441 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:10:35,445 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62595, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0021_m_000002_0_-2026454953_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 151000
2015-03-13 10:10:35,491 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1426266260362_0021_m_000002_0/part-00002	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:35,684 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:35,684 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:35,684 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:35,684 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:35,755 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:10:35,764 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:10:35,767 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:10:35,771 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62586, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0021_m_000004_0_-978846826_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 147000
2015-03-13 10:10:35,778 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:10:35,788 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:10:35,794 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1426266260362_0021_m_000004_0/part-00004 is closed by DFSClient_attempt_1426266260362_0021_m_000004_0_-978846826_1
2015-03-13 10:10:35,795 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:10:35,799 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62596, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0021_m_000000_0_-1492391439_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 149000
2015-03-13 10:10:35,803 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:10:35,804 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1426266260362_0021_m_000004_0	dst=null	perm=null
2015-03-13 10:10:35,806 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62596, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0021_m_000000_0_-1492391439_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 156000
2015-03-13 10:10:35,811 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1426266260362_0021_m_000004_0	dst=null	perm=null
2015-03-13 10:10:35,812 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/task_1426266260362_0021_m_000004	dst=null	perm=null
2015-03-13 10:10:35,813 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:10:35,816 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1426266260362_0021_m_000004_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/task_1426266260362_0021_m_000004	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:10:35,816 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:10:35,820 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62590, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0021_m_000003_0_387821991_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 175000
2015-03-13 10:10:35,837 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0021_01_000006
2015-03-13 10:10:35,837 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0021	CONTAINERID=container_1426266260362_0021_01_000006
2015-03-13 10:10:35,837 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:10:35,837 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0021_01_000006
2015-03-13 10:10:35,837 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:10:35,851 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0021_01_000006 is : 143
2015-03-13 10:10:35,851 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1426266260362_0021_m_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073742073_1249{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:10:35,854 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job_1426266260362_0021_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073742074_1250{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:10:35,856 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742074_1250 src: /127.0.0.1:62598 dest: /127.0.0.1:60686
2015-03-13 10:10:35,858 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742074_1250 src: /127.0.0.1:62599 dest: /127.0.0.1:60693
2015-03-13 10:10:35,860 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742074_1250 src: /127.0.0.1:62600 dest: /127.0.0.1:60696
2015-03-13 10:10:35,863 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:10:35,863 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000006
2015-03-13 10:10:35,863 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000006
2015-03-13 10:10:35,863 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000006
2015-03-13 10:10:35,864 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000006
2015-03-13 10:10:35,863 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0021	CONTAINERID=container_1426266260362_0021_01_000006
2015-03-13 10:10:35,864 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:10:35,864 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0021_01_000006 from application application_1426266260362_0021
2015-03-13 10:10:35,864 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:35,865 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0021
2015-03-13 10:10:35,865 INFO  hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job_1426266260362_0021_1.jhist for DFSClient_NONMAPREDUCE_-2029422546_1
2015-03-13 10:10:35,869 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1426266260362_0021_m_000003_0/part-00003. BP-1005356445-10.1.1.144-1426266257849 blk_1073742075_1251{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:10:35,907 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:10:35,910 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742073_1249 src: /127.0.0.1:62597 dest: /127.0.0.1:60693
2015-03-13 10:10:35,911 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742073_1249 src: /127.0.0.1:62602 dest: /127.0.0.1:60686
2015-03-13 10:10:35,912 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742073_1249 src: /127.0.0.1:62603 dest: /127.0.0.1:60696
2015-03-13 10:10:35,918 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742075_1251 src: /127.0.0.1:62601 dest: /127.0.0.1:60696
2015-03-13 10:10:35,919 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742075_1251 src: /127.0.0.1:62604 dest: /127.0.0.1:60693
2015-03-13 10:10:35,921 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742075_1251 src: /127.0.0.1:62605 dest: /127.0.0.1:60689
2015-03-13 10:10:35,923 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62603, dest: /127.0.0.1:60696, bytes: 80, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0021_m_000000_0_-1492391439_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742073_1249, duration: 8791000
2015-03-13 10:10:35,923 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742073_1249, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:35,923 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742073_1249{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:35,924 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62602, dest: /127.0.0.1:60686, bytes: 80, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0021_m_000000_0_-1492391439_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742073_1249, duration: 9399000
2015-03-13 10:10:35,924 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742073_1249, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:35,924 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742073_1249{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:35,924 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62597, dest: /127.0.0.1:60693, bytes: 80, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0021_m_000000_0_-1492391439_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742073_1249, duration: 10160000
2015-03-13 10:10:35,924 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742073_1249, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:35,925 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742073_1249{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:35,931 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62605, dest: /127.0.0.1:60689, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0021_m_000003_0_387821991_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742075_1251, duration: 8555000
2015-03-13 10:10:35,931 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742075_1251, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:35,932 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742075_1251{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:35,932 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62604, dest: /127.0.0.1:60693, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0021_m_000003_0_387821991_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742075_1251, duration: 9389000
2015-03-13 10:10:35,932 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742075_1251, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:35,932 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742075_1251{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:35,933 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62601, dest: /127.0.0.1:60696, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0021_m_000003_0_387821991_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742075_1251, duration: 10322000
2015-03-13 10:10:35,933 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742075_1251, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:35,933 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742075_1251{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:35,937 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1426266260362_0021_m_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0021_m_000000_0_-1492391439_1
2015-03-13 10:10:35,943 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1426266260362_0021_m_000003_0/part-00003 is closed by DFSClient_attempt_1426266260362_0021_m_000003_0_387821991_1
2015-03-13 10:10:35,946 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:10:35,946 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1426266260362_0021_m_000000_0	dst=null	perm=null
2015-03-13 10:10:35,951 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:10:35,954 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1426266260362_0021_m_000000_0	dst=null	perm=null
2015-03-13 10:10:35,955 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/task_1426266260362_0021_m_000000	dst=null	perm=null
2015-03-13 10:10:35,959 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1426266260362_0021_m_000000_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/task_1426266260362_0021_m_000000	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:10:35,959 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62606, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0021_m_000001_0_237217636_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 128000
2015-03-13 10:10:35,971 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0021_01_000002
2015-03-13 10:10:35,971 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0021	CONTAINERID=container_1426266260362_0021_01_000002
2015-03-13 10:10:35,971 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:10:35,972 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0021_01_000002
2015-03-13 10:10:35,972 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:10:35,972 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:35,972 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:35,972 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:35,984 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0021_01_000002 is : 143
2015-03-13 10:10:35,994 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:10:35,995 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000002
2015-03-13 10:10:35,995 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000002
2015-03-13 10:10:35,995 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000002
2015-03-13 10:10:35,995 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000002
2015-03-13 10:10:35,996 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0021	CONTAINERID=container_1426266260362_0021_01_000002
2015-03-13 10:10:35,996 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:10:35,997 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0021_01_000002 from application application_1426266260362_0021
2015-03-13 10:10:35,997 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:35,997 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0021
2015-03-13 10:10:35,999 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1426266260362_0021_m_000003_0	dst=null	perm=null
2015-03-13 10:10:36,000 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1426266260362_0021_m_000001_0/part-00001. BP-1005356445-10.1.1.144-1426266257849 blk_1073742076_1252{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:10:36,005 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1426266260362_0021_m_000003_0	dst=null	perm=null
2015-03-13 10:10:36,007 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/task_1426266260362_0021_m_000003	dst=null	perm=null
2015-03-13 10:10:36,010 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1426266260362_0021_m_000003_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/task_1426266260362_0021_m_000003	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:10:36,021 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0021_01_000005
2015-03-13 10:10:36,021 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0021	CONTAINERID=container_1426266260362_0021_01_000005
2015-03-13 10:10:36,021 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:10:36,022 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:10:36,022 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0021_01_000005
2015-03-13 10:10:36,022 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0021_01_000002
2015-03-13 10:10:36,022 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:36,022 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:36,022 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:10:36,023 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0021_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:10:36,023 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0021_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:10:36,023 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0021	CONTAINERID=container_1426266260362_0021_01_000002
2015-03-13 10:10:36,023 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0021_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:10:36,023 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:10:36,023 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0021_01_000002, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:36,023 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:36,023 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:10:36,024 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0021_000001 released container container_1426266260362_0021_01_000002 on node: host: 10.1.1.144:60711 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:10:36,035 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0021_01_000005 is : 143
2015-03-13 10:10:36,044 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742076_1252 src: /127.0.0.1:62607 dest: /127.0.0.1:60696
2015-03-13 10:10:36,046 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742076_1252 src: /127.0.0.1:62608 dest: /127.0.0.1:60693
2015-03-13 10:10:36,047 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:10:36,047 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000005
2015-03-13 10:10:36,047 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000005
2015-03-13 10:10:36,047 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742076_1252 src: /127.0.0.1:62609 dest: /127.0.0.1:60689
2015-03-13 10:10:36,048 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000005
2015-03-13 10:10:36,049 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000005
2015-03-13 10:10:36,049 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0021	CONTAINERID=container_1426266260362_0021_01_000005
2015-03-13 10:10:36,049 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:10:36,050 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0021_01_000005 from application application_1426266260362_0021
2015-03-13 10:10:36,050 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:36,050 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0021
2015-03-13 10:10:36,051 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:10:36,056 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62609, dest: /127.0.0.1:60689, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0021_m_000001_0_237217636_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742076_1252, duration: 6850000
2015-03-13 10:10:36,056 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742076_1252, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:36,056 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742076_1252{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:36,057 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62608, dest: /127.0.0.1:60693, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0021_m_000001_0_237217636_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742076_1252, duration: 7302000
2015-03-13 10:10:36,057 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742076_1252, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:36,057 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742076_1252{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:36,057 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62607, dest: /127.0.0.1:60696, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0021_m_000001_0_237217636_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742076_1252, duration: 8271000
2015-03-13 10:10:36,057 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742076_1252, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:36,058 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742076_1252{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:36,062 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1426266260362_0021_m_000001_0/part-00001 is closed by DFSClient_attempt_1426266260362_0021_m_000001_0_237217636_1
2015-03-13 10:10:36,063 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:10:36,066 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:10:36,070 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62610, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0021_m_000002_0_-2026454953_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 173000
2015-03-13 10:10:36,071 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1426266260362_0021_m_000001_0	dst=null	perm=null
2015-03-13 10:10:36,077 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1426266260362_0021_m_000001_0	dst=null	perm=null
2015-03-13 10:10:36,078 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/task_1426266260362_0021_m_000001	dst=null	perm=null
2015-03-13 10:10:36,082 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1426266260362_0021_m_000001_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/task_1426266260362_0021_m_000001	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:10:36,092 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0021_01_000003
2015-03-13 10:10:36,092 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0021	CONTAINERID=container_1426266260362_0021_01_000003
2015-03-13 10:10:36,092 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:10:36,093 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:10:36,093 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0021_01_000003
2015-03-13 10:10:36,093 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:36,093 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:10:36,093 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0021_01_000005
2015-03-13 10:10:36,094 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0021_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:10:36,094 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0021_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:10:36,094 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0021	CONTAINERID=container_1426266260362_0021_01_000005
2015-03-13 10:10:36,094 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0021_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:10:36,094 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:10:36,094 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0021_01_000005, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:36,094 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:36,094 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1426266260362_0021_m_000002_0/part-00002. BP-1005356445-10.1.1.144-1426266257849 blk_1073742077_1253{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:10:36,095 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:10:36,095 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0021_000001 released container container_1426266260362_0021_01_000005 on node: host: 10.1.1.144:60711 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:10:36,106 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0021_01_000003 is : 143
2015-03-13 10:10:36,120 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:10:36,125 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000003
2015-03-13 10:10:36,125 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000003
2015-03-13 10:10:36,125 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000003
2015-03-13 10:10:36,126 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000003
2015-03-13 10:10:36,126 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0021	CONTAINERID=container_1426266260362_0021_01_000003
2015-03-13 10:10:36,126 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:10:36,126 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0021_01_000003 from application application_1426266260362_0021
2015-03-13 10:10:36,126 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:36,126 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0021
2015-03-13 10:10:36,153 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742077_1253 src: /127.0.0.1:62611 dest: /127.0.0.1:60689
2015-03-13 10:10:36,155 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742077_1253 src: /127.0.0.1:62612 dest: /127.0.0.1:60693
2015-03-13 10:10:36,156 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742077_1253 src: /127.0.0.1:62613 dest: /127.0.0.1:60696
2015-03-13 10:10:36,164 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62613, dest: /127.0.0.1:60696, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0021_m_000002_0_-2026454953_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742077_1253, duration: 6494000
2015-03-13 10:10:36,164 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742077_1253, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:36,165 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742077_1253{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:36,165 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62612, dest: /127.0.0.1:60693, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0021_m_000002_0_-2026454953_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742077_1253, duration: 7448000
2015-03-13 10:10:36,165 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742077_1253, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:36,166 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742077_1253{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:36,166 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62611, dest: /127.0.0.1:60689, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0021_m_000002_0_-2026454953_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742077_1253, duration: 8505000
2015-03-13 10:10:36,166 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742077_1253, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:36,167 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742077_1253{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:36,171 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1426266260362_0021_m_000002_0/part-00002 is closed by DFSClient_attempt_1426266260362_0021_m_000002_0_-2026454953_1
2015-03-13 10:10:36,180 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1426266260362_0021_m_000002_0	dst=null	perm=null
2015-03-13 10:10:36,184 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1426266260362_0021_m_000002_0	dst=null	perm=null
2015-03-13 10:10:36,185 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/task_1426266260362_0021_m_000002	dst=null	perm=null
2015-03-13 10:10:36,188 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1426266260362_0021_m_000002_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/task_1426266260362_0021_m_000002	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:10:36,205 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0021_01_000004
2015-03-13 10:10:36,205 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0021	CONTAINERID=container_1426266260362_0021_01_000004
2015-03-13 10:10:36,205 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:10:36,205 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:10:36,206 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0021_01_000003
2015-03-13 10:10:36,205 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0021_01_000004
2015-03-13 10:10:36,206 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:10:36,206 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0021_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:10:36,206 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0021_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:10:36,206 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0021	CONTAINERID=container_1426266260362_0021_01_000003
2015-03-13 10:10:36,206 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0021_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:10:36,207 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:10:36,207 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0021_01_000003, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:36,207 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:36,207 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:10:36,207 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0021_000001 released container container_1426266260362_0021_01_000003 on node: host: 10.1.1.144:60711 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:10:36,209 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:36,211 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-2029422546_1
2015-03-13 10:10:36,215 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1	dst=null	perm=null
2015-03-13 10:10:36,219 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0021_01_000004 is : 143
2015-03-13 10:10:36,222 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone	dst=null	perm=null
2015-03-13 10:10:36,223 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone	dst=null	perm=null
2015-03-13 10:10:36,224 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/task_1426266260362_0021_m_000000	dst=null	perm=null
2015-03-13 10:10:36,225 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/part-00000	dst=null	perm=null
2015-03-13 10:10:36,228 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/task_1426266260362_0021_m_000000/part-00000	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/part-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:36,231 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:10:36,231 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000004
2015-03-13 10:10:36,231 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000004
2015-03-13 10:10:36,231 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000004
2015-03-13 10:10:36,232 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone	dst=null	perm=null
2015-03-13 10:10:36,232 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000004
2015-03-13 10:10:36,232 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0021	CONTAINERID=container_1426266260362_0021_01_000004
2015-03-13 10:10:36,232 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:10:36,232 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0021_01_000004 from application application_1426266260362_0021
2015-03-13 10:10:36,233 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone	dst=null	perm=null
2015-03-13 10:10:36,233 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:36,233 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0021
2015-03-13 10:10:36,234 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/task_1426266260362_0021_m_000001	dst=null	perm=null
2015-03-13 10:10:36,235 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/part-00001	dst=null	perm=null
2015-03-13 10:10:36,239 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/task_1426266260362_0021_m_000001/part-00001	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/part-00001	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:36,240 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone	dst=null	perm=null
2015-03-13 10:10:36,243 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone	dst=null	perm=null
2015-03-13 10:10:36,244 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/task_1426266260362_0021_m_000002	dst=null	perm=null
2015-03-13 10:10:36,246 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/part-00002	dst=null	perm=null
2015-03-13 10:10:36,247 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/task_1426266260362_0021_m_000002/part-00002	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/part-00002	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:36,249 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone	dst=null	perm=null
2015-03-13 10:10:36,250 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone	dst=null	perm=null
2015-03-13 10:10:36,252 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/task_1426266260362_0021_m_000003	dst=null	perm=null
2015-03-13 10:10:36,253 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/part-00003	dst=null	perm=null
2015-03-13 10:10:36,255 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/task_1426266260362_0021_m_000003/part-00003	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/part-00003	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:36,256 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone	dst=null	perm=null
2015-03-13 10:10:36,257 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone	dst=null	perm=null
2015-03-13 10:10:36,258 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/task_1426266260362_0021_m_000004	dst=null	perm=null
2015-03-13 10:10:36,259 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/part-00004	dst=null	perm=null
2015-03-13 10:10:36,261 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/task_1426266260362_0021_m_000004/part-00004	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/part-00004	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:36,265 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary	dst=null	perm=null
2015-03-13 10:10:36,270 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:36,272 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-2029422546_1
2015-03-13 10:10:36,273 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:36,275 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-2029422546_1
2015-03-13 10:10:36,288 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62600, dest: /127.0.0.1:60696, bytes: 53335, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2029422546_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742074_1250, duration: 425881000
2015-03-13 10:10:36,288 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742074_1250, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:36,289 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742074_1250{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:36,289 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62599, dest: /127.0.0.1:60693, bytes: 53335, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2029422546_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742074_1250, duration: 426885000
2015-03-13 10:10:36,289 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742074_1250, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:36,290 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742074_1250{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:36,291 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62598, dest: /127.0.0.1:60686, bytes: 53335, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2029422546_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742074_1250, duration: 428444000
2015-03-13 10:10:36,291 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742074_1250, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:36,294 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742074_1250 size 53335
2015-03-13 10:10:36,294 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job_1426266260362_0021_1.jhist is closed by DFSClient_NONMAPREDUCE_-2029422546_1
2015-03-13 10:10:36,296 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0021.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:36,298 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0021.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742078_1254{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:10:36,300 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742078_1254 src: /127.0.0.1:62614 dest: /127.0.0.1:60693
2015-03-13 10:10:36,301 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742078_1254 src: /127.0.0.1:62615 dest: /127.0.0.1:60696
2015-03-13 10:10:36,302 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742078_1254 src: /127.0.0.1:62616 dest: /127.0.0.1:60689
2015-03-13 10:10:36,305 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62616, dest: /127.0.0.1:60689, bytes: 440, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2029422546_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742078_1254, duration: 1483000
2015-03-13 10:10:36,305 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742078_1254, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:36,306 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742078_1254{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:36,306 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62615, dest: /127.0.0.1:60696, bytes: 440, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2029422546_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742078_1254, duration: 2029000
2015-03-13 10:10:36,306 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742078_1254, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:36,307 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742078_1254{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:36,307 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62614, dest: /127.0.0.1:60693, bytes: 440, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2029422546_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742078_1254, duration: 2950000
2015-03-13 10:10:36,307 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742078_1254, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:36,307 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742078_1254{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:36,309 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0021.summary_tmp is closed by DFSClient_NONMAPREDUCE_-2029422546_1
2015-03-13 10:10:36,313 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0021.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:36,319 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job_1426266260362_0021_1.jhist	dst=null	perm=null
2015-03-13 10:10:36,320 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0021-1426266621046-soberoi-%5B5665C2AB3C80426983CDE9B8E87C8DA6%2F3A3A52572DE24695-1426266636276-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:10:36,324 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job_1426266260362_0021_1.jhist	dst=null	perm=null
2015-03-13 10:10:36,325 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0021-1426266621046-soberoi-%5B5665C2AB3C80426983CDE9B8E87C8DA6%2F3A3A52572DE24695-1426266636276-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:10:36,326 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job_1426266260362_0021_1.jhist	dst=null	perm=null
2015-03-13 10:10:36,329 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0021-1426266621046-soberoi-%5B5665C2AB3C80426983CDE9B8E87C8DA6%2F3A3A52572DE24695-1426266636276-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:36,331 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62617, bytes: 53755, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-2029422546_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742074_1250, duration: 169000
2015-03-13 10:10:36,332 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0021-1426266621046-soberoi-%5B5665C2AB3C80426983CDE9B8E87C8DA6%2F3A3A52572DE24695-1426266636276-5-0-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742079_1255{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:10:36,334 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742079_1255 src: /127.0.0.1:62618 dest: /127.0.0.1:60693
2015-03-13 10:10:36,335 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742079_1255 src: /127.0.0.1:62619 dest: /127.0.0.1:60696
2015-03-13 10:10:36,337 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742079_1255 src: /127.0.0.1:62620 dest: /127.0.0.1:60689
2015-03-13 10:10:36,339 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62620, dest: /127.0.0.1:60689, bytes: 53335, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2029422546_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742079_1255, duration: 1518000
2015-03-13 10:10:36,340 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742079_1255, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:36,340 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62619, dest: /127.0.0.1:60696, bytes: 53335, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2029422546_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742079_1255, duration: 1814000
2015-03-13 10:10:36,340 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742079_1255{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:36,341 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742079_1255{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:36,341 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62618, dest: /127.0.0.1:60693, bytes: 53335, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2029422546_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742079_1255, duration: 2671000
2015-03-13 10:10:36,341 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742079_1255, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:36,340 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742079_1255, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:36,342 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742079_1255{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:36,344 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0021-1426266621046-soberoi-%5B5665C2AB3C80426983CDE9B8E87C8DA6%2F3A3A52572DE24695-1426266636276-5-0-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-2029422546_1
2015-03-13 10:10:36,345 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0021-1426266621046-soberoi-%5B5665C2AB3C80426983CDE9B8E87C8DA6%2F3A3A52572DE24695-1426266636276-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:36,346 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job_1426266260362_0021_1_conf.xml	dst=null	perm=null
2015-03-13 10:10:36,347 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0021_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:10:36,348 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job_1426266260362_0021_1_conf.xml	dst=null	perm=null
2015-03-13 10:10:36,349 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0021_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:10:36,349 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job_1426266260362_0021_1_conf.xml	dst=null	perm=null
2015-03-13 10:10:36,351 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0021_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:36,353 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62621, bytes: 91160, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-2029422546_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742072_1248, duration: 229000
2015-03-13 10:10:36,355 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0021_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742080_1256{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:10:36,357 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742080_1256 src: /127.0.0.1:62622 dest: /127.0.0.1:60693
2015-03-13 10:10:36,358 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742080_1256 src: /127.0.0.1:62623 dest: /127.0.0.1:60696
2015-03-13 10:10:36,360 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742080_1256 src: /127.0.0.1:62624 dest: /127.0.0.1:60689
2015-03-13 10:10:36,363 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62624, dest: /127.0.0.1:60689, bytes: 90452, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2029422546_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742080_1256, duration: 2297000
2015-03-13 10:10:36,364 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742080_1256, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:36,364 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742080_1256{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:36,364 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62623, dest: /127.0.0.1:60696, bytes: 90452, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2029422546_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742080_1256, duration: 2649000
2015-03-13 10:10:36,364 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742080_1256, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:36,365 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742080_1256{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:36,365 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62622, dest: /127.0.0.1:60693, bytes: 90452, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2029422546_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742080_1256, duration: 3720000
2015-03-13 10:10:36,365 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742080_1256, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:36,366 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742080_1256{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:36,367 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0021_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-2029422546_1
2015-03-13 10:10:36,369 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0021_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:36,371 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0021.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0021.summary	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:36,372 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0021_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0021_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:36,375 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0021-1426266621046-soberoi-%5B5665C2AB3C80426983CDE9B8E87C8DA6%2F3A3A52572DE24695-1426266636276-5-0-SUCCEEDED-default.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0021-1426266621046-soberoi-%5B5665C2AB3C80426983CDE9B8E87C8DA6%2F3A3A52572DE24695-1426266636276-5-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:36,382 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0021_000001 State change from RUNNING to FINISHING
2015-03-13 10:10:36,382 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0021
2015-03-13 10:10:36,382 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0021 State change from RUNNING to REMOVING
2015-03-13 10:10:36,382 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0021
2015-03-13 10:10:36,382 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0021 State change from REMOVING to FINISHING
2015-03-13 10:10:36,390 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:36,839 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:10:36,839 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0021_01_000006
2015-03-13 10:10:36,840 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0021_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:10:36,840 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0021_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:10:36,840 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0021	CONTAINERID=container_1426266260362_0021_01_000006
2015-03-13 10:10:36,840 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0021_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:10:36,840 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:10:36,840 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0021_01_000006, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:36,840 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:36,840 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:10:36,841 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0021_000001 released container container_1426266260362_0021_01_000006 on node: host: 10.1.1.144:60715 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:10:37,209 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:10:37,210 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0021_01_000004
2015-03-13 10:10:37,210 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0021_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:10:37,211 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0021_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:10:37,211 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0021	CONTAINERID=container_1426266260362_0021_01_000004
2015-03-13 10:10:37,211 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0021_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:10:37,211 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:10:37,211 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0021_01_000004, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:37,211 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:37,212 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:10:37,212 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0021_000001 released container container_1426266260362_0021_01_000004 on node: host: 10.1.1.144:60711 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:10:37,388 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742068_1244 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60689 
2015-03-13 10:10:37,388 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742069_1245 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60693 127.0.0.1:60686 
2015-03-13 10:10:37,388 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742070_1246 127.0.0.1:60686 127.0.0.1:60693 127.0.0.1:60696 
2015-03-13 10:10:37,388 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742071_1247 127.0.0.1:60689 127.0.0.1:60693 127.0.0.1:60686 
2015-03-13 10:10:37,388 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742074_1250 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60686 
2015-03-13 10:10:37,389 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742072_1248 127.0.0.1:60686 127.0.0.1:60693 127.0.0.1:60689 
2015-03-13 10:10:37,389 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021	dst=null	perm=null
2015-03-13 10:10:37,395 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:37,421 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone	dst=null	perm=null
2015-03-13 10:10:37,422 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary
2015-03-13 10:10:37,422 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary	dst=null	perm=null
2015-03-13 10:10:37,429 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:10:37,429 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:10:37,429 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:10:37,430 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone	dst=null	perm=null
2015-03-13 10:10:37,431 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone	dst=null	perm=null
2015-03-13 10:10:37,431 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone	dst=null	perm=null
2015-03-13 10:10:37,433 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:10:37,433 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/part-00000	dst=null	perm=null
2015-03-13 10:10:37,435 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62626, bytes: 84, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742073_1249, duration: 146000
2015-03-13 10:10:37,436 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/part-00001	dst=null	perm=null
2015-03-13 10:10:37,437 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62627, bytes: 44, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742076_1252, duration: 150000
2015-03-13 10:10:37,438 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/part-00002	dst=null	perm=null
2015-03-13 10:10:37,439 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62627, bytes: 44, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742077_1253, duration: 161000
2015-03-13 10:10:37,440 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/part-00003	dst=null	perm=null
2015-03-13 10:10:37,442 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62628, bytes: 44, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742075_1251, duration: 148000
2015-03-13 10:10:37,442 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/part-00004	dst=null	perm=null
2015-03-13 10:10:37,449 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:10:37,449 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:10:37,450 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:10:37,451 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone	dst=null	perm=null
2015-03-13 10:10:37,451 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone	dst=null	perm=null
2015-03-13 10:10:37,452 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone	dst=null	perm=null
2015-03-13 10:10:37,453 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:10:37,454 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/part-00000	dst=null	perm=null
2015-03-13 10:10:37,456 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62629, bytes: 84, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742073_1249, duration: 121000
2015-03-13 10:10:37,457 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/part-00001	dst=null	perm=null
2015-03-13 10:10:37,458 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62628, bytes: 44, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742076_1252, duration: 115000
2015-03-13 10:10:37,458 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/part-00002	dst=null	perm=null
2015-03-13 10:10:37,459 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62628, bytes: 44, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742077_1253, duration: 122000
2015-03-13 10:10:37,460 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/part-00003	dst=null	perm=null
2015-03-13 10:10:37,461 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62628, bytes: 44, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742075_1251, duration: 148000
2015-03-13 10:10:37,462 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/part-00004	dst=null	perm=null
2015-03-13 10:10:37,462 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/joinnone
2015-03-13 10:10:37,463 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone	dst=null	perm=null
2015-03-13 10:10:37,463 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone	dst=null	perm=null
2015-03-13 10:10:37,464 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone	dst=null	perm=null
2015-03-13 10:10:37,464 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone	dst=null	perm=null
2015-03-13 10:10:37,465 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/part-00000	dst=null	perm=null
2015-03-13 10:10:37,465 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/part-00000	dst=null	perm=null
2015-03-13 10:10:37,467 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62628, bytes: 84, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742073_1249, duration: 169000
2015-03-13 10:10:37,467 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/part-00001	dst=null	perm=null
2015-03-13 10:10:37,475 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/part-00001	dst=null	perm=null
2015-03-13 10:10:37,476 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62627, bytes: 44, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742076_1252, duration: 147000
2015-03-13 10:10:37,477 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/part-00002	dst=null	perm=null
2015-03-13 10:10:37,478 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/part-00002	dst=null	perm=null
2015-03-13 10:10:37,479 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62627, bytes: 44, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742077_1253, duration: 172000
2015-03-13 10:10:37,480 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/part-00003	dst=null	perm=null
2015-03-13 10:10:37,480 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/part-00003	dst=null	perm=null
2015-03-13 10:10:37,481 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62628, bytes: 44, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742075_1251, duration: 175000
2015-03-13 10:10:37,482 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/part-00004	dst=null	perm=null
2015-03-13 10:10:37,483 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/part-00004	dst=null	perm=null
2015-03-13 10:10:37,484 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:10:37,493 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:10:37,494 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:10:37,494 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:10:37,507 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself	dst=null	perm=null
2015-03-13 10:10:37,509 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting
2015-03-13 10:10:37,509 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-03-13 10:10:37,509 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-03-13 10:10:37,509 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself"]
2015-03-13 10:10:37,509 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  parallel execution is enabled: true
2015-03-13 10:10:37,509 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  starting jobs: 2
2015-03-13 10:10:37,509 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  allocating threads: 2
2015-03-13 10:10:37,510 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (2/2)
2015-03-13 10:10:37,518 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:10:37,527 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:10:37,528 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703	dst=null	perm=null
2015-03-13 10:10:37,529 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:10:37,529 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:10:37,531 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 22
2015-03-13 10:10:37,532 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022	dst=null	perm=null
2015-03-13 10:10:37,533 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022	dst=null	perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:10:37,534 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022	dst=null	perm=soberoi:supergroup:rwx------
2015-03-13 10:10:37,534 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.jar	dst=null	perm=null
2015-03-13 10:10:37,535 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:37,537 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073742081_1257{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:10:37,538 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742081_1257 src: /127.0.0.1:62631 dest: /127.0.0.1:60693
2015-03-13 10:10:37,539 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742081_1257 src: /127.0.0.1:62632 dest: /127.0.0.1:60696
2015-03-13 10:10:37,540 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742081_1257 src: /127.0.0.1:62633 dest: /127.0.0.1:60689
2015-03-13 10:10:37,544 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62633, dest: /127.0.0.1:60689, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742081_1257, duration: 2722000
2015-03-13 10:10:37,544 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742081_1257, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:37,544 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742081_1257{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:37,544 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62632, dest: /127.0.0.1:60696, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742081_1257, duration: 2555000
2015-03-13 10:10:37,545 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742081_1257, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:37,545 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742081_1257{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:37,545 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62631, dest: /127.0.0.1:60693, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742081_1257, duration: 3378000
2015-03-13 10:10:37,545 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742081_1257, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:37,546 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742081_1257{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:37,546 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:10:37,547 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.jar
2015-03-13 10:10:37,547 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.jar	dst=null	perm=null
2015-03-13 10:10:37,548 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:37,549 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:10:37,549 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:10:37,550 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:10:37,550 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:10:37,551 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:10:37,551 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:10:37,552 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:10:37,552 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:10:37,553 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:10:37,554 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:10:37,554 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:10:37,555 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:10:37,557 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:37,559 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:37,560 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.split
2015-03-13 10:10:37,560 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.split	dst=null	perm=null
2015-03-13 10:10:37,561 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073742082_1258{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:10:37,562 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742082_1258 src: /127.0.0.1:62634 dest: /127.0.0.1:60696
2015-03-13 10:10:37,564 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742082_1258 src: /127.0.0.1:62635 dest: /127.0.0.1:60686
2015-03-13 10:10:37,565 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742082_1258 src: /127.0.0.1:62636 dest: /127.0.0.1:60689
2015-03-13 10:10:37,566 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742082_1258 src: /127.0.0.1:62637 dest: /127.0.0.1:60693
2015-03-13 10:10:37,569 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62637, dest: /127.0.0.1:60693, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742082_1258, duration: 1346000
2015-03-13 10:10:37,569 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742082_1258, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:37,569 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742082_1258{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:37,570 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62636, dest: /127.0.0.1:60689, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742082_1258, duration: 1799000
2015-03-13 10:10:37,570 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742082_1258, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:37,570 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742082_1258{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:37,570 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62635, dest: /127.0.0.1:60686, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742082_1258, duration: 2626000
2015-03-13 10:10:37,570 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742082_1258, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:37,571 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742082_1258{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:37,571 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62634, dest: /127.0.0.1:60696, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742082_1258, duration: 3480000
2015-03-13 10:10:37,571 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742082_1258, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:37,571 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742082_1258{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:37,573 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:10:37,574 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:37,576 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:37,577 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073742083_1259{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:10:37,578 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742083_1259 src: /127.0.0.1:62638 dest: /127.0.0.1:60696
2015-03-13 10:10:37,580 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742083_1259 src: /127.0.0.1:62639 dest: /127.0.0.1:60686
2015-03-13 10:10:37,581 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742083_1259 src: /127.0.0.1:62640 dest: /127.0.0.1:60689
2015-03-13 10:10:37,583 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62640, dest: /127.0.0.1:60689, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742083_1259, duration: 1123000
2015-03-13 10:10:37,583 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742083_1259, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:37,583 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742083_1259{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:37,584 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62639, dest: /127.0.0.1:60686, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742083_1259, duration: 1594000
2015-03-13 10:10:37,584 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742083_1259, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:37,584 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742083_1259{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:37,584 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62638, dest: /127.0.0.1:60696, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742083_1259, duration: 2060000
2015-03-13 10:10:37,584 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742083_1259, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:37,585 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742083_1259{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:37,586 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:10:37,586 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:10:37,587 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:37,588 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:37,589 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:10:37,589 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:10:37,590 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:10:37,593 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742084_1260{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:10:37,594 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742084_1260 src: /127.0.0.1:62641 dest: /127.0.0.1:60696
2015-03-13 10:10:37,595 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742084_1260 src: /127.0.0.1:62642 dest: /127.0.0.1:60686
2015-03-13 10:10:37,596 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742084_1260 src: /127.0.0.1:62643 dest: /127.0.0.1:60693
2015-03-13 10:10:37,598 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62643, dest: /127.0.0.1:60693, bytes: 96425, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742084_1260, duration: 1642000
2015-03-13 10:10:37,599 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742084_1260, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:37,599 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742084_1260{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:37,599 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62642, dest: /127.0.0.1:60686, bytes: 96425, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742084_1260, duration: 2106000
2015-03-13 10:10:37,599 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742084_1260, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:37,600 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742084_1260{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:37,600 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62641, dest: /127.0.0.1:60696, bytes: 96425, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742084_1260, duration: 2917000
2015-03-13 10:10:37,600 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742084_1260, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:37,600 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742084_1260{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:37,601 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:10:37,601 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0022
2015-03-13 10:10:37,602 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022	dst=null	perm=null
2015-03-13 10:10:37,603 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.xml	dst=null	perm=null
2015-03-13 10:10:37,603 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.xml	dst=null	perm=null
2015-03-13 10:10:37,604 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.jar	dst=null	perm=null
2015-03-13 10:10:37,605 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.jar	dst=null	perm=null
2015-03-13 10:10:37,605 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.split	dst=null	perm=null
2015-03-13 10:10:37,606 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.split	dst=null	perm=null
2015-03-13 10:10:37,607 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:10:37,607 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:10:37,609 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:10:37,610 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:10:37,611 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:10:37,611 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:10:37,612 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:10:37,613 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:10:37,614 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 22 submitted by user soberoi
2015-03-13 10:10:37,614 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0022
2015-03-13 10:10:37,615 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0022 State change from NEW to NEW_SAVING
2015-03-13 10:10:37,615 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0022
2015-03-13 10:10:37,614 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	IP=10.1.1.144	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1426266260362_0022
2015-03-13 10:10:37,615 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0022 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:10:37,615 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0022_000001
2015-03-13 10:10:37,615 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0022_000001 State change from NEW to SUBMITTED
2015-03-13 10:10:37,615 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0022 from user: soberoi activated in queue: default
2015-03-13 10:10:37,615 INFO  capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0022 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:10:37,616 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0022 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:10:37,616 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0022 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:10:37,616 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0022_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:10:37,616 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0022_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:10:37,617 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0022 State change from SUBMITTED to ACCEPTED
2015-03-13 10:10:37,618 INFO  mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0022/
2015-03-13 10:10:37,619 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1426266260362_0022
2015-03-13 10:10:37,619 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0022/
2015-03-13 10:10:37,843 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0022_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:10:37,843 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0022	CONTAINERID=container_1426266260362_0022_01_000001
2015-03-13 10:10:37,844 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0022_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:10:37,844 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0022 container=Container: [ContainerId: container_1426266260362_0022_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0022_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:37,844 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:10:37,844 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:37,844 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0022_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:10:37,845 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0022 AttemptId: appattempt_1426266260362_0022_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0022_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ]
2015-03-13 10:10:37,845 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0022_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:10:37,845 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0022_000001
2015-03-13 10:10:37,846 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0022_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:10:37,846 INFO  amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0022_000001
2015-03-13 10:10:37,846 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0022_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] for AM appattempt_1426266260362_0022_000001
2015-03-13 10:10:37,846 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0022_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-03-13 10:10:37,848 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0022_000001 (auth:SIMPLE)
2015-03-13 10:10:37,850 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0022_01_000001 by user soberoi
2015-03-13 10:10:37,850 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0022
2015-03-13 10:10:37,850 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0022	CONTAINERID=container_1426266260362_0022_01_000001
2015-03-13 10:10:37,850 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0022 transitioned from NEW to INITING
2015-03-13 10:10:37,850 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0022_01_000001 to application application_1426266260362_0022
2015-03-13 10:10:37,851 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0022 transitioned from INITING to RUNNING
2015-03-13 10:10:37,851 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0022_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] for AM appattempt_1426266260362_0022_000001
2015-03-13 10:10:37,851 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0022_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:10:37,851 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:10:37,851 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0022
2015-03-13 10:10:37,851 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:10:37,851 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:10:37,851 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:10:37,852 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:10:37,852 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0022_01_000001
2015-03-13 10:10:37,861 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0022_01_000001.tokens. Credentials list: 
2015-03-13 10:10:37,876 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:10:37,943 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0022_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000001.tokens
2015-03-13 10:10:37,943 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0022 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0022
2015-03-13 10:10:38,003 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.jar	dst=null	perm=null
2015-03-13 10:10:38,004 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.jar	dst=null	perm=null
2015-03-13 10:10:38,005 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.jar	dst=null	perm=null
2015-03-13 10:10:38,010 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62627, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-814663355_11605, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742081_1257, duration: 479000
2015-03-13 10:10:38,028 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:38,043 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:10:38,044 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:10:38,045 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:10:38,050 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62627, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-814663355_11605, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742083_1259, duration: 211000
2015-03-13 10:10:38,062 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:38,079 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.split	dst=null	perm=null
2015-03-13 10:10:38,079 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.split	dst=null	perm=null
2015-03-13 10:10:38,080 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.split	dst=null	perm=null
2015-03-13 10:10:38,085 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62629, bytes: 1798, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-814663355_11605, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742082_1258, duration: 159000
2015-03-13 10:10:38,097 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:38,113 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.xml	dst=null	perm=null
2015-03-13 10:10:38,114 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.xml	dst=null	perm=null
2015-03-13 10:10:38,114 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.xml	dst=null	perm=null
2015-03-13 10:10:38,120 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62626, bytes: 97181, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-814663355_11605, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742084_1260, duration: 269000
2015-03-13 10:10:38,132 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:38,133 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:10:38,157 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:10:38,157 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:38,224 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000001/default_container_executor.sh]
2015-03-13 10:10:38,399 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:38,848 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:38,849 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0022_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:10:38,875 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742079_1255
2015-03-13 10:10:38,875 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742073_1249
2015-03-13 10:10:38,875 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742080_1256
2015-03-13 10:10:38,877 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742076_1252
2015-03-13 10:10:38,878 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742078_1254
2015-03-13 10:10:38,878 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742075_1251
2015-03-13 10:10:39,079 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742081_1257
2015-03-13 10:10:39,080 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742074_1250
2015-03-13 10:10:39,081 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742084_1260
2015-03-13 10:10:39,081 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742077_1253
2015-03-13 10:10:39,082 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742081_1257
2015-03-13 10:10:39,083 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742083_1259
2015-03-13 10:10:39,083 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742077_1253
2015-03-13 10:10:39,084 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742079_1255
2015-03-13 10:10:39,084 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742082_1258
2015-03-13 10:10:39,279 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742080_1256
2015-03-13 10:10:39,280 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742082_1258
2015-03-13 10:10:39,280 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742076_1252
2015-03-13 10:10:39,280 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742078_1254
2015-03-13 10:10:39,280 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742075_1251
2015-03-13 10:10:39,404 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:39,430 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742082_1258
2015-03-13 10:10:39,430 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742074_1250
2015-03-13 10:10:39,431 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742073_1249
2015-03-13 10:10:39,431 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742083_1259
2015-03-13 10:10:39,432 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742084_1260
2015-03-13 10:10:39,632 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742078_1254
2015-03-13 10:10:39,632 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742075_1251
2015-03-13 10:10:39,632 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742077_1253
2015-03-13 10:10:39,632 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742083_1259
2015-03-13 10:10:39,633 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742082_1258
2015-03-13 10:10:39,633 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742074_1250
2015-03-13 10:10:39,633 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742076_1252
2015-03-13 10:10:39,773 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:10:39,793 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/COMMIT_STARTED	dst=null	perm=null
2015-03-13 10:10:39,794 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/COMMIT_SUCCESS	dst=null	perm=null
2015-03-13 10:10:39,795 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/COMMIT_FAIL	dst=null	perm=null
2015-03-13 10:10:39,835 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742081_1257
2015-03-13 10:10:39,836 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742073_1249
2015-03-13 10:10:39,836 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742080_1256
2015-03-13 10:10:39,846 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022	dst=null	perm=null
2015-03-13 10:10:39,847 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:10:39,848 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:10:39,849 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:39,962 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60693 to replicate blk_1073742081_1257 to datanode(s) 127.0.0.1:60686
2015-03-13 10:10:39,962 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073742068_1244, blk_1073742069_1245, blk_1073742070_1246, blk_1073742071_1247, blk_1073742072_1248, blk_1073742074_1250]
2015-03-13 10:10:39,962 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073742068_1244, blk_1073742069_1245, blk_1073742070_1246, blk_1073742074_1250]
2015-03-13 10:10:40,038 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742079_1255
2015-03-13 10:10:40,039 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742084_1260
2015-03-13 10:10:40,125 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:10:40,132 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:10:40,188 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62648, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-504580455_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742083_1259, duration: 125000
2015-03-13 10:10:40,409 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:40,565 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742068_1244 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742068 for deletion
2015-03-13 10:10:40,565 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742069_1245 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742069 for deletion
2015-03-13 10:10:40,565 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742070_1246 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742070 for deletion
2015-03-13 10:10:40,565 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742068_1244 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742068
2015-03-13 10:10:40,565 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742071_1247 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742071 for deletion
2015-03-13 10:10:40,566 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742069_1245 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742069
2015-03-13 10:10:40,566 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742072_1248 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742072 for deletion
2015-03-13 10:10:40,566 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742070_1246 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742070
2015-03-13 10:10:40,566 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742071_1247 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742071
2015-03-13 10:10:40,566 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742074_1250 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742074 for deletion
2015-03-13 10:10:40,566 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742072_1248 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742072
2015-03-13 10:10:40,566 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742074_1250 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742074
2015-03-13 10:10:40,764 INFO  datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-1589780806-10.1.1.144-60693-1426266259390, infoPort=60694, ipcPort=60695, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073742081_1257 to 127.0.0.1:60686 
2015-03-13 10:10:40,765 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742081_1257 src: /127.0.0.1:62651 dest: /127.0.0.1:60686
2015-03-13 10:10:40,765 INFO  datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073742081_1257 (numBytes=254067) to /127.0.0.1:60686
2015-03-13 10:10:40,767 INFO  datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073742081_1257 src: /127.0.0.1:62651 dest: /127.0.0.1:60686 of size 254067
2015-03-13 10:10:40,767 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742081_1257 size 254067
2015-03-13 10:10:40,854 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:40,939 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742068_1244 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742068 for deletion
2015-03-13 10:10:40,939 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742069_1245 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742069 for deletion
2015-03-13 10:10:40,939 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742070_1246 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742070 for deletion
2015-03-13 10:10:40,940 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742068_1244 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742068
2015-03-13 10:10:40,940 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742069_1245 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742069
2015-03-13 10:10:40,940 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742074_1250 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742074 for deletion
2015-03-13 10:10:40,940 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742070_1246 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742070
2015-03-13 10:10:40,940 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742074_1250 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742074
2015-03-13 10:10:40,983 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0022_000001 (auth:SIMPLE)
2015-03-13 10:10:40,985 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0022_000001
2015-03-13 10:10:40,985 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi	IP=10.1.1.144	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1426266260362_0022	APPATTEMPTID=appattempt_1426266260362_0022_000001
2015-03-13 10:10:40,985 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0022_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:10:40,985 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0022 State change from ACCEPTED to RUNNING
2015-03-13 10:10:41,004 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job_1426266260362_0022_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:41,005 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:10:41,075 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job_1426266260362_0022_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:41,203 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job_1426266260362_0022_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742085_1261{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:10:41,250 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742085_1261 src: /127.0.0.1:62655 dest: /127.0.0.1:60693
2015-03-13 10:10:41,252 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742085_1261 src: /127.0.0.1:62656 dest: /127.0.0.1:60696
2015-03-13 10:10:41,253 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742085_1261 src: /127.0.0.1:62657 dest: /127.0.0.1:60686
2015-03-13 10:10:41,260 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62657, dest: /127.0.0.1:60686, bytes: 89339, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-504580455_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742085_1261, duration: 5486000
2015-03-13 10:10:41,260 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742085_1261, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:41,260 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742085_1261{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:10:41,261 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62656, dest: /127.0.0.1:60696, bytes: 89339, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-504580455_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742085_1261, duration: 6155000
2015-03-13 10:10:41,261 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742085_1261, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:41,261 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742085_1261{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:10:41,261 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62655, dest: /127.0.0.1:60693, bytes: 89339, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-504580455_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742085_1261, duration: 7145000
2015-03-13 10:10:41,262 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742085_1261, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:41,262 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742085_1261{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:10:41,266 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job_1426266260362_0022_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-504580455_1
2015-03-13 10:10:41,411 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:41,855 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:42,219 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0022_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:10:42,219 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0022	CONTAINERID=container_1426266260362_0022_01_000002
2015-03-13 10:10:42,219 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0022_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:10:42,219 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0022 container=Container: [ContainerId: container_1426266260362_0022_01_000002, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0022_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:42,220 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:10:42,220 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:42,220 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0022_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:10:42,220 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0022	CONTAINERID=container_1426266260362_0022_01_000003
2015-03-13 10:10:42,220 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0022_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:10:42,221 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0022 container=Container: [ContainerId: container_1426266260362_0022_01_000003, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0022_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:42,221 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:10:42,221 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:42,221 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0022_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:10:42,221 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0022	CONTAINERID=container_1426266260362_0022_01_000004
2015-03-13 10:10:42,221 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0022_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:10:42,221 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0022 container=Container: [ContainerId: container_1426266260362_0022_01_000004, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0022_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:42,222 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:10:42,222 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:42,222 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0022_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:10:42,222 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0022	CONTAINERID=container_1426266260362_0022_01_000005
2015-03-13 10:10:42,222 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0022_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:10:42,222 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0022 container=Container: [ContainerId: container_1426266260362_0022_01_000005, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0022_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:42,222 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:10:42,222 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:42,412 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:42,413 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0022_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:10:42,413 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0022	CONTAINERID=container_1426266260362_0022_01_000006
2015-03-13 10:10:42,413 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0022_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:10:42,413 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0022 container=Container: [ContainerId: container_1426266260362_0022_01_000006, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0022_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:42,414 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7
2015-03-13 10:10:42,414 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:42,526 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0021_01_000001 succeeded 
2015-03-13 10:10:42,527 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:10:42,527 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0021_01_000001
2015-03-13 10:10:42,534 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000001
2015-03-13 10:10:42,534 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000001
2015-03-13 10:10:42,534 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0021	CONTAINERID=container_1426266260362_0021_01_000001
2015-03-13 10:10:42,534 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:10:42,534 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000001
2015-03-13 10:10:42,534 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0021_01_000001 from application application_1426266260362_0021
2015-03-13 10:10:42,534 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:42,534 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0021
2015-03-13 10:10:42,534 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000001
2015-03-13 10:10:42,856 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:42,963 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073742068_1244, blk_1073742069_1245, blk_1073742071_1247, blk_1073742072_1248]
2015-03-13 10:10:42,963 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073742068_1244, blk_1073742069_1245, blk_1073742070_1246, blk_1073742071_1247, blk_1073742072_1248, blk_1073742074_1250]
2015-03-13 10:10:43,014 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0022_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:10:43,014 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0022_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:10:43,014 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0022_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:10:43,015 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0022_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:10:43,015 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0022_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:10:43,041 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.jar	dst=null	perm=null
2015-03-13 10:10:43,042 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.jar	dst=null	perm=null
2015-03-13 10:10:43,051 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.xml	dst=null	perm=null
2015-03-13 10:10:43,051 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.xml	dst=null	perm=null
2015-03-13 10:10:43,054 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:10:43,055 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:10:43,060 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:10:43,061 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:10:43,063 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:10:43,064 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:10:43,136 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0022_000001 (auth:SIMPLE)
2015-03-13 10:10:43,136 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0022_000001 (auth:SIMPLE)
2015-03-13 10:10:43,139 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0022_01_000002 by user soberoi
2015-03-13 10:10:43,140 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0022_01_000005 by user soberoi
2015-03-13 10:10:43,140 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0022	CONTAINERID=container_1426266260362_0022_01_000005
2015-03-13 10:10:43,140 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0022_01_000005 to application application_1426266260362_0022
2015-03-13 10:10:43,140 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0022_01_000006 by user soberoi
2015-03-13 10:10:43,140 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0022
2015-03-13 10:10:43,141 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0022	CONTAINERID=container_1426266260362_0022_01_000002
2015-03-13 10:10:43,141 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0022_01_000003 by user soberoi
2015-03-13 10:10:43,141 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0022
2015-03-13 10:10:43,141 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0022	CONTAINERID=container_1426266260362_0022_01_000003
2015-03-13 10:10:43,141 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0022	CONTAINERID=container_1426266260362_0022_01_000006
2015-03-13 10:10:43,141 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0022_01_000004 by user soberoi
2015-03-13 10:10:43,141 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0022 transitioned from NEW to INITING
2015-03-13 10:10:43,141 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0022_01_000006 to application application_1426266260362_0022
2015-03-13 10:10:43,142 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0022 transitioned from INITING to RUNNING
2015-03-13 10:10:43,142 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:10:43,142 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0022
2015-03-13 10:10:43,142 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0022
2015-03-13 10:10:43,142 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:10:43,142 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0022
2015-03-13 10:10:43,142 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:10:43,142 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:10:43,142 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0022_01_000006
2015-03-13 10:10:43,141 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0022 transitioned from NEW to INITING
2015-03-13 10:10:43,143 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0022_01_000002 to application application_1426266260362_0022
2015-03-13 10:10:43,143 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0022_01_000003 to application application_1426266260362_0022
2015-03-13 10:10:43,141 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0022	CONTAINERID=container_1426266260362_0022_01_000004
2015-03-13 10:10:43,143 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0022_01_000004 to application application_1426266260362_0022
2015-03-13 10:10:43,143 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0022 transitioned from INITING to RUNNING
2015-03-13 10:10:43,144 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:10:43,144 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:10:43,144 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:10:43,144 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:10:43,144 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0022
2015-03-13 10:10:43,144 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0022
2015-03-13 10:10:43,144 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:10:43,144 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0022
2015-03-13 10:10:43,144 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:10:43,145 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:10:43,145 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0022
2015-03-13 10:10:43,145 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0022
2015-03-13 10:10:43,145 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:10:43,145 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0022
2015-03-13 10:10:43,145 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0022
2015-03-13 10:10:43,145 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0022
2015-03-13 10:10:43,145 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:10:43,145 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0022
2015-03-13 10:10:43,146 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0022
2015-03-13 10:10:43,146 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0022
2015-03-13 10:10:43,146 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:10:43,146 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0022
2015-03-13 10:10:43,146 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0022_01_000003
2015-03-13 10:10:43,147 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0022_01_000004
2015-03-13 10:10:43,147 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0022_01_000002
2015-03-13 10:10:43,150 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0022_01_000005
2015-03-13 10:10:43,159 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426266260362_0022_01_000006.tokens. Credentials list: 
2015-03-13 10:10:43,168 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1426266260362_0022_01_000003.tokens. Credentials list: 
2015-03-13 10:10:43,168 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1426266260362_0022_01_000002.tokens. Credentials list: 
2015-03-13 10:10:43,168 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1426266260362_0022_01_000004.tokens. Credentials list: 
2015-03-13 10:10:43,169 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0022_01_000005.tokens. Credentials list: 
2015-03-13 10:10:43,183 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:10:43,187 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:10:43,219 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:43,219 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:43,220 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:43,220 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:43,220 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0022_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:10:43,220 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0022_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:10:43,220 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0022_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:10:43,220 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0022_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:10:43,259 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426266260362_0022_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000006.tokens
2015-03-13 10:10:43,259 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0022 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0022
2015-03-13 10:10:43,264 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1426266260362_0022_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000003.tokens
2015-03-13 10:10:43,264 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0022 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0022
2015-03-13 10:10:43,335 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.jar	dst=null	perm=null
2015-03-13 10:10:43,336 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.jar	dst=null	perm=null
2015-03-13 10:10:43,337 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.jar	dst=null	perm=null
2015-03-13 10:10:43,339 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.jar	dst=null	perm=null
2015-03-13 10:10:43,340 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.jar	dst=null	perm=null
2015-03-13 10:10:43,341 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.jar	dst=null	perm=null
2015-03-13 10:10:43,344 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62664, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1681704845_11748, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742081_1257, duration: 414000
2015-03-13 10:10:43,348 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62665, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1786177933_11751, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742081_1257, duration: 424000
2015-03-13 10:10:43,366 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:43,371 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:43,389 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.xml	dst=null	perm=null
2015-03-13 10:10:43,389 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.xml	dst=null	perm=null
2015-03-13 10:10:43,390 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.xml	dst=null	perm=null
2015-03-13 10:10:43,393 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.xml	dst=null	perm=null
2015-03-13 10:10:43,394 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.xml	dst=null	perm=null
2015-03-13 10:10:43,394 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.xml	dst=null	perm=null
2015-03-13 10:10:43,397 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62666, bytes: 97181, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1681704845_11748, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742084_1260, duration: 308000
2015-03-13 10:10:43,402 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62664, bytes: 97181, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1786177933_11751, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742084_1260, duration: 271000
2015-03-13 10:10:43,412 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:43,412 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:10:43,413 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:10:43,413 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0021_01_000001
2015-03-13 10:10:43,413 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:43,413 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0022_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:10:43,414 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0021_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:10:43,414 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0021_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:10:43,414 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0021	CONTAINERID=container_1426266260362_0021_01_000001
2015-03-13 10:10:43,414 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0021_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:10:43,414 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:7168, vCores:6> numContainers=6 user=soberoi user-resources=<memory:7168, vCores:6>
2015-03-13 10:10:43,414 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0021_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:43,414 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:43,414 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6
2015-03-13 10:10:43,414 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0021_000001 released container container_1426266260362_0021_01_000001 on node: host: 10.1.1.144:60723 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:10:43,414 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0021_000001
2015-03-13 10:10:43,415 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0021_000001 State change from FINISHING to FINISHED
2015-03-13 10:10:43,415 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0021 State change from FINISHING to FINISHED
2015-03-13 10:10:43,415 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1426266260362_0021
2015-03-13 10:10:43,415 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0021,name=[5665C2AB3C80426983CDE9B8E87C8DA6/3A3A52572DE2469599E707FB097F70CF] lower*upper/(1/1) ...dedpipesplatform/joinnone,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0021/jobhistory/job/job_1426266260362_0021,appMasterHost=Edinburgh.local,startTime=1426266621046,finishTime=1426266636382,finalStatus=SUCCEEDED
2015-03-13 10:10:43,415 INFO  capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0021_000001 is done. finalState=FINISHED
2015-03-13 10:10:43,415 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0021 requests cleared
2015-03-13 10:10:43,415 INFO  capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0021 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:10:43,415 INFO  capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0021 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:10:43,416 INFO  amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0021_000001
2015-03-13 10:10:43,418 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0021_000001 (auth:SIMPLE)
2015-03-13 10:10:43,419 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:43,419 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:10:43,419 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:10:43,419 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:10:43,419 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:10:43,419 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0021_01_000001
2015-03-13 10:10:43,464 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:10:43,464 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:43,465 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:10:43,465 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:43,470 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:10:43,470 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:43,472 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:10:43,472 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:43,472 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:10:43,473 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:43,564 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742068_1244 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742068 for deletion
2015-03-13 10:10:43,565 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742069_1245 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742069 for deletion
2015-03-13 10:10:43,565 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742071_1247 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742071 for deletion
2015-03-13 10:10:43,565 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742072_1248 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742072 for deletion
2015-03-13 10:10:43,565 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742068_1244 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742068
2015-03-13 10:10:43,565 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742071_1247 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742071
2015-03-13 10:10:43,565 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742069_1245 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742069
2015-03-13 10:10:43,565 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742072_1248 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742072
2015-03-13 10:10:43,600 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000004/default_container_executor.sh]
2015-03-13 10:10:43,607 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000002/default_container_executor.sh]
2015-03-13 10:10:43,607 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000006/default_container_executor.sh]
2015-03-13 10:10:43,620 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000005/default_container_executor.sh]
2015-03-13 10:10:43,625 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000003/default_container_executor.sh]
2015-03-13 10:10:43,765 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742068_1244 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742068 for deletion
2015-03-13 10:10:43,765 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742069_1245 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742069 for deletion
2015-03-13 10:10:43,765 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742070_1246 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742070 for deletion
2015-03-13 10:10:43,765 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742071_1247 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742071 for deletion
2015-03-13 10:10:43,765 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742068_1244 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742068
2015-03-13 10:10:43,765 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742072_1248 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742072 for deletion
2015-03-13 10:10:43,765 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742074_1250 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742074 for deletion
2015-03-13 10:10:43,765 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742069_1245 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742069
2015-03-13 10:10:43,765 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742070_1246 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742070
2015-03-13 10:10:43,765 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742071_1247 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742071
2015-03-13 10:10:43,766 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742072_1248 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742072
2015-03-13 10:10:43,766 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742074_1250 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742074
2015-03-13 10:10:43,858 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:43,859 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0021 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:10:43,859 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0021
2015-03-13 10:10:43,859 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0021
2015-03-13 10:10:43,859 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0021
2015-03-13 10:10:43,859 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0021 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:10:43,859 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0021, with delay of 10800 seconds
2015-03-13 10:10:43,859 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0021
2015-03-13 10:10:43,859 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0021
2015-03-13 10:10:44,030 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:10:44,223 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:44,224 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:44,224 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:44,224 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:44,224 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0021 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:10:44,224 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0021
2015-03-13 10:10:44,224 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0021
2015-03-13 10:10:44,225 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0021
2015-03-13 10:10:44,225 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0021
2015-03-13 10:10:44,225 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0021
2015-03-13 10:10:44,225 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0021 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:10:44,225 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0021, with delay of 10800 seconds
2015-03-13 10:10:44,286 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742085_1261
2015-03-13 10:10:44,418 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:44,419 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0021 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:10:44,419 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0021
2015-03-13 10:10:44,419 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0021
2015-03-13 10:10:44,419 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0021
2015-03-13 10:10:44,420 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0021
2015-03-13 10:10:44,420 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0021 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:10:44,421 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0021, with delay of 10800 seconds
2015-03-13 10:10:44,420 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0021
2015-03-13 10:10:44,435 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742085_1261
2015-03-13 10:10:44,437 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742081_1257
2015-03-13 10:10:44,450 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:10:44,583 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0022_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000005.tokens
2015-03-13 10:10:44,583 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0022 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0022
2015-03-13 10:10:44,685 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:10:44,806 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1426266260362_0022_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000004.tokens
2015-03-13 10:10:44,807 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0022 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0022
2015-03-13 10:10:44,860 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:44,923 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:10:45,044 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1426266260362_0022_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000002.tokens
2015-03-13 10:10:45,044 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742085_1261
2015-03-13 10:10:45,044 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0022 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0022
2015-03-13 10:10:45,229 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:45,229 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:45,229 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:45,230 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:45,422 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:45,863 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:46,230 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:46,231 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:46,231 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:46,231 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:46,423 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:46,865 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:47,236 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:47,236 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:47,236 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:47,236 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:47,428 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:47,869 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:48,238 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:48,238 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:48,239 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:48,239 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:48,432 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:48,870 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:49,244 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:49,244 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:49,245 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:49,245 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:49,434 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:49,874 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:50,248 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:50,248 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:50,248 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:50,249 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:50,437 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:50,879 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:51,183 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.split	dst=null	perm=null
2015-03-13 10:10:51,252 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:51,252 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:51,252 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:51,252 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:51,414 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.split	dst=null	perm=null
2015-03-13 10:10:51,424 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.split	dst=null	perm=null
2015-03-13 10:10:51,441 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:51,449 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.split	dst=null	perm=null
2015-03-13 10:10:51,483 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62677, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0022_m_000004_0_-271737584_1, offset: 1024, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742082_1258, duration: 169000
2015-03-13 10:10:51,534 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.split	dst=null	perm=null
2015-03-13 10:10:51,584 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62682, bytes: 1282, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0022_m_000002_0_-875840111_1, offset: 512, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742082_1258, duration: 157000
2015-03-13 10:10:51,595 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62683, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0022_m_000003_0_1696893016_1, offset: 1024, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742082_1258, duration: 172000
2015-03-13 10:10:51,615 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62684, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0022_m_000000_0_-366512103_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742082_1258, duration: 149000
2015-03-13 10:10:51,641 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:10:51,645 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62686, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0022_m_000004_0_-271737584_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 185000
2015-03-13 10:10:51,675 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62685, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0022_m_000001_0_157658245_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742082_1258, duration: 151000
2015-03-13 10:10:51,685 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/_temporary/attempt_1426266260362_0022_m_000004_0/part-00004	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:51,703 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:10:51,710 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62687, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0022_m_000002_0_-875840111_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 164000
2015-03-13 10:10:51,727 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:10:51,730 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62683, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0022_m_000003_0_1696893016_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 151000
2015-03-13 10:10:51,735 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:10:51,750 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/_temporary/attempt_1426266260362_0022_m_000002_0/part-00002	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:51,768 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/_temporary/attempt_1426266260362_0022_m_000003_0/part-00003	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:51,777 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/_temporary/attempt_1426266260362_0022_m_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:51,810 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:10:51,818 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62688, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0022_m_000001_0_157658245_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 154000
2015-03-13 10:10:51,858 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/_temporary/attempt_1426266260362_0022_m_000001_0/part-00001	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:51,885 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:52,053 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/_temporary/attempt_1426266260362_0022_m_000004_0/part-00004. BP-1005356445-10.1.1.144-1426266257849 blk_1073742086_1262{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:10:52,095 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742086_1262 src: /127.0.0.1:62689 dest: /127.0.0.1:60686
2015-03-13 10:10:52,097 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742086_1262 src: /127.0.0.1:62690 dest: /127.0.0.1:60689
2015-03-13 10:10:52,098 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742086_1262 src: /127.0.0.1:62691 dest: /127.0.0.1:60693
2015-03-13 10:10:52,106 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62691, dest: /127.0.0.1:60693, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0022_m_000004_0_-271737584_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742086_1262, duration: 5954000
2015-03-13 10:10:52,106 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742086_1262, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:52,106 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742086_1262{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:52,107 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62690, dest: /127.0.0.1:60689, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0022_m_000004_0_-271737584_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742086_1262, duration: 6771000
2015-03-13 10:10:52,107 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742086_1262, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:52,107 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742086_1262{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:52,107 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62689, dest: /127.0.0.1:60686, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0022_m_000004_0_-271737584_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742086_1262, duration: 7610000
2015-03-13 10:10:52,108 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742086_1262, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:52,108 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742086_1262{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:52,112 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/_temporary/attempt_1426266260362_0022_m_000004_0/part-00004 is closed by DFSClient_attempt_1426266260362_0022_m_000004_0_-271737584_1
2015-03-13 10:10:52,123 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/_temporary/attempt_1426266260362_0022_m_000004_0	dst=null	perm=null
2015-03-13 10:10:52,128 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/_temporary/attempt_1426266260362_0022_m_000002_0/part-00002. BP-1005356445-10.1.1.144-1426266257849 blk_1073742087_1263{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:10:52,131 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/_temporary/attempt_1426266260362_0022_m_000004_0	dst=null	perm=null
2015-03-13 10:10:52,132 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/task_1426266260362_0022_m_000004	dst=null	perm=null
2015-03-13 10:10:52,133 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/_temporary/attempt_1426266260362_0022_m_000003_0/part-00003. BP-1005356445-10.1.1.144-1426266257849 blk_1073742088_1264{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:10:52,138 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/_temporary/attempt_1426266260362_0022_m_000004_0	dst=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/task_1426266260362_0022_m_000004	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:10:52,158 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0022_01_000006
2015-03-13 10:10:52,158 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0022	CONTAINERID=container_1426266260362_0022_01_000006
2015-03-13 10:10:52,158 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:10:52,158 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0022_01_000006
2015-03-13 10:10:52,159 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:10:52,171 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0022_01_000006 is : 143
2015-03-13 10:10:52,172 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job_1426266260362_0022_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073742089_1265{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:10:52,174 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742089_1265 src: /127.0.0.1:62694 dest: /127.0.0.1:60693
2015-03-13 10:10:52,175 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742089_1265 src: /127.0.0.1:62695 dest: /127.0.0.1:60686
2015-03-13 10:10:52,176 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742089_1265 src: /127.0.0.1:62696 dest: /127.0.0.1:60696
2015-03-13 10:10:52,181 INFO  hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job_1426266260362_0022_1.jhist for DFSClient_NONMAPREDUCE_-504580455_1
2015-03-13 10:10:52,203 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62697, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0022_m_000000_0_-366512103_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 160000
2015-03-13 10:10:52,203 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:10:52,204 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000006
2015-03-13 10:10:52,204 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000006
2015-03-13 10:10:52,204 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000006
2015-03-13 10:10:52,204 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0022	CONTAINERID=container_1426266260362_0022_01_000006
2015-03-13 10:10:52,204 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000006
2015-03-13 10:10:52,204 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:10:52,205 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0022_01_000006 from application application_1426266260362_0022
2015-03-13 10:10:52,205 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:52,205 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0022
2015-03-13 10:10:52,211 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742088_1264 src: /127.0.0.1:62693 dest: /127.0.0.1:60696
2015-03-13 10:10:52,212 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742088_1264 src: /127.0.0.1:62698 dest: /127.0.0.1:60693
2015-03-13 10:10:52,213 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742087_1263 src: /127.0.0.1:62692 dest: /127.0.0.1:60686
2015-03-13 10:10:52,213 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742088_1264 src: /127.0.0.1:62699 dest: /127.0.0.1:60689
2015-03-13 10:10:52,215 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742087_1263 src: /127.0.0.1:62700 dest: /127.0.0.1:60696
2015-03-13 10:10:52,216 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742087_1263 src: /127.0.0.1:62701 dest: /127.0.0.1:60689
2015-03-13 10:10:52,224 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62701, dest: /127.0.0.1:60689, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0022_m_000002_0_-875840111_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742087_1263, duration: 6185000
2015-03-13 10:10:52,224 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742087_1263, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:52,225 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742087_1263{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:52,225 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62700, dest: /127.0.0.1:60696, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0022_m_000002_0_-875840111_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742087_1263, duration: 6795000
2015-03-13 10:10:52,225 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742087_1263, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:52,225 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742087_1263{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:52,225 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62692, dest: /127.0.0.1:60686, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0022_m_000002_0_-875840111_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742087_1263, duration: 7534000
2015-03-13 10:10:52,225 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742087_1263, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:52,226 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742087_1263{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:52,233 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/_temporary/attempt_1426266260362_0022_m_000002_0/part-00002 is closed by DFSClient_attempt_1426266260362_0022_m_000002_0_-875840111_1
2015-03-13 10:10:52,233 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62699, dest: /127.0.0.1:60689, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0022_m_000003_0_1696893016_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742088_1264, duration: 18553000
2015-03-13 10:10:52,234 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742088_1264, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:52,234 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742088_1264{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:52,235 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62698, dest: /127.0.0.1:60693, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0022_m_000003_0_1696893016_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742088_1264, duration: 19370000
2015-03-13 10:10:52,235 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742088_1264, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:52,235 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742088_1264{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:52,235 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62693, dest: /127.0.0.1:60696, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0022_m_000003_0_1696893016_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742088_1264, duration: 20266000
2015-03-13 10:10:52,236 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742088_1264, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:52,236 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742088_1264{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:52,240 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/_temporary/attempt_1426266260362_0022_m_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073742090_1266{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:10:52,244 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/_temporary/attempt_1426266260362_0022_m_000003_0/part-00003 is closed by DFSClient_attempt_1426266260362_0022_m_000003_0_1696893016_1
2015-03-13 10:10:52,249 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/_temporary/attempt_1426266260362_0022_m_000002_0	dst=null	perm=null
2015-03-13 10:10:52,257 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:52,257 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:52,257 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:52,257 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:52,260 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/_temporary/attempt_1426266260362_0022_m_000002_0	dst=null	perm=null
2015-03-13 10:10:52,261 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/task_1426266260362_0022_m_000002	dst=null	perm=null
2015-03-13 10:10:52,265 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/_temporary/attempt_1426266260362_0022_m_000002_0	dst=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/task_1426266260362_0022_m_000002	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:10:52,275 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/_temporary/attempt_1426266260362_0022_m_000003_0	dst=null	perm=null
2015-03-13 10:10:52,279 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0022_01_000004
2015-03-13 10:10:52,279 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0022	CONTAINERID=container_1426266260362_0022_01_000004
2015-03-13 10:10:52,279 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:10:52,279 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0022_01_000004
2015-03-13 10:10:52,279 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:52,280 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:52,280 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:10:52,280 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:52,290 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742090_1266 src: /127.0.0.1:62702 dest: /127.0.0.1:60693
2015-03-13 10:10:52,292 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0022_01_000004 is : 143
2015-03-13 10:10:52,292 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742090_1266 src: /127.0.0.1:62703 dest: /127.0.0.1:60689
2015-03-13 10:10:52,293 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742090_1266 src: /127.0.0.1:62704 dest: /127.0.0.1:60696
2015-03-13 10:10:52,302 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62704, dest: /127.0.0.1:60696, bytes: 114, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0022_m_000000_0_-366512103_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742090_1266, duration: 7080000
2015-03-13 10:10:52,302 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742090_1266, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:52,303 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62703, dest: /127.0.0.1:60689, bytes: 114, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0022_m_000000_0_-366512103_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742090_1266, duration: 7922000
2015-03-13 10:10:52,303 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742090_1266, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:52,303 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742090_1266{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:52,304 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742090_1266{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:52,304 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62702, dest: /127.0.0.1:60693, bytes: 114, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0022_m_000000_0_-366512103_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742090_1266, duration: 8933000
2015-03-13 10:10:52,304 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:10:52,304 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742090_1266, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:52,305 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000004
2015-03-13 10:10:52,305 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000004
2015-03-13 10:10:52,305 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0022	CONTAINERID=container_1426266260362_0022_01_000004
2015-03-13 10:10:52,305 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:10:52,305 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0022_01_000004 from application application_1426266260362_0022
2015-03-13 10:10:52,305 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:52,305 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0022
2015-03-13 10:10:52,305 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000004
2015-03-13 10:10:52,305 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000004
2015-03-13 10:10:52,305 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742090_1266{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:52,327 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/_temporary/attempt_1426266260362_0022_m_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0022_m_000000_0_-366512103_1
2015-03-13 10:10:52,330 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/_temporary/attempt_1426266260362_0022_m_000003_0	dst=null	perm=null
2015-03-13 10:10:52,331 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/task_1426266260362_0022_m_000003	dst=null	perm=null
2015-03-13 10:10:52,334 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/_temporary/attempt_1426266260362_0022_m_000003_0	dst=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/task_1426266260362_0022_m_000003	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:10:52,338 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/_temporary/attempt_1426266260362_0022_m_000000_0	dst=null	perm=null
2015-03-13 10:10:52,347 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0022_01_000005
2015-03-13 10:10:52,347 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0022	CONTAINERID=container_1426266260362_0022_01_000005
2015-03-13 10:10:52,348 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:10:52,348 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0022_01_000005
2015-03-13 10:10:52,348 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:52,348 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:52,348 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:10:52,348 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0022_01_000004
2015-03-13 10:10:52,348 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:10:52,349 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0022_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:10:52,349 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0022_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:10:52,349 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0022	CONTAINERID=container_1426266260362_0022_01_000004
2015-03-13 10:10:52,349 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0022_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:10:52,349 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:10:52,349 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0022_01_000004, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:52,349 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:52,349 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:10:52,349 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0022_000001 released container container_1426266260362_0022_01_000004 on node: host: 10.1.1.144:60711 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:10:52,350 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/_temporary/attempt_1426266260362_0022_m_000000_0	dst=null	perm=null
2015-03-13 10:10:52,351 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/task_1426266260362_0022_m_000000	dst=null	perm=null
2015-03-13 10:10:52,355 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/_temporary/attempt_1426266260362_0022_m_000000_0	dst=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/task_1426266260362_0022_m_000000	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:10:52,359 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0022_01_000005 is : 143
2015-03-13 10:10:52,365 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0022_01_000002
2015-03-13 10:10:52,366 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0022	CONTAINERID=container_1426266260362_0022_01_000002
2015-03-13 10:10:52,366 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:52,366 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:52,366 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: -1000
2015-03-13 10:10:52,372 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:10:52,372 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:10:52,373 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000005
2015-03-13 10:10:52,373 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000005
2015-03-13 10:10:52,373 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000005
2015-03-13 10:10:52,374 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000005
2015-03-13 10:10:52,374 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0022_01_000002
2015-03-13 10:10:52,385 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0022_01_000002 is : 143
2015-03-13 10:10:52,386 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/_temporary/attempt_1426266260362_0022_m_000001_0/part-00001. BP-1005356445-10.1.1.144-1426266257849 blk_1073742091_1267{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:10:52,394 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0022	CONTAINERID=container_1426266260362_0022_01_000005
2015-03-13 10:10:52,394 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:10:52,394 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:10:52,395 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0022_01_000005 from application application_1426266260362_0022
2015-03-13 10:10:52,395 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:52,395 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0022
2015-03-13 10:10:52,395 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000002
2015-03-13 10:10:52,395 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000002
2015-03-13 10:10:52,396 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000002
2015-03-13 10:10:52,396 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000002
2015-03-13 10:10:52,397 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0022	CONTAINERID=container_1426266260362_0022_01_000002
2015-03-13 10:10:52,397 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:10:52,397 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0022_01_000002 from application application_1426266260362_0022
2015-03-13 10:10:52,397 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:52,398 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0022
2015-03-13 10:10:52,432 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742091_1267 src: /127.0.0.1:62705 dest: /127.0.0.1:60696
2015-03-13 10:10:52,433 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742091_1267 src: /127.0.0.1:62706 dest: /127.0.0.1:60686
2015-03-13 10:10:52,435 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742091_1267 src: /127.0.0.1:62707 dest: /127.0.0.1:60689
2015-03-13 10:10:52,443 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62707, dest: /127.0.0.1:60689, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0022_m_000001_0_157658245_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742091_1267, duration: 6518000
2015-03-13 10:10:52,443 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742091_1267, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:52,444 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742091_1267{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:52,444 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62706, dest: /127.0.0.1:60686, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0022_m_000001_0_157658245_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742091_1267, duration: 7196000
2015-03-13 10:10:52,444 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742091_1267, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:52,444 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742091_1267{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:52,444 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62705, dest: /127.0.0.1:60696, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0022_m_000001_0_157658245_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742091_1267, duration: 7940000
2015-03-13 10:10:52,445 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742091_1267, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:52,445 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742091_1267{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:52,450 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/_temporary/attempt_1426266260362_0022_m_000001_0/part-00001 is closed by DFSClient_attempt_1426266260362_0022_m_000001_0_157658245_1
2015-03-13 10:10:52,460 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/_temporary/attempt_1426266260362_0022_m_000001_0	dst=null	perm=null
2015-03-13 10:10:52,467 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/_temporary/attempt_1426266260362_0022_m_000001_0	dst=null	perm=null
2015-03-13 10:10:52,469 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/task_1426266260362_0022_m_000001	dst=null	perm=null
2015-03-13 10:10:52,473 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/_temporary/attempt_1426266260362_0022_m_000001_0	dst=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/task_1426266260362_0022_m_000001	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:10:52,488 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0022_01_000003
2015-03-13 10:10:52,488 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0022	CONTAINERID=container_1426266260362_0022_01_000003
2015-03-13 10:10:52,488 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:10:52,489 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0022_01_000003
2015-03-13 10:10:52,489 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:10:52,489 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0022_01_000002
2015-03-13 10:10:52,489 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:10:52,489 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:10:52,489 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0022_01_000005
2015-03-13 10:10:52,490 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0022_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:10:52,490 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0022_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:10:52,490 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0022	CONTAINERID=container_1426266260362_0022_01_000002
2015-03-13 10:10:52,490 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0022_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:10:52,490 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:10:52,490 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0022_01_000002, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:52,490 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:52,490 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:10:52,490 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0022_000001 released container container_1426266260362_0022_01_000002 on node: host: 10.1.1.144:60711 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:10:52,490 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0022_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:10:52,490 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0022_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:10:52,491 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0022	CONTAINERID=container_1426266260362_0022_01_000005
2015-03-13 10:10:52,491 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0022_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:10:52,491 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:10:52,491 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0022_01_000005, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:52,491 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:52,491 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:10:52,491 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0022_000001 released container container_1426266260362_0022_01_000005 on node: host: 10.1.1.144:60711 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:10:52,493 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:52,495 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-504580455_1
2015-03-13 10:10:52,499 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1	dst=null	perm=null
2015-03-13 10:10:52,502 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0022_01_000003 is : 143
2015-03-13 10:10:52,506 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703	dst=null	perm=null
2015-03-13 10:10:52,507 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703	dst=null	perm=null
2015-03-13 10:10:52,508 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/task_1426266260362_0022_m_000000	dst=null	perm=null
2015-03-13 10:10:52,510 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00000	dst=null	perm=null
2015-03-13 10:10:52,513 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/task_1426266260362_0022_m_000000/part-00000	dst=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:52,515 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:10:52,516 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703	dst=null	perm=null
2015-03-13 10:10:52,516 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000003
2015-03-13 10:10:52,516 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000003
2015-03-13 10:10:52,517 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000003
2015-03-13 10:10:52,517 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703	dst=null	perm=null
2015-03-13 10:10:52,517 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000003
2015-03-13 10:10:52,518 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/task_1426266260362_0022_m_000001	dst=null	perm=null
2015-03-13 10:10:52,518 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0022	CONTAINERID=container_1426266260362_0022_01_000003
2015-03-13 10:10:52,518 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:10:52,518 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0022_01_000003 from application application_1426266260362_0022
2015-03-13 10:10:52,518 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:52,519 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0022
2015-03-13 10:10:52,519 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00001	dst=null	perm=null
2015-03-13 10:10:52,521 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/task_1426266260362_0022_m_000001/part-00001	dst=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00001	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:52,522 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703	dst=null	perm=null
2015-03-13 10:10:52,523 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703	dst=null	perm=null
2015-03-13 10:10:52,524 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/task_1426266260362_0022_m_000002	dst=null	perm=null
2015-03-13 10:10:52,525 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00002	dst=null	perm=null
2015-03-13 10:10:52,526 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/task_1426266260362_0022_m_000002/part-00002	dst=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00002	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:52,527 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703	dst=null	perm=null
2015-03-13 10:10:52,528 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703	dst=null	perm=null
2015-03-13 10:10:52,530 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/task_1426266260362_0022_m_000003	dst=null	perm=null
2015-03-13 10:10:52,531 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00003	dst=null	perm=null
2015-03-13 10:10:52,532 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/task_1426266260362_0022_m_000003/part-00003	dst=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00003	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:52,533 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703	dst=null	perm=null
2015-03-13 10:10:52,533 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703	dst=null	perm=null
2015-03-13 10:10:52,534 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/task_1426266260362_0022_m_000004	dst=null	perm=null
2015-03-13 10:10:52,535 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00004	dst=null	perm=null
2015-03-13 10:10:52,536 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/task_1426266260362_0022_m_000004/part-00004	dst=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00004	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:52,539 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary	dst=null	perm=null
2015-03-13 10:10:52,542 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:52,544 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-504580455_1
2015-03-13 10:10:52,547 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:52,549 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-504580455_1
2015-03-13 10:10:52,563 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62696, dest: /127.0.0.1:60696, bytes: 53313, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-504580455_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742089_1265, duration: 384760000
2015-03-13 10:10:52,563 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742089_1265, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:52,564 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742089_1265{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:52,564 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62695, dest: /127.0.0.1:60686, bytes: 53313, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-504580455_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742089_1265, duration: 386140000
2015-03-13 10:10:52,564 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742089_1265, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:52,565 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742089_1265{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:52,566 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62694, dest: /127.0.0.1:60693, bytes: 53313, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-504580455_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742089_1265, duration: 387646000
2015-03-13 10:10:52,566 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742089_1265, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:52,566 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742089_1265{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:52,568 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job_1426266260362_0022_1.jhist is closed by DFSClient_NONMAPREDUCE_-504580455_1
2015-03-13 10:10:52,570 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0022.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:52,572 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0022.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742092_1268{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:10:52,574 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742092_1268 src: /127.0.0.1:62708 dest: /127.0.0.1:60693
2015-03-13 10:10:52,575 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742092_1268 src: /127.0.0.1:62709 dest: /127.0.0.1:60689
2015-03-13 10:10:52,577 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742092_1268 src: /127.0.0.1:62710 dest: /127.0.0.1:60696
2015-03-13 10:10:52,579 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62710, dest: /127.0.0.1:60696, bytes: 411, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-504580455_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742092_1268, duration: 1377000
2015-03-13 10:10:52,580 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742092_1268, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:52,580 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742092_1268{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:52,580 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62709, dest: /127.0.0.1:60689, bytes: 411, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-504580455_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742092_1268, duration: 1846000
2015-03-13 10:10:52,580 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742092_1268, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:52,581 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742092_1268{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:52,581 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62708, dest: /127.0.0.1:60693, bytes: 411, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-504580455_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742092_1268, duration: 2576000
2015-03-13 10:10:52,581 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742092_1268, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:52,581 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742092_1268{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:52,583 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0022.summary_tmp is closed by DFSClient_NONMAPREDUCE_-504580455_1
2015-03-13 10:10:52,586 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0022.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:52,590 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job_1426266260362_0022_1.jhist	dst=null	perm=null
2015-03-13 10:10:52,592 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0022-1426266637614-soberoi-%5B5C1ADEBEAF9544CFBB574223654F352B%2FC41347FCE26941FD-1426266652550-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:10:52,596 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job_1426266260362_0022_1.jhist	dst=null	perm=null
2015-03-13 10:10:52,597 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0022-1426266637614-soberoi-%5B5C1ADEBEAF9544CFBB574223654F352B%2FC41347FCE26941FD-1426266652550-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:10:52,598 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job_1426266260362_0022_1.jhist	dst=null	perm=null
2015-03-13 10:10:52,602 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0022-1426266637614-soberoi-%5B5C1ADEBEAF9544CFBB574223654F352B%2FC41347FCE26941FD-1426266652550-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:52,604 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62711, bytes: 53733, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-504580455_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742089_1265, duration: 164000
2015-03-13 10:10:52,606 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0022-1426266637614-soberoi-%5B5C1ADEBEAF9544CFBB574223654F352B%2FC41347FCE26941FD-1426266652550-5-0-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742093_1269{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:10:52,608 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742093_1269 src: /127.0.0.1:62712 dest: /127.0.0.1:60696
2015-03-13 10:10:52,609 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742093_1269 src: /127.0.0.1:62713 dest: /127.0.0.1:60686
2015-03-13 10:10:52,610 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742093_1269 src: /127.0.0.1:62714 dest: /127.0.0.1:60689
2015-03-13 10:10:52,613 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62714, dest: /127.0.0.1:60689, bytes: 53313, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-504580455_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742093_1269, duration: 1530000
2015-03-13 10:10:52,613 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742093_1269, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:52,614 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62713, dest: /127.0.0.1:60686, bytes: 53313, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-504580455_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742093_1269, duration: 1988000
2015-03-13 10:10:52,614 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742093_1269{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:52,614 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742093_1269, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:52,615 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62712, dest: /127.0.0.1:60696, bytes: 53313, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-504580455_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742093_1269, duration: 2983000
2015-03-13 10:10:52,615 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742093_1269, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:52,616 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742093_1269{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:52,617 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742093_1269 size 53313
2015-03-13 10:10:52,617 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0022-1426266637614-soberoi-%5B5C1ADEBEAF9544CFBB574223654F352B%2FC41347FCE26941FD-1426266652550-5-0-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-504580455_1
2015-03-13 10:10:52,619 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0022-1426266637614-soberoi-%5B5C1ADEBEAF9544CFBB574223654F352B%2FC41347FCE26941FD-1426266652550-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:52,621 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job_1426266260362_0022_1_conf.xml	dst=null	perm=null
2015-03-13 10:10:52,622 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0022_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:10:52,623 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job_1426266260362_0022_1_conf.xml	dst=null	perm=null
2015-03-13 10:10:52,624 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0022_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:10:52,625 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job_1426266260362_0022_1_conf.xml	dst=null	perm=null
2015-03-13 10:10:52,627 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0022_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:52,629 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62711, bytes: 90039, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-504580455_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742085_1261, duration: 259000
2015-03-13 10:10:52,631 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0022_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742094_1270{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:10:52,633 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742094_1270 src: /127.0.0.1:62715 dest: /127.0.0.1:60693
2015-03-13 10:10:52,634 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742094_1270 src: /127.0.0.1:62716 dest: /127.0.0.1:60686
2015-03-13 10:10:52,635 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742094_1270 src: /127.0.0.1:62717 dest: /127.0.0.1:60689
2015-03-13 10:10:52,639 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62717, dest: /127.0.0.1:60689, bytes: 89339, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-504580455_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742094_1270, duration: 2124000
2015-03-13 10:10:52,639 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742094_1270, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:52,640 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62716, dest: /127.0.0.1:60686, bytes: 89339, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-504580455_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742094_1270, duration: 2720000
2015-03-13 10:10:52,640 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742094_1270{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:52,640 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742094_1270, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:52,640 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62715, dest: /127.0.0.1:60693, bytes: 89339, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-504580455_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742094_1270, duration: 3693000
2015-03-13 10:10:52,641 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742094_1270, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:52,641 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742094_1270{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:52,642 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742094_1270{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:52,643 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0022_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-504580455_1
2015-03-13 10:10:52,644 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0022_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:52,646 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0022.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0022.summary	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:52,648 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0022_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0022_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:52,650 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0022-1426266637614-soberoi-%5B5C1ADEBEAF9544CFBB574223654F352B%2FC41347FCE26941FD-1426266652550-5-0-SUCCEEDED-default.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0022-1426266637614-soberoi-%5B5C1ADEBEAF9544CFBB574223654F352B%2FC41347FCE26941FD-1426266652550-5-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:52,655 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0022_000001 State change from RUNNING to FINISHING
2015-03-13 10:10:52,655 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0022
2015-03-13 10:10:52,655 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0022 State change from RUNNING to REMOVING
2015-03-13 10:10:52,655 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0022
2015-03-13 10:10:52,655 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0022 State change from REMOVING to FINISHING
2015-03-13 10:10:52,890 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:53,159 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:10:53,159 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0022_01_000006
2015-03-13 10:10:53,160 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0022_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:10:53,160 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0022_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:10:53,160 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0022	CONTAINERID=container_1426266260362_0022_01_000006
2015-03-13 10:10:53,160 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0022_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:10:53,160 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:10:53,161 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0022_01_000006, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:53,161 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:53,161 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:10:53,161 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0022_000001 released container container_1426266260362_0022_01_000006 on node: host: 10.1.1.144:60723 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:10:53,493 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:10:53,493 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0022_01_000003
2015-03-13 10:10:53,493 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0022_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:10:53,494 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0022_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:10:53,494 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0022	CONTAINERID=container_1426266260362_0022_01_000003
2015-03-13 10:10:53,494 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0022_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:10:53,494 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:10:53,494 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0022_01_000003, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:53,494 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:53,495 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:10:53,495 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0022_000001 released container container_1426266260362_0022_01_000003 on node: host: 10.1.1.144:60711 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:10:53,661 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742081_1257 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60686 
2015-03-13 10:10:53,661 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742082_1258 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60693 
2015-03-13 10:10:53,662 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742083_1259 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60689 
2015-03-13 10:10:53,662 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742084_1260 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60693 
2015-03-13 10:10:53,662 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742089_1265 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60696 
2015-03-13 10:10:53,662 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742085_1261 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60686 
2015-03-13 10:10:53,662 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022	dst=null	perm=null
2015-03-13 10:10:53,686 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (1/2) ...dedpipesplatform/joinself
2015-03-13 10:10:53,693 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:10:53,700 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:10:53,702 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself	dst=null	perm=null
2015-03-13 10:10:53,703 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:10:53,703 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:10:53,705 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 23
2015-03-13 10:10:53,706 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023	dst=null	perm=null
2015-03-13 10:10:53,707 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023	dst=null	perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:10:53,708 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023	dst=null	perm=soberoi:supergroup:rwx------
2015-03-13 10:10:53,709 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.jar	dst=null	perm=null
2015-03-13 10:10:53,710 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:53,711 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073742095_1271{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:10:53,713 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742095_1271 src: /127.0.0.1:62720 dest: /127.0.0.1:60686
2015-03-13 10:10:53,714 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742095_1271 src: /127.0.0.1:62721 dest: /127.0.0.1:60693
2015-03-13 10:10:53,715 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742095_1271 src: /127.0.0.1:62722 dest: /127.0.0.1:60696
2015-03-13 10:10:53,719 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62722, dest: /127.0.0.1:60696, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742095_1271, duration: 2737000
2015-03-13 10:10:53,719 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742095_1271, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:53,719 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742095_1271{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:53,719 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62721, dest: /127.0.0.1:60693, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742095_1271, duration: 2644000
2015-03-13 10:10:53,720 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742095_1271, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:53,720 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742095_1271{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:53,720 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62720, dest: /127.0.0.1:60686, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742095_1271, duration: 3626000
2015-03-13 10:10:53,720 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742095_1271, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:53,721 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742095_1271{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:53,722 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:10:53,723 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.jar
2015-03-13 10:10:53,723 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.jar	dst=null	perm=null
2015-03-13 10:10:53,724 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:53,725 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:10:53,726 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:10:53,727 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:10:53,727 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:10:53,728 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:10:53,729 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:10:53,729 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:10:53,730 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:10:53,731 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:10:53,732 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:10:53,732 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:10:53,733 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:10:53,734 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:53,735 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:53,736 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.split
2015-03-13 10:10:53,736 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.split	dst=null	perm=null
2015-03-13 10:10:53,737 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073742096_1272{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:10:53,738 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742096_1272 src: /127.0.0.1:62723 dest: /127.0.0.1:60693
2015-03-13 10:10:53,739 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742096_1272 src: /127.0.0.1:62724 dest: /127.0.0.1:60689
2015-03-13 10:10:53,740 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742096_1272 src: /127.0.0.1:62725 dest: /127.0.0.1:60696
2015-03-13 10:10:53,741 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742096_1272 src: /127.0.0.1:62726 dest: /127.0.0.1:60686
2015-03-13 10:10:53,744 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62726, dest: /127.0.0.1:60686, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742096_1272, duration: 1561000
2015-03-13 10:10:53,744 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742096_1272, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:53,744 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742096_1272{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:10:53,744 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62725, dest: /127.0.0.1:60696, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742096_1272, duration: 2010000
2015-03-13 10:10:53,745 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742096_1272, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:53,745 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742096_1272{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:10:53,745 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62724, dest: /127.0.0.1:60689, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742096_1272, duration: 2762000
2015-03-13 10:10:53,745 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742096_1272, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:53,746 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742096_1272{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:10:53,746 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62723, dest: /127.0.0.1:60693, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742096_1272, duration: 3250000
2015-03-13 10:10:53,746 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742096_1272, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:53,747 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742096_1272{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:10:53,748 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:10:53,749 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:53,750 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:53,751 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073742097_1273{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:10:53,752 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742097_1273 src: /127.0.0.1:62727 dest: /127.0.0.1:60693
2015-03-13 10:10:53,753 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742097_1273 src: /127.0.0.1:62728 dest: /127.0.0.1:60689
2015-03-13 10:10:53,754 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742097_1273 src: /127.0.0.1:62729 dest: /127.0.0.1:60696
2015-03-13 10:10:53,757 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62729, dest: /127.0.0.1:60696, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742097_1273, duration: 1326000
2015-03-13 10:10:53,757 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742097_1273, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:53,757 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742097_1273{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:53,758 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62728, dest: /127.0.0.1:60689, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742097_1273, duration: 2109000
2015-03-13 10:10:53,758 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742097_1273, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:53,758 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742097_1273{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:53,758 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62727, dest: /127.0.0.1:60693, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742097_1273, duration: 2946000
2015-03-13 10:10:53,759 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742097_1273, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:53,759 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742097_1273{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:53,760 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:10:53,760 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:10:53,761 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:53,762 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:53,763 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:10:53,764 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:10:53,764 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:10:53,769 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742098_1274{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:10:53,770 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742098_1274 src: /127.0.0.1:62730 dest: /127.0.0.1:60693
2015-03-13 10:10:53,771 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742098_1274 src: /127.0.0.1:62731 dest: /127.0.0.1:60686
2015-03-13 10:10:53,773 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742098_1274 src: /127.0.0.1:62732 dest: /127.0.0.1:60689
2015-03-13 10:10:53,775 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62732, dest: /127.0.0.1:60689, bytes: 97852, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742098_1274, duration: 1374000
2015-03-13 10:10:53,775 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742098_1274, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:53,776 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742098_1274{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:53,776 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62731, dest: /127.0.0.1:60686, bytes: 97852, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742098_1274, duration: 1826000
2015-03-13 10:10:53,776 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742098_1274, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:53,776 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742098_1274{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:53,777 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62730, dest: /127.0.0.1:60693, bytes: 97852, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742098_1274, duration: 2565000
2015-03-13 10:10:53,777 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742098_1274, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:53,779 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742098_1274{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:53,779 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:10:53,780 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0023
2015-03-13 10:10:53,781 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023	dst=null	perm=null
2015-03-13 10:10:53,781 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.xml	dst=null	perm=null
2015-03-13 10:10:53,782 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.xml	dst=null	perm=null
2015-03-13 10:10:53,782 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.jar	dst=null	perm=null
2015-03-13 10:10:53,783 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.jar	dst=null	perm=null
2015-03-13 10:10:53,783 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.split	dst=null	perm=null
2015-03-13 10:10:53,784 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.split	dst=null	perm=null
2015-03-13 10:10:53,784 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:10:53,784 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:10:53,786 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:10:53,786 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:10:53,787 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:10:53,787 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:10:53,788 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:10:53,788 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:10:53,789 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 23 submitted by user soberoi
2015-03-13 10:10:53,789 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0023
2015-03-13 10:10:53,790 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	IP=10.1.1.144	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1426266260362_0023
2015-03-13 10:10:53,790 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0023
2015-03-13 10:10:53,790 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0023 State change from NEW to NEW_SAVING
2015-03-13 10:10:53,790 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0023 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:10:53,790 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0023_000001
2015-03-13 10:10:53,790 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0023_000001 State change from NEW to SUBMITTED
2015-03-13 10:10:53,790 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0023 from user: soberoi activated in queue: default
2015-03-13 10:10:53,790 INFO  capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0023 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:10:53,791 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0023 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:10:53,791 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0023 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:10:53,791 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0023_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:10:53,792 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0023_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:10:53,792 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0023 State change from SUBMITTED to ACCEPTED
2015-03-13 10:10:53,792 INFO  mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0023/
2015-03-13 10:10:53,792 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1426266260362_0023
2015-03-13 10:10:53,793 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0023/
2015-03-13 10:10:53,894 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:53,895 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0023_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:10:53,895 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0023	CONTAINERID=container_1426266260362_0023_01_000001
2015-03-13 10:10:53,895 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0023_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:4096, vCores:2> used and <memory:0, vCores:6> available
2015-03-13 10:10:53,895 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0023 container=Container: [ContainerId: container_1426266260362_0023_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0023_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:53,895 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:10:53,896 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0023_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:10:53,896 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:53,896 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0023 AttemptId: appattempt_1426266260362_0023_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0023_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ]
2015-03-13 10:10:53,897 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0023_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:10:53,897 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0023_000001
2015-03-13 10:10:53,897 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0023_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:10:53,897 INFO  amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0023_000001
2015-03-13 10:10:53,898 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0023_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] for AM appattempt_1426266260362_0023_000001
2015-03-13 10:10:53,898 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0023_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-03-13 10:10:53,900 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0023_000001 (auth:SIMPLE)
2015-03-13 10:10:53,901 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0023_01_000001 by user soberoi
2015-03-13 10:10:53,901 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0023
2015-03-13 10:10:53,901 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0023	CONTAINERID=container_1426266260362_0023_01_000001
2015-03-13 10:10:53,901 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0023 transitioned from NEW to INITING
2015-03-13 10:10:53,901 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0023_01_000001 to application application_1426266260362_0023
2015-03-13 10:10:53,901 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0023_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] for AM appattempt_1426266260362_0023_000001
2015-03-13 10:10:53,902 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0023 transitioned from INITING to RUNNING
2015-03-13 10:10:53,902 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0023_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:10:53,902 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:10:53,902 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0023
2015-03-13 10:10:53,902 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:10:53,902 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:10:53,902 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:10:53,903 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:10:53,903 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0023_01_000001
2015-03-13 10:10:53,912 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426266260362_0023_01_000001.tokens. Credentials list: 
2015-03-13 10:10:53,926 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:10:53,996 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426266260362_0023_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000001.tokens
2015-03-13 10:10:53,996 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0023 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0023
2015-03-13 10:10:54,059 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.jar	dst=null	perm=null
2015-03-13 10:10:54,060 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.jar	dst=null	perm=null
2015-03-13 10:10:54,060 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.jar	dst=null	perm=null
2015-03-13 10:10:54,067 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62736, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-2000142493_12149, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742095_1271, duration: 498000
2015-03-13 10:10:54,086 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:54,096 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742091_1267
2015-03-13 10:10:54,096 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742086_1262
2015-03-13 10:10:54,096 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742094_1270
2015-03-13 10:10:54,097 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742087_1263
2015-03-13 10:10:54,097 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742090_1266
2015-03-13 10:10:54,097 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742093_1269
2015-03-13 10:10:54,097 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742096_1272
2015-03-13 10:10:54,098 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742088_1264
2015-03-13 10:10:54,098 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742098_1274
2015-03-13 10:10:54,099 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742097_1273
2015-03-13 10:10:54,099 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742092_1268
2015-03-13 10:10:54,102 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:10:54,103 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:10:54,103 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:10:54,111 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62737, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-2000142493_12149, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742097_1273, duration: 126000
2015-03-13 10:10:54,122 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:54,138 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.split	dst=null	perm=null
2015-03-13 10:10:54,139 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.split	dst=null	perm=null
2015-03-13 10:10:54,139 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.split	dst=null	perm=null
2015-03-13 10:10:54,145 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62736, bytes: 1798, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-2000142493_12149, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742096_1272, duration: 128000
2015-03-13 10:10:54,157 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:54,173 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.xml	dst=null	perm=null
2015-03-13 10:10:54,174 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.xml	dst=null	perm=null
2015-03-13 10:10:54,175 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.xml	dst=null	perm=null
2015-03-13 10:10:54,180 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62736, bytes: 98620, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-2000142493_12149, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742098_1274, duration: 285000
2015-03-13 10:10:54,193 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:54,193 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:10:54,219 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:10:54,219 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:54,288 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000001/default_container_executor.sh]
2015-03-13 10:10:54,297 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742088_1264
2015-03-13 10:10:54,297 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742089_1265
2015-03-13 10:10:54,298 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742098_1274
2015-03-13 10:10:54,298 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742094_1270
2015-03-13 10:10:54,298 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742086_1262
2015-03-13 10:10:54,447 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742087_1263
2015-03-13 10:10:54,448 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742086_1262
2015-03-13 10:10:54,448 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742091_1267
2015-03-13 10:10:54,448 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742089_1265
2015-03-13 10:10:54,653 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742095_1271
2015-03-13 10:10:54,653 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742096_1272
2015-03-13 10:10:54,653 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742093_1269
2015-03-13 10:10:54,699 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742095_1271
2015-03-13 10:10:54,699 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742096_1272
2015-03-13 10:10:54,700 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742097_1273
2015-03-13 10:10:54,700 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742090_1266
2015-03-13 10:10:54,700 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742092_1268
2015-03-13 10:10:54,852 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742098_1274
2015-03-13 10:10:54,853 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742094_1270
2015-03-13 10:10:54,897 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:54,897 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:54,897 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0023_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:10:54,979 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60696 to replicate blk_1073742095_1271 to datanode(s) 127.0.0.1:60689
2015-03-13 10:10:54,979 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073742081_1257, blk_1073742082_1258, blk_1073742083_1259, blk_1073742084_1260, blk_1073742085_1261, blk_1073742089_1265]
2015-03-13 10:10:54,979 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073742081_1257, blk_1073742082_1258, blk_1073742083_1259, blk_1073742084_1260, blk_1073742085_1261, blk_1073742089_1265]
2015-03-13 10:10:55,054 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742089_1265
2015-03-13 10:10:55,055 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742093_1269
2015-03-13 10:10:55,055 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742090_1266
2015-03-13 10:10:55,055 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742087_1263
2015-03-13 10:10:55,055 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742097_1273
2015-03-13 10:10:55,055 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742096_1272
2015-03-13 10:10:55,056 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742091_1267
2015-03-13 10:10:55,056 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742088_1264
2015-03-13 10:10:55,056 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742092_1268
2015-03-13 10:10:55,057 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742095_1271
2015-03-13 10:10:55,576 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742081_1257 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742081 for deletion
2015-03-13 10:10:55,576 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742082_1258 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742082 for deletion
2015-03-13 10:10:55,576 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742083_1259 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742083 for deletion
2015-03-13 10:10:55,576 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742084_1260 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742084 for deletion
2015-03-13 10:10:55,576 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742081_1257 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742081
2015-03-13 10:10:55,576 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742085_1261 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742085 for deletion
2015-03-13 10:10:55,576 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742082_1258 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742082
2015-03-13 10:10:55,577 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742089_1265 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742089 for deletion
2015-03-13 10:10:55,577 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742083_1259 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742083
2015-03-13 10:10:55,577 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742084_1260 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742084
2015-03-13 10:10:55,577 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742085_1261 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742085
2015-03-13 10:10:55,577 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742089_1265 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742089
2015-03-13 10:10:55,902 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:55,902 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:55,906 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:10:55,927 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/COMMIT_STARTED	dst=null	perm=null
2015-03-13 10:10:55,928 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/COMMIT_SUCCESS	dst=null	perm=null
2015-03-13 10:10:55,929 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/COMMIT_FAIL	dst=null	perm=null
2015-03-13 10:10:55,956 INFO  datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-318492837-10.1.1.144-60696-1426266259571, infoPort=60697, ipcPort=60698, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073742095_1271 to 127.0.0.1:60689 
2015-03-13 10:10:55,957 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742081_1257 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742081 for deletion
2015-03-13 10:10:55,957 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742082_1258 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742082 for deletion
2015-03-13 10:10:55,957 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742083_1259 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742083 for deletion
2015-03-13 10:10:55,957 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742084_1260 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742084 for deletion
2015-03-13 10:10:55,958 INFO  datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073742095_1271 (numBytes=254067) to /127.0.0.1:60689
2015-03-13 10:10:55,958 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742082_1258 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742082
2015-03-13 10:10:55,958 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742095_1271 src: /127.0.0.1:62739 dest: /127.0.0.1:60689
2015-03-13 10:10:55,959 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742084_1260 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742084
2015-03-13 10:10:55,958 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742081_1257 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742081
2015-03-13 10:10:55,958 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742085_1261 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742085 for deletion
2015-03-13 10:10:55,959 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742089_1265 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742089 for deletion
2015-03-13 10:10:55,959 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742083_1259 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742083
2015-03-13 10:10:55,960 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742089_1265 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742089
2015-03-13 10:10:55,960 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742085_1261 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742085
2015-03-13 10:10:55,960 INFO  datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073742095_1271 src: /127.0.0.1:62739 dest: /127.0.0.1:60689 of size 254067
2015-03-13 10:10:55,961 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742095_1271 size 254067
2015-03-13 10:10:55,985 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023	dst=null	perm=null
2015-03-13 10:10:55,987 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:10:55,988 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:10:56,278 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:10:56,285 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:10:56,346 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62740, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-872052556_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742097_1273, duration: 156000
2015-03-13 10:10:56,906 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:56,906 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:57,134 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0023_000001 (auth:SIMPLE)
2015-03-13 10:10:57,136 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0023_000001
2015-03-13 10:10:57,136 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi	IP=10.1.1.144	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1426266260362_0023	APPATTEMPTID=appattempt_1426266260362_0023_000001
2015-03-13 10:10:57,136 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0023_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:10:57,136 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0023 State change from ACCEPTED to RUNNING
2015-03-13 10:10:57,156 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job_1426266260362_0023_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:57,162 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:10:57,223 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job_1426266260362_0023_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:57,368 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job_1426266260362_0023_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742099_1275{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:10:57,407 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742099_1275 src: /127.0.0.1:62746 dest: /127.0.0.1:60696
2015-03-13 10:10:57,408 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742099_1275 src: /127.0.0.1:62747 dest: /127.0.0.1:60686
2015-03-13 10:10:57,413 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742099_1275 src: /127.0.0.1:62748 dest: /127.0.0.1:60693
2015-03-13 10:10:57,421 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62748, dest: /127.0.0.1:60693, bytes: 90664, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-872052556_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742099_1275, duration: 6306000
2015-03-13 10:10:57,421 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742099_1275, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:57,421 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742099_1275{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:57,422 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62747, dest: /127.0.0.1:60686, bytes: 90664, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-872052556_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742099_1275, duration: 7052000
2015-03-13 10:10:57,422 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742099_1275, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:57,422 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742099_1275{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:57,422 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62746, dest: /127.0.0.1:60696, bytes: 90664, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-872052556_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742099_1275, duration: 7819000
2015-03-13 10:10:57,423 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742099_1275, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:57,423 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742099_1275{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:57,427 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job_1426266260362_0023_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-872052556_1
2015-03-13 10:10:57,912 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:57,912 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:57,980 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073742081_1257, blk_1073742082_1258, blk_1073742084_1260, blk_1073742085_1261, blk_1073742089_1265]
2015-03-13 10:10:57,980 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073742081_1257, blk_1073742082_1258, blk_1073742083_1259]
2015-03-13 10:10:58,170 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0023_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:10:58,170 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0023	CONTAINERID=container_1426266260362_0023_01_000002
2015-03-13 10:10:58,170 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0023_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:10:58,170 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0023 container=Container: [ContainerId: container_1426266260362_0023_01_000002, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0023_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:58,170 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:10:58,170 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:58,171 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0023_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:10:58,171 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0023	CONTAINERID=container_1426266260362_0023_01_000003
2015-03-13 10:10:58,171 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0023_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:10:58,171 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0023 container=Container: [ContainerId: container_1426266260362_0023_01_000003, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0023_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:58,171 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:10:58,171 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:58,172 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0023_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:10:58,172 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0023	CONTAINERID=container_1426266260362_0023_01_000004
2015-03-13 10:10:58,172 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0023_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:10:58,172 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0023 container=Container: [ContainerId: container_1426266260362_0023_01_000004, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0023_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:58,172 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:10:58,172 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:58,172 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0023_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:10:58,172 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0023	CONTAINERID=container_1426266260362_0023_01_000005
2015-03-13 10:10:58,173 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0023_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:10:58,173 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0023 container=Container: [ContainerId: container_1426266260362_0023_01_000005, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0023_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:58,173 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:10:58,173 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:58,468 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0023_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:10:58,468 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0023	CONTAINERID=container_1426266260362_0023_01_000006
2015-03-13 10:10:58,468 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0023_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:10:58,468 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0023 container=Container: [ContainerId: container_1426266260362_0023_01_000006, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0023_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:58,468 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7
2015-03-13 10:10:58,469 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:58,574 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742081_1257 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742081 for deletion
2015-03-13 10:10:58,574 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742082_1258 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742082 for deletion
2015-03-13 10:10:58,575 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742083_1259 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742083 for deletion
2015-03-13 10:10:58,575 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742081_1257 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742081
2015-03-13 10:10:58,575 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742082_1258 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742082
2015-03-13 10:10:58,575 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742083_1259 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742083
2015-03-13 10:10:58,690 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0022_01_000001 succeeded 
2015-03-13 10:10:58,690 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:10:58,690 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0022_01_000001
2015-03-13 10:10:58,697 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000001
2015-03-13 10:10:58,697 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000001
2015-03-13 10:10:58,697 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000001
2015-03-13 10:10:58,697 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0022	CONTAINERID=container_1426266260362_0022_01_000001
2015-03-13 10:10:58,698 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:10:58,698 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0022_01_000001 from application application_1426266260362_0022
2015-03-13 10:10:58,698 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:58,698 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0022
2015-03-13 10:10:58,697 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000001
2015-03-13 10:10:58,778 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742081_1257 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742081 for deletion
2015-03-13 10:10:58,778 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742082_1258 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742082 for deletion
2015-03-13 10:10:58,779 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742084_1260 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742084 for deletion
2015-03-13 10:10:58,779 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742085_1261 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742085 for deletion
2015-03-13 10:10:58,779 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742082_1258 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742082
2015-03-13 10:10:58,779 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742089_1265 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742089 for deletion
2015-03-13 10:10:58,779 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742081_1257 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742081
2015-03-13 10:10:58,779 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742085_1261 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742085
2015-03-13 10:10:58,780 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742084_1260 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742084
2015-03-13 10:10:58,780 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742089_1265 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742089
2015-03-13 10:10:58,913 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:10:58,913 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0022_01_000001
2015-03-13 10:10:58,913 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:58,914 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0022_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:10:58,914 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0022_000001
2015-03-13 10:10:58,914 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0022_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:10:58,914 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0022_000001 State change from FINISHING to FINISHED
2015-03-13 10:10:58,914 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0022	CONTAINERID=container_1426266260362_0022_01_000001
2015-03-13 10:10:58,914 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0022 State change from FINISHING to FINISHED
2015-03-13 10:10:58,914 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0022_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:10:58,914 INFO  amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0022_000001
2015-03-13 10:10:58,914 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:7168, vCores:6> numContainers=6 user=soberoi user-resources=<memory:7168, vCores:6>
2015-03-13 10:10:58,914 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1426266260362_0022
2015-03-13 10:10:58,915 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0022_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:58,915 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0022,name=[5C1ADEBEAF9544CFBB574223654F352B/C41347FCE26941FD99688B6E707F843A] lower*upper/(2/2),user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0022/jobhistory/job/job_1426266260362_0022,appMasterHost=Edinburgh.local,startTime=1426266637614,finishTime=1426266652655,finalStatus=SUCCEEDED
2015-03-13 10:10:58,915 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:58,915 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6
2015-03-13 10:10:58,915 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0022_000001 released container container_1426266260362_0022_01_000001 on node: host: 10.1.1.144:60715 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:10:58,915 INFO  capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0022_000001 is done. finalState=FINISHED
2015-03-13 10:10:58,916 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0022 requests cleared
2015-03-13 10:10:58,916 INFO  capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0022 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:10:58,916 INFO  capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0022 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:10:58,917 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0022_000001 (auth:SIMPLE)
2015-03-13 10:10:58,918 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0022_01_000001
2015-03-13 10:10:59,106 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742095_1271
2015-03-13 10:10:59,172 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0022 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:10:59,172 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0022
2015-03-13 10:10:59,172 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0022
2015-03-13 10:10:59,172 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0022
2015-03-13 10:10:59,172 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0022 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:10:59,173 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0022, with delay of 10800 seconds
2015-03-13 10:10:59,172 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0022
2015-03-13 10:10:59,173 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0022
2015-03-13 10:10:59,174 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0023_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:10:59,175 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0023_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:10:59,175 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0023_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:10:59,175 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0023_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:10:59,175 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0023_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:10:59,202 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.jar	dst=null	perm=null
2015-03-13 10:10:59,203 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.jar	dst=null	perm=null
2015-03-13 10:10:59,211 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.xml	dst=null	perm=null
2015-03-13 10:10:59,212 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.xml	dst=null	perm=null
2015-03-13 10:10:59,214 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:10:59,215 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:10:59,220 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:10:59,222 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:10:59,223 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:10:59,224 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:10:59,300 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0023_000001 (auth:SIMPLE)
2015-03-13 10:10:59,300 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0023_000001 (auth:SIMPLE)
2015-03-13 10:10:59,303 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0023_01_000005 by user soberoi
2015-03-13 10:10:59,303 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0023_01_000004 by user soberoi
2015-03-13 10:10:59,303 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0023_01_000006 by user soberoi
2015-03-13 10:10:59,303 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0023	CONTAINERID=container_1426266260362_0023_01_000004
2015-03-13 10:10:59,303 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0023
2015-03-13 10:10:59,303 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0023	CONTAINERID=container_1426266260362_0023_01_000006
2015-03-13 10:10:59,304 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0023_01_000004 to application application_1426266260362_0023
2015-03-13 10:10:59,303 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0023
2015-03-13 10:10:59,304 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0023	CONTAINERID=container_1426266260362_0023_01_000005
2015-03-13 10:10:59,304 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0023 transitioned from NEW to INITING
2015-03-13 10:10:59,304 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0023_01_000006 to application application_1426266260362_0023
2015-03-13 10:10:59,304 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0023 transitioned from NEW to INITING
2015-03-13 10:10:59,304 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0023_01_000005 to application application_1426266260362_0023
2015-03-13 10:10:59,304 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0023 transitioned from INITING to RUNNING
2015-03-13 10:10:59,305 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:10:59,305 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0023
2015-03-13 10:10:59,305 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0023
2015-03-13 10:10:59,305 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:10:59,305 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0023
2015-03-13 10:10:59,305 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:10:59,305 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:10:59,305 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0023_01_000006
2015-03-13 10:10:59,304 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0023 transitioned from INITING to RUNNING
2015-03-13 10:10:59,306 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:10:59,305 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0023_01_000002 by user soberoi
2015-03-13 10:10:59,306 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0023	CONTAINERID=container_1426266260362_0023_01_000002
2015-03-13 10:10:59,306 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0023_01_000003 by user soberoi
2015-03-13 10:10:59,307 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0023	CONTAINERID=container_1426266260362_0023_01_000003
2015-03-13 10:10:59,306 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:10:59,307 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0023
2015-03-13 10:10:59,307 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0023
2015-03-13 10:10:59,307 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:10:59,307 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0023
2015-03-13 10:10:59,307 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:10:59,307 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:10:59,308 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0023
2015-03-13 10:10:59,308 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0023
2015-03-13 10:10:59,308 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:10:59,308 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0023
2015-03-13 10:10:59,308 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0023_01_000002 to application application_1426266260362_0023
2015-03-13 10:10:59,308 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0023_01_000003 to application application_1426266260362_0023
2015-03-13 10:10:59,308 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0023_01_000005
2015-03-13 10:10:59,309 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0023_01_000004
2015-03-13 10:10:59,309 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:10:59,310 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:10:59,310 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0023
2015-03-13 10:10:59,310 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0023
2015-03-13 10:10:59,310 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:10:59,310 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0023
2015-03-13 10:10:59,310 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0023
2015-03-13 10:10:59,310 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0023
2015-03-13 10:10:59,310 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:10:59,310 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0023
2015-03-13 10:10:59,310 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0023_01_000002
2015-03-13 10:10:59,312 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0023_01_000003
2015-03-13 10:10:59,331 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1426266260362_0023_01_000005.tokens. Credentials list: 
2015-03-13 10:10:59,331 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426266260362_0023_01_000006.tokens. Credentials list: 
2015-03-13 10:10:59,332 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1426266260362_0023_01_000004.tokens. Credentials list: 
2015-03-13 10:10:59,332 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1426266260362_0023_01_000003.tokens. Credentials list: 
2015-03-13 10:10:59,333 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426266260362_0023_01_000002.tokens. Credentials list: 
2015-03-13 10:10:59,352 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:10:59,353 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:10:59,430 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426266260362_0023_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000006.tokens
2015-03-13 10:10:59,430 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0023 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0023
2015-03-13 10:10:59,430 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1426266260362_0023_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000005.tokens
2015-03-13 10:10:59,430 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0023 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0023
2015-03-13 10:10:59,468 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:59,468 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0023_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:10:59,500 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.jar	dst=null	perm=null
2015-03-13 10:10:59,500 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.jar	dst=null	perm=null
2015-03-13 10:10:59,501 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.jar	dst=null	perm=null
2015-03-13 10:10:59,501 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.jar	dst=null	perm=null
2015-03-13 10:10:59,502 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.jar	dst=null	perm=null
2015-03-13 10:10:59,502 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.jar	dst=null	perm=null
2015-03-13 10:10:59,509 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62756, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_727660181_12297, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742095_1271, duration: 458000
2015-03-13 10:10:59,510 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62757, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1315627514_12296, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742095_1271, duration: 508000
2015-03-13 10:10:59,518 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0022 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:10:59,518 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0022
2015-03-13 10:10:59,519 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0022
2015-03-13 10:10:59,519 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0022
2015-03-13 10:10:59,519 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0022
2015-03-13 10:10:59,519 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0022 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:10:59,519 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0022, with delay of 10800 seconds
2015-03-13 10:10:59,519 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0022
2015-03-13 10:10:59,536 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:59,536 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:59,557 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.xml	dst=null	perm=null
2015-03-13 10:10:59,558 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.xml	dst=null	perm=null
2015-03-13 10:10:59,558 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.xml	dst=null	perm=null
2015-03-13 10:10:59,558 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.xml	dst=null	perm=null
2015-03-13 10:10:59,558 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.xml	dst=null	perm=null
2015-03-13 10:10:59,559 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.xml	dst=null	perm=null
2015-03-13 10:10:59,565 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62756, bytes: 98620, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1315627514_12296, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742098_1274, duration: 236000
2015-03-13 10:10:59,565 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62758, bytes: 98620, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_727660181_12297, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742098_1274, duration: 254000
2015-03-13 10:10:59,579 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:59,579 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:10:59,580 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:10:59,579 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:10:59,579 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:59,580 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:10:59,580 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:10:59,631 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:10:59,631 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:59,632 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:10:59,632 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:59,632 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:10:59,632 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:59,633 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:10:59,633 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:59,633 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:10:59,634 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:59,710 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742099_1275
2015-03-13 10:10:59,768 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000005/default_container_executor.sh]
2015-03-13 10:10:59,769 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000002/default_container_executor.sh]
2015-03-13 10:10:59,769 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000006/default_container_executor.sh]
2015-03-13 10:10:59,770 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000004/default_container_executor.sh]
2015-03-13 10:10:59,770 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000003/default_container_executor.sh]
2015-03-13 10:10:59,860 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742099_1275
2015-03-13 10:10:59,914 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:59,914 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0022 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:10:59,914 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0022
2015-03-13 10:10:59,915 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0022
2015-03-13 10:10:59,915 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0022
2015-03-13 10:10:59,915 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0022 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:10:59,915 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0022, with delay of 10800 seconds
2015-03-13 10:10:59,915 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0022
2015-03-13 10:10:59,916 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0022
2015-03-13 10:11:00,065 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742099_1275
2015-03-13 10:11:00,176 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:00,177 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:00,177 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:00,177 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:00,177 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0023_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:11:00,177 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0023_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:11:00,177 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0023_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:11:00,178 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0023_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:11:00,188 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:11:00,473 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:00,608 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:11:00,724 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426266260362_0023_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000002.tokens
2015-03-13 10:11:00,725 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0023 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0023
2015-03-13 10:11:00,839 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:11:00,915 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:00,955 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1426266260362_0023_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000003.tokens
2015-03-13 10:11:00,955 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0023 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0023
2015-03-13 10:11:01,059 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:11:01,174 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1426266260362_0023_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000004.tokens
2015-03-13 10:11:01,174 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0023 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0023
2015-03-13 10:11:01,181 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:01,181 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:01,181 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:01,181 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:01,478 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:01,917 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:02,185 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:02,185 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:02,185 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:02,185 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:02,480 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:02,918 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:03,186 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:03,186 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:03,186 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:03,186 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:03,484 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:03,922 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:04,187 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:04,188 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:04,188 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:04,188 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:04,486 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:04,924 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:05,191 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:05,191 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:05,192 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:05,192 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:05,490 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:05,929 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:06,194 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:06,194 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:06,194 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:06,195 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:06,494 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:06,931 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:07,198 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:07,198 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:07,199 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:07,199 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:07,496 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:07,546 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.split	dst=null	perm=null
2015-03-13 10:11:07,705 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.split	dst=null	perm=null
2015-03-13 10:11:07,760 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.split	dst=null	perm=null
2015-03-13 10:11:07,786 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62769, bytes: 1282, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000002_0_-52856569_1, offset: 512, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742096_1272, duration: 143000
2015-03-13 10:11:07,797 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.split	dst=null	perm=null
2015-03-13 10:11:07,808 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.split	dst=null	perm=null
2015-03-13 10:11:07,862 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62773, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000001_0_-1932647283_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742096_1272, duration: 161000
2015-03-13 10:11:07,921 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62775, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000000_0_1749206131_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742096_1272, duration: 150000
2015-03-13 10:11:07,927 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:11:07,931 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62769, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000002_0_-52856569_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 167000
2015-03-13 10:11:07,933 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62774, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000004_0_-330135731_1, offset: 1024, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742096_1272, duration: 155000
2015-03-13 10:11:07,938 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:07,958 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/_temporary/attempt_1426266260362_0023_m_000002_0/part-00002	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:07,970 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62776, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000003_0_1427193032_1, offset: 1024, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742096_1272, duration: 155000
2015-03-13 10:11:07,997 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:11:08,001 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62777, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000001_0_-1932647283_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 138000
2015-03-13 10:11:08,023 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/_temporary/attempt_1426266260362_0023_m_000001_0/part-00001	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:08,045 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:11:08,061 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:11:08,072 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62774, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000004_0_-330135731_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 144000
2015-03-13 10:11:08,077 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/_temporary/attempt_1426266260362_0023_m_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:08,093 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/_temporary/attempt_1426266260362_0023_m_000004_0/part-00004	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:08,098 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:11:08,103 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62778, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000003_0_1427193032_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 145000
2015-03-13 10:11:08,124 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/_temporary/attempt_1426266260362_0023_m_000003_0/part-00003	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:08,202 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:08,203 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:08,203 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:08,203 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:08,385 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703	dst=null	perm=null
2015-03-13 10:11:08,390 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703	dst=null	perm=null
2015-03-13 10:11:08,392 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703	dst=null	perm=null
2015-03-13 10:11:08,430 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00000	dst=null	perm=null
2015-03-13 10:11:08,431 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00000	dst=null	perm=null
2015-03-13 10:11:08,431 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703	dst=null	perm=null
2015-03-13 10:11:08,434 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62779, bytes: 118, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000002_0_-52856569_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742090_1266, duration: 151000
2015-03-13 10:11:08,436 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703	dst=null	perm=null
2015-03-13 10:11:08,439 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703	dst=null	perm=null
2015-03-13 10:11:08,448 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00001	dst=null	perm=null
2015-03-13 10:11:08,449 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00001	dst=null	perm=null
2015-03-13 10:11:08,455 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62780, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000002_0_-52856569_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742091_1267, duration: 144000
2015-03-13 10:11:08,459 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00002	dst=null	perm=null
2015-03-13 10:11:08,460 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00002	dst=null	perm=null
2015-03-13 10:11:08,465 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62781, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000002_0_-52856569_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742087_1263, duration: 176000
2015-03-13 10:11:08,467 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00003	dst=null	perm=null
2015-03-13 10:11:08,469 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00003	dst=null	perm=null
2015-03-13 10:11:08,471 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62779, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000002_0_-52856569_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742088_1264, duration: 153000
2015-03-13 10:11:08,473 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00004	dst=null	perm=null
2015-03-13 10:11:08,475 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00004	dst=null	perm=null
2015-03-13 10:11:08,478 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62782, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000002_0_-52856569_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742086_1262, duration: 149000
2015-03-13 10:11:08,482 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703	dst=null	perm=null
2015-03-13 10:11:08,487 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703	dst=null	perm=null
2015-03-13 10:11:08,490 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703	dst=null	perm=null
2015-03-13 10:11:08,495 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00000	dst=null	perm=null
2015-03-13 10:11:08,496 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00000	dst=null	perm=null
2015-03-13 10:11:08,499 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62783, bytes: 118, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000001_0_-1932647283_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742090_1266, duration: 137000
2015-03-13 10:11:08,499 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:08,505 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703	dst=null	perm=null
2015-03-13 10:11:08,508 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/_temporary/attempt_1426266260362_0023_m_000002_0/part-00002. BP-1005356445-10.1.1.144-1426266257849 blk_1073742100_1276{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:11:08,511 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703	dst=null	perm=null
2015-03-13 10:11:08,514 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703	dst=null	perm=null
2015-03-13 10:11:08,521 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00001	dst=null	perm=null
2015-03-13 10:11:08,522 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00001	dst=null	perm=null
2015-03-13 10:11:08,524 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62783, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000001_0_-1932647283_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742091_1267, duration: 159000
2015-03-13 10:11:08,531 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00002	dst=null	perm=null
2015-03-13 10:11:08,532 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00002	dst=null	perm=null
2015-03-13 10:11:08,534 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62783, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000001_0_-1932647283_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742087_1263, duration: 148000
2015-03-13 10:11:08,536 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00003	dst=null	perm=null
2015-03-13 10:11:08,538 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00003	dst=null	perm=null
2015-03-13 10:11:08,540 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62785, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000001_0_-1932647283_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742088_1264, duration: 153000
2015-03-13 10:11:08,543 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00004	dst=null	perm=null
2015-03-13 10:11:08,544 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00004	dst=null	perm=null
2015-03-13 10:11:08,547 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62786, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000001_0_-1932647283_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742086_1262, duration: 180000
2015-03-13 10:11:08,550 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742100_1276 src: /127.0.0.1:62784 dest: /127.0.0.1:60686
2015-03-13 10:11:08,551 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742100_1276 src: /127.0.0.1:62787 dest: /127.0.0.1:60696
2015-03-13 10:11:08,552 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742100_1276 src: /127.0.0.1:62788 dest: /127.0.0.1:60693
2015-03-13 10:11:08,554 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703	dst=null	perm=null
2015-03-13 10:11:08,559 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703	dst=null	perm=null
2015-03-13 10:11:08,560 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62788, dest: /127.0.0.1:60693, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0023_m_000002_0_-52856569_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742100_1276, duration: 5855000
2015-03-13 10:11:08,560 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742100_1276, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:08,561 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742100_1276{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:11:08,561 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62787, dest: /127.0.0.1:60696, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0023_m_000002_0_-52856569_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742100_1276, duration: 6890000
2015-03-13 10:11:08,561 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742100_1276, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:08,562 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62784, dest: /127.0.0.1:60686, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0023_m_000002_0_-52856569_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742100_1276, duration: 8089000
2015-03-13 10:11:08,562 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742100_1276, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:08,562 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742100_1276{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:11:08,563 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742100_1276{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:11:08,566 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703	dst=null	perm=null
2015-03-13 10:11:08,567 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/_temporary/attempt_1426266260362_0023_m_000002_0/part-00002 is closed by DFSClient_attempt_1426266260362_0023_m_000002_0_-52856569_1
2015-03-13 10:11:08,577 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/_temporary/attempt_1426266260362_0023_m_000002_0	dst=null	perm=null
2015-03-13 10:11:08,578 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/_temporary/attempt_1426266260362_0023_m_000001_0/part-00001. BP-1005356445-10.1.1.144-1426266257849 blk_1073742101_1277{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:11:08,583 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/_temporary/attempt_1426266260362_0023_m_000002_0	dst=null	perm=null
2015-03-13 10:11:08,584 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/task_1426266260362_0023_m_000002	dst=null	perm=null
2015-03-13 10:11:08,589 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/_temporary/attempt_1426266260362_0023_m_000002_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/task_1426266260362_0023_m_000002	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:11:08,609 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0023_01_000004
2015-03-13 10:11:08,609 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0023	CONTAINERID=container_1426266260362_0023_01_000004
2015-03-13 10:11:08,609 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:11:08,610 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0023_01_000004
2015-03-13 10:11:08,610 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:08,610 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:08,610 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:11:08,611 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:08,622 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0023_01_000004 is : 143
2015-03-13 10:11:08,625 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job_1426266260362_0023_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073742102_1278{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:11:08,627 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742102_1278 src: /127.0.0.1:62790 dest: /127.0.0.1:60689
2015-03-13 10:11:08,628 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742102_1278 src: /127.0.0.1:62791 dest: /127.0.0.1:60686
2015-03-13 10:11:08,630 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742102_1278 src: /127.0.0.1:62792 dest: /127.0.0.1:60693
2015-03-13 10:11:08,634 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:11:08,634 INFO  hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job_1426266260362_0023_1.jhist for DFSClient_NONMAPREDUCE_-872052556_1
2015-03-13 10:11:08,635 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000004
2015-03-13 10:11:08,635 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0023	CONTAINERID=container_1426266260362_0023_01_000004
2015-03-13 10:11:08,635 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:11:08,635 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0023_01_000004 from application application_1426266260362_0023
2015-03-13 10:11:08,635 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000004
2015-03-13 10:11:08,636 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000004
2015-03-13 10:11:08,635 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000004
2015-03-13 10:11:08,635 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:08,636 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0023
2015-03-13 10:11:08,650 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742101_1277 src: /127.0.0.1:62789 dest: /127.0.0.1:60689
2015-03-13 10:11:08,651 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742101_1277 src: /127.0.0.1:62793 dest: /127.0.0.1:60696
2015-03-13 10:11:08,653 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742101_1277 src: /127.0.0.1:62794 dest: /127.0.0.1:60686
2015-03-13 10:11:08,656 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00000	dst=null	perm=null
2015-03-13 10:11:08,658 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00000	dst=null	perm=null
2015-03-13 10:11:08,661 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62794, dest: /127.0.0.1:60686, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0023_m_000001_0_-1932647283_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742101_1277, duration: 7181000
2015-03-13 10:11:08,661 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742101_1277, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:08,662 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742101_1277{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:08,662 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62793, dest: /127.0.0.1:60696, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0023_m_000001_0_-1932647283_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742101_1277, duration: 7821000
2015-03-13 10:11:08,662 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742101_1277, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:08,662 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742101_1277{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:08,663 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62789, dest: /127.0.0.1:60689, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0023_m_000001_0_-1932647283_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742101_1277, duration: 8551000
2015-03-13 10:11:08,663 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742101_1277, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:08,663 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742101_1277{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:08,668 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/_temporary/attempt_1426266260362_0023_m_000001_0/part-00001 is closed by DFSClient_attempt_1426266260362_0023_m_000001_0_-1932647283_1
2015-03-13 10:11:08,669 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62795, bytes: 118, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000000_0_1749206131_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742090_1266, duration: 147000
2015-03-13 10:11:08,680 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00000	dst=null	perm=null
2015-03-13 10:11:08,681 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00000	dst=null	perm=null
2015-03-13 10:11:08,688 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62796, bytes: 118, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000004_0_-330135731_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742090_1266, duration: 166000
2015-03-13 10:11:08,693 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/_temporary/attempt_1426266260362_0023_m_000001_0	dst=null	perm=null
2015-03-13 10:11:08,699 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/_temporary/attempt_1426266260362_0023_m_000001_0	dst=null	perm=null
2015-03-13 10:11:08,700 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/task_1426266260362_0023_m_000001	dst=null	perm=null
2015-03-13 10:11:08,704 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/_temporary/attempt_1426266260362_0023_m_000001_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/task_1426266260362_0023_m_000001	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:11:08,707 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00001	dst=null	perm=null
2015-03-13 10:11:08,708 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00001	dst=null	perm=null
2015-03-13 10:11:08,710 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62797, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000000_0_1749206131_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742091_1267, duration: 155000
2015-03-13 10:11:08,713 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00002	dst=null	perm=null
2015-03-13 10:11:08,715 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00002	dst=null	perm=null
2015-03-13 10:11:08,715 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0023_01_000003
2015-03-13 10:11:08,716 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0023	CONTAINERID=container_1426266260362_0023_01_000003
2015-03-13 10:11:08,716 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:11:08,716 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:08,716 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0023_01_000003
2015-03-13 10:11:08,716 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:11:08,716 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:11:08,717 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0023_01_000004
2015-03-13 10:11:08,717 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:08,717 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0023_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:11:08,717 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0023_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:11:08,717 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0023	CONTAINERID=container_1426266260362_0023_01_000004
2015-03-13 10:11:08,717 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0023_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:11:08,717 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:11:08,718 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0023_01_000004, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:08,718 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:08,719 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:11:08,719 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0023_000001 released container container_1426266260362_0023_01_000004 on node: host: 10.1.1.144:60723 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:11:08,729 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62795, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000000_0_1749206131_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742087_1263, duration: 164000
2015-03-13 10:11:08,730 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0023_01_000003 is : 143
2015-03-13 10:11:08,733 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00003	dst=null	perm=null
2015-03-13 10:11:08,734 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00003	dst=null	perm=null
2015-03-13 10:11:08,736 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62795, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000000_0_1749206131_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742088_1264, duration: 139000
2015-03-13 10:11:08,738 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00001	dst=null	perm=null
2015-03-13 10:11:08,738 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00004	dst=null	perm=null
2015-03-13 10:11:08,739 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00001	dst=null	perm=null
2015-03-13 10:11:08,740 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00004	dst=null	perm=null
2015-03-13 10:11:08,741 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62796, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000004_0_-330135731_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742091_1267, duration: 141000
2015-03-13 10:11:08,742 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62798, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000000_0_1749206131_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742086_1262, duration: 127000
2015-03-13 10:11:08,743 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:11:08,743 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000003
2015-03-13 10:11:08,743 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000003
2015-03-13 10:11:08,744 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000003
2015-03-13 10:11:08,744 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000003
2015-03-13 10:11:08,744 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0023	CONTAINERID=container_1426266260362_0023_01_000003
2015-03-13 10:11:08,744 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:11:08,745 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0023_01_000003 from application application_1426266260362_0023
2015-03-13 10:11:08,745 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:08,745 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0023
2015-03-13 10:11:08,746 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00002	dst=null	perm=null
2015-03-13 10:11:08,747 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00002	dst=null	perm=null
2015-03-13 10:11:08,747 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62775, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000000_0_1749206131_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 165000
2015-03-13 10:11:08,747 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00000	dst=null	perm=null
2015-03-13 10:11:08,749 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00000	dst=null	perm=null
2015-03-13 10:11:08,750 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62799, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000004_0_-330135731_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742087_1263, duration: 135000
2015-03-13 10:11:08,751 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62776, bytes: 118, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000003_0_1427193032_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742090_1266, duration: 124000
2015-03-13 10:11:08,753 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00003	dst=null	perm=null
2015-03-13 10:11:08,754 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00003	dst=null	perm=null
2015-03-13 10:11:08,756 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62796, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000004_0_-330135731_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742088_1264, duration: 151000
2015-03-13 10:11:08,759 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00004	dst=null	perm=null
2015-03-13 10:11:08,761 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00004	dst=null	perm=null
2015-03-13 10:11:08,766 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62800, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000004_0_-330135731_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742086_1262, duration: 145000
2015-03-13 10:11:08,770 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/_temporary/attempt_1426266260362_0023_m_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073742103_1279{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:11:08,770 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00001	dst=null	perm=null
2015-03-13 10:11:08,771 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00001	dst=null	perm=null
2015-03-13 10:11:08,774 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62801, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000003_0_1427193032_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742091_1267, duration: 154000
2015-03-13 10:11:08,780 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/_temporary/attempt_1426266260362_0023_m_000004_0/part-00004 is closed by DFSClient_attempt_1426266260362_0023_m_000004_0_-330135731_1
2015-03-13 10:11:08,780 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00002	dst=null	perm=null
2015-03-13 10:11:08,781 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00002	dst=null	perm=null
2015-03-13 10:11:08,793 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62803, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000003_0_1427193032_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742087_1263, duration: 149000
2015-03-13 10:11:08,794 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/_temporary/attempt_1426266260362_0023_m_000004_0	dst=null	perm=null
2015-03-13 10:11:08,799 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00003	dst=null	perm=null
2015-03-13 10:11:08,800 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00003	dst=null	perm=null
2015-03-13 10:11:08,800 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/_temporary/attempt_1426266260362_0023_m_000004_0	dst=null	perm=null
2015-03-13 10:11:08,801 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/task_1426266260362_0023_m_000004	dst=null	perm=null
2015-03-13 10:11:08,803 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62804, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000003_0_1427193032_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742088_1264, duration: 152000
2015-03-13 10:11:08,805 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/_temporary/attempt_1426266260362_0023_m_000004_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/task_1426266260362_0023_m_000004	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:11:08,806 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00004	dst=null	perm=null
2015-03-13 10:11:08,807 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00004	dst=null	perm=null
2015-03-13 10:11:08,810 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62803, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000003_0_1427193032_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742086_1262, duration: 143000
2015-03-13 10:11:08,812 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742103_1279 src: /127.0.0.1:62802 dest: /127.0.0.1:60693
2015-03-13 10:11:08,814 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742103_1279 src: /127.0.0.1:62805 dest: /127.0.0.1:60689
2015-03-13 10:11:08,815 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742103_1279 src: /127.0.0.1:62806 dest: /127.0.0.1:60696
2015-03-13 10:11:08,821 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0023_01_000006
2015-03-13 10:11:08,821 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0023	CONTAINERID=container_1426266260362_0023_01_000006
2015-03-13 10:11:08,822 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:11:08,822 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0023_01_000006
2015-03-13 10:11:08,822 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:11:08,833 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62806, dest: /127.0.0.1:60696, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0023_m_000000_0_1749206131_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742103_1279, duration: 16462000
2015-03-13 10:11:08,834 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742103_1279, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:08,834 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742103_1279{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:08,834 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62805, dest: /127.0.0.1:60689, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0023_m_000000_0_1749206131_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742103_1279, duration: 17553000
2015-03-13 10:11:08,835 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742103_1279, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:08,835 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0023_01_000006 is : 143
2015-03-13 10:11:08,835 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62802, dest: /127.0.0.1:60693, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0023_m_000000_0_1749206131_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742103_1279, duration: 18474000
2015-03-13 10:11:08,836 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742103_1279, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:08,835 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742103_1279{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:08,836 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742103_1279{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:08,842 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/_temporary/attempt_1426266260362_0023_m_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0023_m_000000_0_1749206131_1
2015-03-13 10:11:08,847 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:11:08,847 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000006
2015-03-13 10:11:08,847 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0023	CONTAINERID=container_1426266260362_0023_01_000006
2015-03-13 10:11:08,847 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:11:08,847 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000006
2015-03-13 10:11:08,848 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000006
2015-03-13 10:11:08,848 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000006
2015-03-13 10:11:08,847 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0023_01_000006 from application application_1426266260362_0023
2015-03-13 10:11:08,848 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:08,848 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0023
2015-03-13 10:11:08,851 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/_temporary/attempt_1426266260362_0023_m_000003_0/part-00003. BP-1005356445-10.1.1.144-1426266257849 blk_1073742104_1280{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:11:08,855 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/_temporary/attempt_1426266260362_0023_m_000000_0	dst=null	perm=null
2015-03-13 10:11:08,861 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/_temporary/attempt_1426266260362_0023_m_000000_0	dst=null	perm=null
2015-03-13 10:11:08,866 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/task_1426266260362_0023_m_000000	dst=null	perm=null
2015-03-13 10:11:08,872 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/_temporary/attempt_1426266260362_0023_m_000000_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/task_1426266260362_0023_m_000000	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:11:08,888 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0023_01_000002
2015-03-13 10:11:08,888 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0023	CONTAINERID=container_1426266260362_0023_01_000002
2015-03-13 10:11:08,889 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:11:08,889 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:08,889 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0023_01_000002
2015-03-13 10:11:08,889 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:11:08,889 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0023_01_000003
2015-03-13 10:11:08,889 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:08,890 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0023_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:11:08,890 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0023_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:11:08,890 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0023	CONTAINERID=container_1426266260362_0023_01_000003
2015-03-13 10:11:08,890 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0023_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:11:08,890 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:11:08,891 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0023_01_000003, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:08,891 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:08,891 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:11:08,891 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0023_000001 released container container_1426266260362_0023_01_000003 on node: host: 10.1.1.144:60723 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:11:08,902 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0023_01_000002 is : 143
2015-03-13 10:11:08,904 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742104_1280 src: /127.0.0.1:62807 dest: /127.0.0.1:60686
2015-03-13 10:11:08,906 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742104_1280 src: /127.0.0.1:62808 dest: /127.0.0.1:60689
2015-03-13 10:11:08,907 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742104_1280 src: /127.0.0.1:62809 dest: /127.0.0.1:60696
2015-03-13 10:11:08,915 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:11:08,916 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62809, dest: /127.0.0.1:60696, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0023_m_000003_0_1427193032_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742104_1280, duration: 7315000
2015-03-13 10:11:08,916 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000002
2015-03-13 10:11:08,916 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742104_1280, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:08,916 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62808, dest: /127.0.0.1:60689, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0023_m_000003_0_1427193032_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742104_1280, duration: 7812000
2015-03-13 10:11:08,916 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742104_1280{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:08,916 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742104_1280, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:08,917 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742104_1280{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:08,917 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62807, dest: /127.0.0.1:60686, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0023_m_000003_0_1427193032_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742104_1280, duration: 8526000
2015-03-13 10:11:08,917 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742104_1280, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:08,918 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742104_1280{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:08,918 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000002
2015-03-13 10:11:08,918 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000002
2015-03-13 10:11:08,919 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000002
2015-03-13 10:11:08,919 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0023	CONTAINERID=container_1426266260362_0023_01_000002
2015-03-13 10:11:08,919 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:11:08,919 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0023_01_000002 from application application_1426266260362_0023
2015-03-13 10:11:08,919 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:08,919 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0023
2015-03-13 10:11:08,924 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/_temporary/attempt_1426266260362_0023_m_000003_0/part-00003 is closed by DFSClient_attempt_1426266260362_0023_m_000003_0_1427193032_1
2015-03-13 10:11:08,936 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/_temporary/attempt_1426266260362_0023_m_000003_0	dst=null	perm=null
2015-03-13 10:11:08,939 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:08,943 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/_temporary/attempt_1426266260362_0023_m_000003_0	dst=null	perm=null
2015-03-13 10:11:08,945 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/task_1426266260362_0023_m_000003	dst=null	perm=null
2015-03-13 10:11:08,948 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/_temporary/attempt_1426266260362_0023_m_000003_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/task_1426266260362_0023_m_000003	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:11:08,960 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0023_01_000005
2015-03-13 10:11:08,961 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0023	CONTAINERID=container_1426266260362_0023_01_000005
2015-03-13 10:11:08,961 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:11:08,961 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:11:08,961 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0023_01_000002
2015-03-13 10:11:08,961 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:11:08,961 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0023_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:11:08,962 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0023_01_000005
2015-03-13 10:11:08,962 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0023_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:11:08,962 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0023	CONTAINERID=container_1426266260362_0023_01_000002
2015-03-13 10:11:08,962 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0023_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:11:08,962 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:11:08,963 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0023_01_000002, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:08,963 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:08,963 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:11:08,963 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0023_000001 released container container_1426266260362_0023_01_000002 on node: host: 10.1.1.144:60723 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:11:08,965 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:08,968 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-872052556_1
2015-03-13 10:11:08,972 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1	dst=null	perm=null
2015-03-13 10:11:08,975 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0023_01_000005 is : 143
2015-03-13 10:11:08,979 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself	dst=null	perm=null
2015-03-13 10:11:08,980 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself	dst=null	perm=null
2015-03-13 10:11:08,981 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/task_1426266260362_0023_m_000000	dst=null	perm=null
2015-03-13 10:11:08,983 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/part-00000	dst=null	perm=null
2015-03-13 10:11:08,986 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/task_1426266260362_0023_m_000000/part-00000	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/part-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:08,988 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:11:08,988 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000005
2015-03-13 10:11:08,989 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000005
2015-03-13 10:11:08,989 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000005
2015-03-13 10:11:08,989 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000005
2015-03-13 10:11:08,990 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself	dst=null	perm=null
2015-03-13 10:11:08,990 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0023	CONTAINERID=container_1426266260362_0023_01_000005
2015-03-13 10:11:08,991 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:11:08,991 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself	dst=null	perm=null
2015-03-13 10:11:08,991 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0023_01_000005 from application application_1426266260362_0023
2015-03-13 10:11:08,991 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:08,991 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0023
2015-03-13 10:11:08,992 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/task_1426266260362_0023_m_000001	dst=null	perm=null
2015-03-13 10:11:08,993 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/part-00001	dst=null	perm=null
2015-03-13 10:11:08,994 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/task_1426266260362_0023_m_000001/part-00001	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/part-00001	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:08,994 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself	dst=null	perm=null
2015-03-13 10:11:08,995 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself	dst=null	perm=null
2015-03-13 10:11:08,996 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/task_1426266260362_0023_m_000002	dst=null	perm=null
2015-03-13 10:11:08,997 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/part-00002	dst=null	perm=null
2015-03-13 10:11:08,998 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/task_1426266260362_0023_m_000002/part-00002	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/part-00002	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:08,999 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself	dst=null	perm=null
2015-03-13 10:11:09,000 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself	dst=null	perm=null
2015-03-13 10:11:09,001 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/task_1426266260362_0023_m_000003	dst=null	perm=null
2015-03-13 10:11:09,002 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/part-00003	dst=null	perm=null
2015-03-13 10:11:09,004 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/task_1426266260362_0023_m_000003/part-00003	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/part-00003	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:09,006 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself	dst=null	perm=null
2015-03-13 10:11:09,007 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself	dst=null	perm=null
2015-03-13 10:11:09,008 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/task_1426266260362_0023_m_000004	dst=null	perm=null
2015-03-13 10:11:09,009 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/part-00004	dst=null	perm=null
2015-03-13 10:11:09,011 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/task_1426266260362_0023_m_000004/part-00004	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/part-00004	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:09,015 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary	dst=null	perm=null
2015-03-13 10:11:09,019 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:09,021 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-872052556_1
2015-03-13 10:11:09,023 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:09,025 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-872052556_1
2015-03-13 10:11:09,037 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62792, dest: /127.0.0.1:60693, bytes: 53318, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-872052556_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742102_1278, duration: 405561000
2015-03-13 10:11:09,037 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742102_1278, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:09,040 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742102_1278{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:11:09,040 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62791, dest: /127.0.0.1:60686, bytes: 53318, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-872052556_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742102_1278, duration: 408089000
2015-03-13 10:11:09,040 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742102_1278, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:09,041 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742102_1278{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:11:09,041 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62790, dest: /127.0.0.1:60689, bytes: 53318, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-872052556_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742102_1278, duration: 408876000
2015-03-13 10:11:09,041 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742102_1278, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:09,041 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742102_1278{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:11:09,043 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job_1426266260362_0023_1.jhist is closed by DFSClient_NONMAPREDUCE_-872052556_1
2015-03-13 10:11:09,044 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0023.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:09,046 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0023.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742105_1281{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:11:09,048 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742105_1281 src: /127.0.0.1:62810 dest: /127.0.0.1:60686
2015-03-13 10:11:09,049 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742105_1281 src: /127.0.0.1:62811 dest: /127.0.0.1:60696
2015-03-13 10:11:09,050 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742105_1281 src: /127.0.0.1:62812 dest: /127.0.0.1:60689
2015-03-13 10:11:09,053 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62812, dest: /127.0.0.1:60689, bytes: 440, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-872052556_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742105_1281, duration: 1199000
2015-03-13 10:11:09,053 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742105_1281, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:09,053 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742105_1281{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:11:09,053 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62811, dest: /127.0.0.1:60696, bytes: 440, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-872052556_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742105_1281, duration: 1687000
2015-03-13 10:11:09,053 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742105_1281, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:09,054 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742105_1281{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:11:09,054 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62810, dest: /127.0.0.1:60686, bytes: 440, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-872052556_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742105_1281, duration: 2434000
2015-03-13 10:11:09,054 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742105_1281, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:09,054 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742105_1281{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:11:09,056 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0023.summary_tmp is closed by DFSClient_NONMAPREDUCE_-872052556_1
2015-03-13 10:11:09,060 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0023.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:11:09,065 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job_1426266260362_0023_1.jhist	dst=null	perm=null
2015-03-13 10:11:09,066 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0023-1426266653789-soberoi-%5B5C1ADEBEAF9544CFBB574223654F352B%2FD216C764973C483C-1426266669026-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:11:09,070 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job_1426266260362_0023_1.jhist	dst=null	perm=null
2015-03-13 10:11:09,071 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0023-1426266653789-soberoi-%5B5C1ADEBEAF9544CFBB574223654F352B%2FD216C764973C483C-1426266669026-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:11:09,072 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job_1426266260362_0023_1.jhist	dst=null	perm=null
2015-03-13 10:11:09,075 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0023-1426266653789-soberoi-%5B5C1ADEBEAF9544CFBB574223654F352B%2FD216C764973C483C-1426266669026-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:09,077 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62813, bytes: 53738, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-872052556_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742102_1278, duration: 177000
2015-03-13 10:11:09,079 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0023-1426266653789-soberoi-%5B5C1ADEBEAF9544CFBB574223654F352B%2FD216C764973C483C-1426266669026-5-0-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742106_1282{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:11:09,080 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742106_1282 src: /127.0.0.1:62814 dest: /127.0.0.1:60689
2015-03-13 10:11:09,081 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742106_1282 src: /127.0.0.1:62815 dest: /127.0.0.1:60693
2015-03-13 10:11:09,082 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742106_1282 src: /127.0.0.1:62816 dest: /127.0.0.1:60686
2015-03-13 10:11:09,085 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62816, dest: /127.0.0.1:60686, bytes: 53318, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-872052556_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742106_1282, duration: 1686000
2015-03-13 10:11:09,085 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742106_1282, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:09,086 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62815, dest: /127.0.0.1:60693, bytes: 53318, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-872052556_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742106_1282, duration: 2134000
2015-03-13 10:11:09,086 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742106_1282, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:09,086 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742106_1282{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:09,087 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62814, dest: /127.0.0.1:60689, bytes: 53318, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-872052556_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742106_1282, duration: 3161000
2015-03-13 10:11:09,087 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742106_1282, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:09,088 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742106_1282{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:09,088 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742106_1282{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:09,090 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0023-1426266653789-soberoi-%5B5C1ADEBEAF9544CFBB574223654F352B%2FD216C764973C483C-1426266669026-5-0-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-872052556_1
2015-03-13 10:11:09,093 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0023-1426266653789-soberoi-%5B5C1ADEBEAF9544CFBB574223654F352B%2FD216C764973C483C-1426266669026-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:11:09,094 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job_1426266260362_0023_1_conf.xml	dst=null	perm=null
2015-03-13 10:11:09,095 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0023_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:11:09,096 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job_1426266260362_0023_1_conf.xml	dst=null	perm=null
2015-03-13 10:11:09,096 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0023_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:11:09,097 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job_1426266260362_0023_1_conf.xml	dst=null	perm=null
2015-03-13 10:11:09,099 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0023_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:09,101 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62813, bytes: 91376, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-872052556_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742099_1275, duration: 240000
2015-03-13 10:11:09,103 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0023_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742107_1283{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:11:09,104 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742107_1283 src: /127.0.0.1:62817 dest: /127.0.0.1:60686
2015-03-13 10:11:09,106 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742107_1283 src: /127.0.0.1:62818 dest: /127.0.0.1:60689
2015-03-13 10:11:09,107 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742107_1283 src: /127.0.0.1:62819 dest: /127.0.0.1:60693
2015-03-13 10:11:09,110 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742106_1282
2015-03-13 10:11:09,110 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62819, dest: /127.0.0.1:60693, bytes: 90664, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-872052556_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742107_1283, duration: 1932000
2015-03-13 10:11:09,110 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742107_1283, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:09,110 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742103_1279
2015-03-13 10:11:09,111 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62818, dest: /127.0.0.1:60689, bytes: 90664, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-872052556_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742107_1283, duration: 2451000
2015-03-13 10:11:09,111 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742105_1281
2015-03-13 10:11:09,111 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742107_1283, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:09,111 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742107_1283{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:11:09,112 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62817, dest: /127.0.0.1:60686, bytes: 90664, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-872052556_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742107_1283, duration: 3270000
2015-03-13 10:11:09,112 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742107_1283, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:09,112 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742107_1283{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:11:09,112 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742107_1283
2015-03-13 10:11:09,113 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742107_1283{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:11:09,113 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742104_1280
2015-03-13 10:11:09,113 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742101_1277
2015-03-13 10:11:09,114 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742102_1278
2015-03-13 10:11:09,114 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0023_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-872052556_1
2015-03-13 10:11:09,116 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0023_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:11:09,118 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0023.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0023.summary	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:11:09,119 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0023_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0023_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:11:09,121 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0023-1426266653789-soberoi-%5B5C1ADEBEAF9544CFBB574223654F352B%2FD216C764973C483C-1426266669026-5-0-SUCCEEDED-default.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0023-1426266653789-soberoi-%5B5C1ADEBEAF9544CFBB574223654F352B%2FD216C764973C483C-1426266669026-5-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:11:09,128 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0023_000001 State change from RUNNING to FINISHING
2015-03-13 10:11:09,128 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0023
2015-03-13 10:11:09,128 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0023 State change from RUNNING to REMOVING
2015-03-13 10:11:09,128 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0023
2015-03-13 10:11:09,128 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0023 State change from REMOVING to FINISHING
2015-03-13 10:11:09,719 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742103_1279
2015-03-13 10:11:09,720 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742107_1283
2015-03-13 10:11:09,721 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742102_1278
2015-03-13 10:11:09,722 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742106_1282
2015-03-13 10:11:09,722 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742100_1276
2015-03-13 10:11:09,823 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:11:09,823 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0023_01_000006
2015-03-13 10:11:09,823 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0023_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:11:09,823 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0023_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:11:09,823 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0023	CONTAINERID=container_1426266260362_0023_01_000006
2015-03-13 10:11:09,824 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0023_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:11:09,824 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:11:09,825 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0023_01_000006, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:09,825 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:09,825 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:11:09,825 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0023_000001 released container container_1426266260362_0023_01_000006 on node: host: 10.1.1.144:60719 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:11:09,869 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742107_1283
2015-03-13 10:11:09,870 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742104_1280
2015-03-13 10:11:09,870 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742100_1276
2015-03-13 10:11:09,870 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742101_1277
2015-03-13 10:11:09,871 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742106_1282
2015-03-13 10:11:09,871 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742102_1278
2015-03-13 10:11:09,872 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742105_1281
2015-03-13 10:11:09,941 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:09,964 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:11:09,964 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0023_01_000005
2015-03-13 10:11:09,965 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0023_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:11:09,965 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0023_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:11:09,965 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0023	CONTAINERID=container_1426266260362_0023_01_000005
2015-03-13 10:11:09,965 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0023_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:11:09,966 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:11:09,966 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0023_01_000005, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:09,966 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:09,966 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:11:09,967 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0023_000001 released container container_1426266260362_0023_01_000005 on node: host: 10.1.1.144:60723 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:11:10,078 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742103_1279
2015-03-13 10:11:10,078 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742104_1280
2015-03-13 10:11:10,079 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742100_1276
2015-03-13 10:11:10,079 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742101_1277
2015-03-13 10:11:10,079 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742105_1281
2015-03-13 10:11:10,133 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742095_1271 127.0.0.1:60686 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60689 
2015-03-13 10:11:10,133 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742096_1272 127.0.0.1:60693 127.0.0.1:60689 127.0.0.1:60696 127.0.0.1:60686 
2015-03-13 10:11:10,133 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742097_1273 127.0.0.1:60693 127.0.0.1:60689 127.0.0.1:60696 
2015-03-13 10:11:10,133 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742098_1274 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60689 
2015-03-13 10:11:10,134 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742102_1278 127.0.0.1:60689 127.0.0.1:60686 127.0.0.1:60693 
2015-03-13 10:11:10,134 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742099_1275 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60693 
2015-03-13 10:11:10,134 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023	dst=null	perm=null
2015-03-13 10:11:10,174 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742090_1266 127.0.0.1:60693 127.0.0.1:60689 127.0.0.1:60696 
2015-03-13 10:11:10,174 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742091_1267 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60689 
2015-03-13 10:11:10,174 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742087_1263 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60689 
2015-03-13 10:11:10,174 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742088_1264 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60689 
2015-03-13 10:11:10,175 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742086_1262 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60693 
2015-03-13 10:11:10,175 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703	dst=null	perm=null
2015-03-13 10:11:10,175 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself	dst=null	perm=null
2015-03-13 10:11:10,176 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary
2015-03-13 10:11:10,176 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary	dst=null	perm=null
2015-03-13 10:11:10,183 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:11:10,183 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:11:10,184 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:11:10,185 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself	dst=null	perm=null
2015-03-13 10:11:10,185 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself	dst=null	perm=null
2015-03-13 10:11:10,186 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself	dst=null	perm=null
2015-03-13 10:11:10,187 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:11:10,188 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/part-00000	dst=null	perm=null
2015-03-13 10:11:10,189 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62821, bytes: 20, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742103_1279, duration: 120000
2015-03-13 10:11:10,190 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/part-00001	dst=null	perm=null
2015-03-13 10:11:10,192 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62822, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742101_1277, duration: 159000
2015-03-13 10:11:10,192 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/part-00002	dst=null	perm=null
2015-03-13 10:11:10,193 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62822, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742100_1276, duration: 130000
2015-03-13 10:11:10,194 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/part-00003	dst=null	perm=null
2015-03-13 10:11:10,195 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62822, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742104_1280, duration: 144000
2015-03-13 10:11:10,195 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/part-00004	dst=null	perm=null
2015-03-13 10:11:10,202 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:11:10,202 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:11:10,202 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:11:10,203 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself	dst=null	perm=null
2015-03-13 10:11:10,204 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself	dst=null	perm=null
2015-03-13 10:11:10,204 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself	dst=null	perm=null
2015-03-13 10:11:10,206 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:11:10,206 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/part-00000	dst=null	perm=null
2015-03-13 10:11:10,208 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62823, bytes: 20, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742103_1279, duration: 176000
2015-03-13 10:11:10,209 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/part-00001	dst=null	perm=null
2015-03-13 10:11:10,210 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62821, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742101_1277, duration: 141000
2015-03-13 10:11:10,211 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/part-00002	dst=null	perm=null
2015-03-13 10:11:10,212 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62822, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742100_1276, duration: 157000
2015-03-13 10:11:10,212 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/part-00003	dst=null	perm=null
2015-03-13 10:11:10,213 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62822, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742104_1280, duration: 135000
2015-03-13 10:11:10,214 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/part-00004	dst=null	perm=null
2015-03-13 10:11:10,214 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/joinself
2015-03-13 10:11:10,214 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself	dst=null	perm=null
2015-03-13 10:11:10,215 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself	dst=null	perm=null
2015-03-13 10:11:10,215 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself	dst=null	perm=null
2015-03-13 10:11:10,216 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself	dst=null	perm=null
2015-03-13 10:11:10,217 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/part-00000	dst=null	perm=null
2015-03-13 10:11:10,217 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/part-00000	dst=null	perm=null
2015-03-13 10:11:10,218 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62823, bytes: 20, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742103_1279, duration: 118000
2015-03-13 10:11:10,219 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/part-00001	dst=null	perm=null
2015-03-13 10:11:10,219 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/part-00001	dst=null	perm=null
2015-03-13 10:11:10,221 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62824, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742101_1277, duration: 172000
2015-03-13 10:11:10,222 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/part-00002	dst=null	perm=null
2015-03-13 10:11:10,222 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/part-00002	dst=null	perm=null
2015-03-13 10:11:10,223 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62823, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742100_1276, duration: 168000
2015-03-13 10:11:10,224 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/part-00003	dst=null	perm=null
2015-03-13 10:11:10,224 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/part-00003	dst=null	perm=null
2015-03-13 10:11:10,226 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62822, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742104_1280, duration: 163000
2015-03-13 10:11:10,226 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/part-00004	dst=null	perm=null
2015-03-13 10:11:10,227 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/part-00004	dst=null	perm=null
2015-03-13 10:11:10,228 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:11:10,229 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:11:10,237 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:11:10,238 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:11:10,238 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:11:10,258 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped	dst=null	perm=null
2015-03-13 10:11:10,259 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [upper2*lower*upper1] starting
2015-03-13 10:11:10,259 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [upper2*lower*upper1]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt"]
2015-03-13 10:11:10,260 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [upper2*lower*upper1]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-03-13 10:11:10,260 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [upper2*lower*upper1]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt"]
2015-03-13 10:11:10,260 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [upper2*lower*upper1]  sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped"]
2015-03-13 10:11:10,260 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [upper2*lower*upper1]  parallel execution is enabled: true
2015-03-13 10:11:10,260 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [upper2*lower*upper1]  starting jobs: 2
2015-03-13 10:11:10,260 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [upper2*lower*upper1]  allocating threads: 2
2015-03-13 10:11:10,261 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [upper2*lower*upper1] starting step: (2/2)
2015-03-13 10:11:10,280 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:11:10,288 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:11:10,289 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5	dst=null	perm=null
2015-03-13 10:11:10,290 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:11:10,290 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:11:10,292 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 24
2015-03-13 10:11:10,293 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024	dst=null	perm=null
2015-03-13 10:11:10,294 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024	dst=null	perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:11:10,295 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024	dst=null	perm=soberoi:supergroup:rwx------
2015-03-13 10:11:10,296 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.jar	dst=null	perm=null
2015-03-13 10:11:10,297 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:11:10,298 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073742108_1284{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:11:10,299 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742108_1284 src: /127.0.0.1:62826 dest: /127.0.0.1:60686
2015-03-13 10:11:10,301 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742108_1284 src: /127.0.0.1:62827 dest: /127.0.0.1:60693
2015-03-13 10:11:10,301 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742108_1284 src: /127.0.0.1:62828 dest: /127.0.0.1:60689
2015-03-13 10:11:10,305 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62828, dest: /127.0.0.1:60689, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742108_1284, duration: 1897000
2015-03-13 10:11:10,306 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742108_1284, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:10,306 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742108_1284{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:11:10,306 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62827, dest: /127.0.0.1:60693, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742108_1284, duration: 2555000
2015-03-13 10:11:10,306 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742108_1284, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:10,307 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742108_1284{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:11:10,307 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62826, dest: /127.0.0.1:60686, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742108_1284, duration: 3008000
2015-03-13 10:11:10,307 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742108_1284, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:10,307 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742108_1284{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:11:10,308 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:11:10,309 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.jar
2015-03-13 10:11:10,309 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.jar	dst=null	perm=null
2015-03-13 10:11:10,310 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:11:10,311 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:11:10,312 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:11:10,313 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:11:10,313 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:11:10,314 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:11:10,314 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:11:10,315 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:11:10,316 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:11:10,316 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:11:10,318 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:11:10,318 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:11:10,319 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:11:10,320 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:11:10,321 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:11:10,322 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.split
2015-03-13 10:11:10,322 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.split	dst=null	perm=null
2015-03-13 10:11:10,323 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073742109_1285{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:11:10,325 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742109_1285 src: /127.0.0.1:62829 dest: /127.0.0.1:60689
2015-03-13 10:11:10,326 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742109_1285 src: /127.0.0.1:62830 dest: /127.0.0.1:60693
2015-03-13 10:11:10,327 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742109_1285 src: /127.0.0.1:62831 dest: /127.0.0.1:60696
2015-03-13 10:11:10,328 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742109_1285 src: /127.0.0.1:62832 dest: /127.0.0.1:60686
2015-03-13 10:11:10,331 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62832, dest: /127.0.0.1:60686, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742109_1285, duration: 1527000
2015-03-13 10:11:10,331 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742109_1285, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:10,331 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742109_1285{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:10,331 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62831, dest: /127.0.0.1:60696, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742109_1285, duration: 1848000
2015-03-13 10:11:10,332 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742109_1285, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:10,332 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742109_1285{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:10,332 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62830, dest: /127.0.0.1:60693, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742109_1285, duration: 2631000
2015-03-13 10:11:10,332 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742109_1285, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:10,333 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742109_1285{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:10,333 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62829, dest: /127.0.0.1:60689, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742109_1285, duration: 3443000
2015-03-13 10:11:10,333 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742109_1285, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:10,334 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742109_1285{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:10,335 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:11:10,336 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:11:10,337 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:11:10,338 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073742110_1286{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:11:10,339 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742110_1286 src: /127.0.0.1:62833 dest: /127.0.0.1:60686
2015-03-13 10:11:10,340 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742110_1286 src: /127.0.0.1:62834 dest: /127.0.0.1:60689
2015-03-13 10:11:10,341 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742110_1286 src: /127.0.0.1:62835 dest: /127.0.0.1:60696
2015-03-13 10:11:10,343 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62835, dest: /127.0.0.1:60696, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742110_1286, duration: 1197000
2015-03-13 10:11:10,344 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742110_1286, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:10,344 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742110_1286{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:10,344 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62834, dest: /127.0.0.1:60689, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742110_1286, duration: 1546000
2015-03-13 10:11:10,344 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742110_1286, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:10,344 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742110_1286{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:10,345 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62833, dest: /127.0.0.1:60686, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742110_1286, duration: 2287000
2015-03-13 10:11:10,345 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742110_1286, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:10,345 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742110_1286{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:10,346 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:11:10,346 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:11:10,347 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:11:10,349 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:11:10,349 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:11:10,350 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:11:10,350 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:11:10,352 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742111_1287{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:11:10,354 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742111_1287 src: /127.0.0.1:62836 dest: /127.0.0.1:60693
2015-03-13 10:11:10,355 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742111_1287 src: /127.0.0.1:62837 dest: /127.0.0.1:60689
2015-03-13 10:11:10,356 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742111_1287 src: /127.0.0.1:62838 dest: /127.0.0.1:60696
2015-03-13 10:11:10,359 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62838, dest: /127.0.0.1:60696, bytes: 97854, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742111_1287, duration: 1344000
2015-03-13 10:11:10,359 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742111_1287, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:10,359 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742111_1287{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:10,359 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62837, dest: /127.0.0.1:60689, bytes: 97854, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742111_1287, duration: 1694000
2015-03-13 10:11:10,360 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742111_1287, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:10,360 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742111_1287{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:10,360 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62836, dest: /127.0.0.1:60693, bytes: 97854, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742111_1287, duration: 2469000
2015-03-13 10:11:10,360 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742111_1287, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:10,361 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742111_1287{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:10,362 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:11:10,362 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0024
2015-03-13 10:11:10,363 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024	dst=null	perm=null
2015-03-13 10:11:10,363 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.xml	dst=null	perm=null
2015-03-13 10:11:10,364 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.xml	dst=null	perm=null
2015-03-13 10:11:10,365 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.jar	dst=null	perm=null
2015-03-13 10:11:10,365 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.jar	dst=null	perm=null
2015-03-13 10:11:10,366 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.split	dst=null	perm=null
2015-03-13 10:11:10,367 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.split	dst=null	perm=null
2015-03-13 10:11:10,367 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:11:10,368 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:11:10,370 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:11:10,371 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:11:10,371 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:11:10,372 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:11:10,373 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:11:10,374 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:11:10,375 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 24 submitted by user soberoi
2015-03-13 10:11:10,375 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0024
2015-03-13 10:11:10,375 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	IP=10.1.1.144	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1426266260362_0024
2015-03-13 10:11:10,375 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0024
2015-03-13 10:11:10,375 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0024 State change from NEW to NEW_SAVING
2015-03-13 10:11:10,376 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0024 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:11:10,376 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0024_000001
2015-03-13 10:11:10,376 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0024_000001 State change from NEW to SUBMITTED
2015-03-13 10:11:10,376 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0024 from user: soberoi activated in queue: default
2015-03-13 10:11:10,376 INFO  capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0024 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:11:10,377 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0024 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:11:10,377 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0024 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:11:10,377 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0024_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:11:10,377 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0024_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:11:10,378 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0024 State change from SUBMITTED to ACCEPTED
2015-03-13 10:11:10,379 INFO  mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0024/
2015-03-13 10:11:10,380 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [upper2*lower*upper1] submitted hadoop job: job_1426266260362_0024
2015-03-13 10:11:10,380 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [upper2*lower*upper1] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0024/
2015-03-13 10:11:10,542 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0024_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:11:10,542 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0024	CONTAINERID=container_1426266260362_0024_01_000001
2015-03-13 10:11:10,542 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0024_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:11:10,542 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0024 container=Container: [ContainerId: container_1426266260362_0024_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0024_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:10,542 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:11:10,542 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0024_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:11:10,542 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:10,543 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0024 AttemptId: appattempt_1426266260362_0024_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0024_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ]
2015-03-13 10:11:10,543 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0024_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:11:10,543 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0024_000001
2015-03-13 10:11:10,544 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0024_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:11:10,544 INFO  amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0024_000001
2015-03-13 10:11:10,544 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0024_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] for AM appattempt_1426266260362_0024_000001
2015-03-13 10:11:10,545 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0024_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-03-13 10:11:10,547 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0024_000001 (auth:SIMPLE)
2015-03-13 10:11:10,548 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0024_01_000001 by user soberoi
2015-03-13 10:11:10,548 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0024
2015-03-13 10:11:10,548 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0024	CONTAINERID=container_1426266260362_0024_01_000001
2015-03-13 10:11:10,548 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0024 transitioned from NEW to INITING
2015-03-13 10:11:10,548 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0024_01_000001 to application application_1426266260362_0024
2015-03-13 10:11:10,548 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0024_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] for AM appattempt_1426266260362_0024_000001
2015-03-13 10:11:10,548 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0024 transitioned from INITING to RUNNING
2015-03-13 10:11:10,549 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0024_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:11:10,549 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:11:10,549 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0024
2015-03-13 10:11:10,549 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:11:10,549 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:11:10,549 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:11:10,549 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:11:10,550 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0024_01_000001
2015-03-13 10:11:10,559 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0024_01_000001.tokens. Credentials list: 
2015-03-13 10:11:10,574 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:11:10,642 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0024_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000001.tokens
2015-03-13 10:11:10,642 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0024 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0024
2015-03-13 10:11:10,702 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.jar	dst=null	perm=null
2015-03-13 10:11:10,702 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.jar	dst=null	perm=null
2015-03-13 10:11:10,703 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.jar	dst=null	perm=null
2015-03-13 10:11:10,709 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62823, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1604125116_12714, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742108_1284, duration: 525000
2015-03-13 10:11:10,728 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:11:10,744 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:11:10,744 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:11:10,745 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:11:10,750 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62822, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1604125116_12714, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742110_1286, duration: 161000
2015-03-13 10:11:10,763 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:11:10,779 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.split	dst=null	perm=null
2015-03-13 10:11:10,779 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.split	dst=null	perm=null
2015-03-13 10:11:10,780 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.split	dst=null	perm=null
2015-03-13 10:11:10,785 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62823, bytes: 1798, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1604125116_12714, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742109_1285, duration: 145000
2015-03-13 10:11:10,797 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:11:10,815 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.xml	dst=null	perm=null
2015-03-13 10:11:10,815 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.xml	dst=null	perm=null
2015-03-13 10:11:10,816 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.xml	dst=null	perm=null
2015-03-13 10:11:10,822 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62823, bytes: 98622, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1604125116_12714, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742111_1287, duration: 266000
2015-03-13 10:11:10,835 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:11:10,835 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:11:10,859 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:11:10,859 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:10,926 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000001/default_container_executor.sh]
2015-03-13 10:11:10,942 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:11,545 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:11,546 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0024_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:11:11,946 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:12,443 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:11:12,464 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/COMMIT_STARTED	dst=null	perm=null
2015-03-13 10:11:12,465 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/COMMIT_SUCCESS	dst=null	perm=null
2015-03-13 10:11:12,466 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/COMMIT_FAIL	dst=null	perm=null
2015-03-13 10:11:12,515 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024	dst=null	perm=null
2015-03-13 10:11:12,516 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:11:12,517 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:11:12,549 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:12,787 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:11:12,794 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:11:12,847 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62843, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1654895269_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742110_1286, duration: 129000
2015-03-13 10:11:12,951 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:12,996 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60689 to replicate blk_1073742108_1284 to datanode(s) 127.0.0.1:60696
2015-03-13 10:11:12,996 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073742096_1272, blk_1073742098_1274, blk_1073742099_1275, blk_1073742086_1262, blk_1073742102_1278, blk_1073742087_1263, blk_1073742091_1267, blk_1073742095_1271]
2015-03-13 10:11:12,996 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073742096_1272, blk_1073742097_1273, blk_1073742098_1274, blk_1073742086_1262, blk_1073742102_1278, blk_1073742087_1263, blk_1073742088_1264, blk_1073742090_1266, blk_1073742091_1267, blk_1073742095_1271]
2015-03-13 10:11:13,553 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:13,587 INFO  datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-1172757413-10.1.1.144-60689-1426266259165, infoPort=60690, ipcPort=60692, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073742108_1284 to 127.0.0.1:60696 
2015-03-13 10:11:13,587 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742096_1272 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742096 for deletion
2015-03-13 10:11:13,587 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742096_1272 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742096 for deletion
2015-03-13 10:11:13,587 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742098_1274 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742098 for deletion
2015-03-13 10:11:13,587 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742097_1273 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742097 for deletion
2015-03-13 10:11:13,587 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742099_1275 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742099 for deletion
2015-03-13 10:11:13,587 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742102_1278 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742102 for deletion
2015-03-13 10:11:13,588 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742086_1262 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742086 for deletion
2015-03-13 10:11:13,588 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742087_1263 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742087 for deletion
2015-03-13 10:11:13,588 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742091_1267 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742091 for deletion
2015-03-13 10:11:13,588 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742095_1271 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742095 for deletion
2015-03-13 10:11:13,588 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742096_1272 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742096
2015-03-13 10:11:13,587 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742098_1274 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742098 for deletion
2015-03-13 10:11:13,588 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742097_1273 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742097
2015-03-13 10:11:13,588 INFO  datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073742108_1284 (numBytes=254067) to /127.0.0.1:60696
2015-03-13 10:11:13,588 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742096_1272 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742096
2015-03-13 10:11:13,589 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742098_1274 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742098
2015-03-13 10:11:13,588 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742098_1274 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742098
2015-03-13 10:11:13,588 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742102_1278 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742102 for deletion
2015-03-13 10:11:13,589 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742099_1275 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742099
2015-03-13 10:11:13,589 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742086_1262 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742086 for deletion
2015-03-13 10:11:13,589 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742086_1262 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742086
2015-03-13 10:11:13,589 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742102_1278 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742102
2015-03-13 10:11:13,589 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742087_1263 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742087 for deletion
2015-03-13 10:11:13,589 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742088_1264 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742088 for deletion
2015-03-13 10:11:13,589 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742108_1284 src: /127.0.0.1:62847 dest: /127.0.0.1:60696
2015-03-13 10:11:13,589 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742102_1278 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742102
2015-03-13 10:11:13,590 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742086_1262 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742086
2015-03-13 10:11:13,590 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742087_1263 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742087
2015-03-13 10:11:13,589 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742090_1266 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742090 for deletion
2015-03-13 10:11:13,590 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742091_1267 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742091 for deletion
2015-03-13 10:11:13,590 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742095_1271 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742095 for deletion
2015-03-13 10:11:13,589 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742087_1263 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742087
2015-03-13 10:11:13,590 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742091_1267 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742091
2015-03-13 10:11:13,591 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742095_1271 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742095
2015-03-13 10:11:13,590 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742091_1267 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742091
2015-03-13 10:11:13,590 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742088_1264 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742088
2015-03-13 10:11:13,591 INFO  datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073742108_1284 src: /127.0.0.1:62847 dest: /127.0.0.1:60696 of size 254067
2015-03-13 10:11:13,592 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742090_1266 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742090
2015-03-13 10:11:13,592 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742095_1271 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742095
2015-03-13 10:11:13,592 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742108_1284 size 254067
2015-03-13 10:11:13,637 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0024_000001 (auth:SIMPLE)
2015-03-13 10:11:13,638 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0024_000001
2015-03-13 10:11:13,638 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi	IP=10.1.1.144	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1426266260362_0024	APPATTEMPTID=appattempt_1426266260362_0024_000001
2015-03-13 10:11:13,638 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0024_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:11:13,638 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0024 State change from ACCEPTED to RUNNING
2015-03-13 10:11:13,656 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job_1426266260362_0024_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:13,659 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:11:13,723 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job_1426266260362_0024_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:13,852 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job_1426266260362_0024_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742112_1288{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:11:13,892 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742112_1288 src: /127.0.0.1:62850 dest: /127.0.0.1:60693
2015-03-13 10:11:13,893 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742112_1288 src: /127.0.0.1:62851 dest: /127.0.0.1:60689
2015-03-13 10:11:13,895 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742112_1288 src: /127.0.0.1:62852 dest: /127.0.0.1:60686
2015-03-13 10:11:13,901 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62852, dest: /127.0.0.1:60686, bytes: 90776, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1654895269_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742112_1288, duration: 4839000
2015-03-13 10:11:13,901 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742112_1288, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:13,902 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742112_1288{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:13,902 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62851, dest: /127.0.0.1:60689, bytes: 90776, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1654895269_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742112_1288, duration: 5505000
2015-03-13 10:11:13,902 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742112_1288, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:13,902 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742112_1288{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:13,903 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62850, dest: /127.0.0.1:60693, bytes: 90776, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1654895269_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742112_1288, duration: 6245000
2015-03-13 10:11:13,903 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742112_1288, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:13,903 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742112_1288{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:13,907 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job_1426266260362_0024_1_conf.xml is closed by DFSClient_NONMAPREDUCE_1654895269_1
2015-03-13 10:11:13,955 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:14,116 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742109_1285
2015-03-13 10:11:14,118 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742108_1284
2015-03-13 10:11:14,319 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742111_1287
2015-03-13 10:11:14,320 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742110_1286
2015-03-13 10:11:14,320 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742112_1288
2015-03-13 10:11:14,557 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:14,725 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742109_1285
2015-03-13 10:11:14,727 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742108_1284
2015-03-13 10:11:14,832 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0024_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:11:14,832 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0024	CONTAINERID=container_1426266260362_0024_01_000002
2015-03-13 10:11:14,832 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0024_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:11:14,832 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0024 container=Container: [ContainerId: container_1426266260362_0024_01_000002, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0024_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:14,833 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:11:14,833 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:14,833 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0024_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:11:14,833 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0024	CONTAINERID=container_1426266260362_0024_01_000003
2015-03-13 10:11:14,833 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0024_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:11:14,834 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0024 container=Container: [ContainerId: container_1426266260362_0024_01_000003, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0024_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:14,834 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:11:14,834 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:14,834 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0024_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:11:14,834 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0024	CONTAINERID=container_1426266260362_0024_01_000004
2015-03-13 10:11:14,835 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0024_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:11:14,835 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0024 container=Container: [ContainerId: container_1426266260362_0024_01_000004, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0024_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:14,835 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:11:14,835 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:14,835 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0024_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:11:14,835 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0024	CONTAINERID=container_1426266260362_0024_01_000005
2015-03-13 10:11:14,835 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0024_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:11:14,836 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0024 container=Container: [ContainerId: container_1426266260362_0024_01_000005, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0024_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:14,836 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:11:14,836 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:14,879 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742109_1285
2015-03-13 10:11:14,880 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742110_1286
2015-03-13 10:11:14,881 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742108_1284
2015-03-13 10:11:14,882 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742112_1288
2015-03-13 10:11:14,931 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742112_1288
2015-03-13 10:11:14,932 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742111_1287
2015-03-13 10:11:14,958 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:14,958 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0024_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:11:14,959 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0024	CONTAINERID=container_1426266260362_0024_01_000006
2015-03-13 10:11:14,959 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0024_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:11:14,959 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0024 container=Container: [ContainerId: container_1426266260362_0024_01_000006, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0024_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:14,959 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7
2015-03-13 10:11:14,959 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:15,083 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742110_1286
2015-03-13 10:11:15,083 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742111_1287
2015-03-13 10:11:15,084 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742109_1285
2015-03-13 10:11:15,085 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742108_1284
2015-03-13 10:11:15,165 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0023_01_000001 succeeded 
2015-03-13 10:11:15,165 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:11:15,165 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0023_01_000001
2015-03-13 10:11:15,173 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000001
2015-03-13 10:11:15,173 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000001
2015-03-13 10:11:15,173 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000001
2015-03-13 10:11:15,173 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000001
2015-03-13 10:11:15,173 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0023	CONTAINERID=container_1426266260362_0023_01_000001
2015-03-13 10:11:15,173 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:11:15,174 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0023_01_000001 from application application_1426266260362_0023
2015-03-13 10:11:15,174 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:15,174 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0023
2015-03-13 10:11:15,559 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:15,668 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0024_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:11:15,668 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0024_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:11:15,668 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0024_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:11:15,669 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0024_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:11:15,669 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0024_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:11:15,696 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.jar	dst=null	perm=null
2015-03-13 10:11:15,697 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.jar	dst=null	perm=null
2015-03-13 10:11:15,705 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.xml	dst=null	perm=null
2015-03-13 10:11:15,706 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.xml	dst=null	perm=null
2015-03-13 10:11:15,708 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:11:15,709 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:11:15,714 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:11:15,715 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:11:15,716 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:11:15,718 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:11:15,790 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0024_000001 (auth:SIMPLE)
2015-03-13 10:11:15,790 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0024_000001 (auth:SIMPLE)
2015-03-13 10:11:15,793 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0024_01_000003 by user soberoi
2015-03-13 10:11:15,794 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0024_01_000006 by user soberoi
2015-03-13 10:11:15,794 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0024
2015-03-13 10:11:15,794 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0024
2015-03-13 10:11:15,794 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0024	CONTAINERID=container_1426266260362_0024_01_000003
2015-03-13 10:11:15,794 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0024 transitioned from NEW to INITING
2015-03-13 10:11:15,794 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0024_01_000003 to application application_1426266260362_0024
2015-03-13 10:11:15,794 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0024_01_000005 by user soberoi
2015-03-13 10:11:15,794 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0024 transitioned from INITING to RUNNING
2015-03-13 10:11:15,795 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0024	CONTAINERID=container_1426266260362_0024_01_000005
2015-03-13 10:11:15,795 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:11:15,794 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0024_01_000002 by user soberoi
2015-03-13 10:11:15,794 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0024	CONTAINERID=container_1426266260362_0024_01_000006
2015-03-13 10:11:15,795 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0024	CONTAINERID=container_1426266260362_0024_01_000002
2015-03-13 10:11:15,795 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0024
2015-03-13 10:11:15,795 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0024
2015-03-13 10:11:15,795 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:11:15,796 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0024
2015-03-13 10:11:15,796 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0024_01_000005 to application application_1426266260362_0024
2015-03-13 10:11:15,796 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:11:15,796 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:11:15,796 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0024_01_000002 to application application_1426266260362_0024
2015-03-13 10:11:15,794 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0024 transitioned from NEW to INITING
2015-03-13 10:11:15,796 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0024_01_000006 to application application_1426266260362_0024
2015-03-13 10:11:15,796 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:11:15,796 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0024_01_000003
2015-03-13 10:11:15,794 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0024_01_000004 by user soberoi
2015-03-13 10:11:15,796 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0024 transitioned from INITING to RUNNING
2015-03-13 10:11:15,797 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0024	CONTAINERID=container_1426266260362_0024_01_000004
2015-03-13 10:11:15,797 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:11:15,797 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0024
2015-03-13 10:11:15,797 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0024
2015-03-13 10:11:15,797 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:11:15,797 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0024
2015-03-13 10:11:15,797 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:11:15,797 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:11:15,797 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0024
2015-03-13 10:11:15,797 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0024
2015-03-13 10:11:15,797 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:11:15,797 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0024
2015-03-13 10:11:15,798 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0024_01_000004 to application application_1426266260362_0024
2015-03-13 10:11:15,798 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0024
2015-03-13 10:11:15,798 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0024
2015-03-13 10:11:15,798 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:11:15,798 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0024
2015-03-13 10:11:15,798 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0024_01_000005
2015-03-13 10:11:15,797 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:11:15,799 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0024_01_000006
2015-03-13 10:11:15,799 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:11:15,799 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0024_01_000002
2015-03-13 10:11:15,800 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0024
2015-03-13 10:11:15,800 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0024
2015-03-13 10:11:15,800 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:11:15,800 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0024
2015-03-13 10:11:15,801 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0024_01_000004
2015-03-13 10:11:15,822 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1426266260362_0024_01_000003.tokens. Credentials list: 
2015-03-13 10:11:15,823 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0024_01_000002.tokens. Credentials list: 
2015-03-13 10:11:15,823 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426266260362_0024_01_000006.tokens. Credentials list: 
2015-03-13 10:11:15,824 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426266260362_0024_01_000004.tokens. Credentials list: 
2015-03-13 10:11:15,824 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1426266260362_0024_01_000005.tokens. Credentials list: 
2015-03-13 10:11:15,832 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:15,833 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:15,833 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:15,833 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:15,833 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0024_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:11:15,833 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0024_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:11:15,834 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0024_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:11:15,834 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0024_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:11:15,842 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:11:15,842 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:11:15,921 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426266260362_0024_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000006.tokens
2015-03-13 10:11:15,921 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0024 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0024
2015-03-13 10:11:15,922 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1426266260362_0024_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000003.tokens
2015-03-13 10:11:15,922 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0024 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0024
2015-03-13 10:11:15,959 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:11:15,959 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0023_01_000001
2015-03-13 10:11:15,959 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:15,960 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0024_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:11:15,960 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0023_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:11:15,960 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0023_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:11:15,960 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0023	CONTAINERID=container_1426266260362_0023_01_000001
2015-03-13 10:11:15,960 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0023_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:11:15,960 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:7168, vCores:6> numContainers=6 user=soberoi user-resources=<memory:7168, vCores:6>
2015-03-13 10:11:15,960 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0023_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:15,960 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:15,960 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6
2015-03-13 10:11:15,960 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0023_000001 released container container_1426266260362_0023_01_000001 on node: host: 10.1.1.144:60715 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:11:15,960 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0023_000001
2015-03-13 10:11:15,961 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0023_000001 State change from FINISHING to FINISHED
2015-03-13 10:11:15,961 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0023 State change from FINISHING to FINISHED
2015-03-13 10:11:15,961 INFO  capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0023_000001 is done. finalState=FINISHED
2015-03-13 10:11:15,961 INFO  amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0023_000001
2015-03-13 10:11:15,961 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0023 requests cleared
2015-03-13 10:11:15,961 INFO  capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0023 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:11:15,961 INFO  capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0023 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:11:15,961 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1426266260362_0023
2015-03-13 10:11:15,962 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0023,name=[5C1ADEBEAF9544CFBB574223654F352B/D216C764973C483CA6D2DDC3E72E5438] lower*upper/(1/2) ...dedpipesplatform/joinself,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0023/jobhistory/job/job_1426266260362_0023,appMasterHost=Edinburgh.local,startTime=1426266653789,finishTime=1426266669128,finalStatus=SUCCEEDED
2015-03-13 10:11:15,963 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0023_000001 (auth:SIMPLE)
2015-03-13 10:11:15,965 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0023_01_000001
2015-03-13 10:11:15,986 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0023 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:11:15,986 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0023
2015-03-13 10:11:15,987 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0023 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:11:15,987 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0023, with delay of 10800 seconds
2015-03-13 10:11:15,987 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0023
2015-03-13 10:11:15,987 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0023
2015-03-13 10:11:15,987 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0023
2015-03-13 10:11:15,987 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0023
2015-03-13 10:11:15,997 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073742096_1272, blk_1073742097_1273, blk_1073742098_1274, blk_1073742099_1275, blk_1073742086_1262, blk_1073742102_1278, blk_1073742088_1264, blk_1073742090_1266, blk_1073742095_1271]
2015-03-13 10:11:15,997 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073742096_1272, blk_1073742097_1273, blk_1073742099_1275, blk_1073742087_1263, blk_1073742088_1264, blk_1073742090_1266, blk_1073742091_1267, blk_1073742095_1271]
2015-03-13 10:11:16,003 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.jar	dst=null	perm=null
2015-03-13 10:11:16,004 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.jar	dst=null	perm=null
2015-03-13 10:11:16,005 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.jar	dst=null	perm=null
2015-03-13 10:11:16,005 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.jar	dst=null	perm=null
2015-03-13 10:11:16,005 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.jar	dst=null	perm=null
2015-03-13 10:11:16,005 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.jar	dst=null	perm=null
2015-03-13 10:11:16,013 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62860, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-599587954_12860, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742108_1284, duration: 353000
2015-03-13 10:11:16,013 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62861, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1431582356_12859, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742108_1284, duration: 538000
2015-03-13 10:11:16,039 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:11:16,039 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:11:16,057 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.xml	dst=null	perm=null
2015-03-13 10:11:16,057 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.xml	dst=null	perm=null
2015-03-13 10:11:16,058 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.xml	dst=null	perm=null
2015-03-13 10:11:16,058 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.xml	dst=null	perm=null
2015-03-13 10:11:16,059 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.xml	dst=null	perm=null
2015-03-13 10:11:16,059 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.xml	dst=null	perm=null
2015-03-13 10:11:16,066 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62861, bytes: 98622, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-599587954_12860, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742111_1287, duration: 259000
2015-03-13 10:11:16,066 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62862, bytes: 98622, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1431582356_12859, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742111_1287, duration: 251000
2015-03-13 10:11:16,081 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:11:16,081 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:11:16,081 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:11:16,081 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:11:16,082 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:11:16,082 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:11:16,081 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:11:16,129 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:11:16,129 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:16,131 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:11:16,131 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:11:16,131 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:16,132 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:16,143 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:11:16,143 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:16,144 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:11:16,144 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:16,264 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000004/default_container_executor.sh]
2015-03-13 10:11:16,271 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000005/default_container_executor.sh]
2015-03-13 10:11:16,271 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000002/default_container_executor.sh]
2015-03-13 10:11:16,292 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000003/default_container_executor.sh]
2015-03-13 10:11:16,295 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000006/default_container_executor.sh]
2015-03-13 10:11:16,560 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:16,683 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:11:16,792 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742096_1272 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742096 for deletion
2015-03-13 10:11:16,792 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742097_1273 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742097 for deletion
2015-03-13 10:11:16,792 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742096_1272 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742096
2015-03-13 10:11:16,792 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742098_1274 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742098 for deletion
2015-03-13 10:11:16,793 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742097_1273 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742097
2015-03-13 10:11:16,793 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742099_1275 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742099 for deletion
2015-03-13 10:11:16,793 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742098_1274 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742098
2015-03-13 10:11:16,793 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742102_1278 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742102 for deletion
2015-03-13 10:11:16,793 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742086_1262 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742086 for deletion
2015-03-13 10:11:16,793 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742099_1275 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742099
2015-03-13 10:11:16,793 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742088_1264 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742088 for deletion
2015-03-13 10:11:16,793 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742090_1266 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742090 for deletion
2015-03-13 10:11:16,793 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742102_1278 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742102
2015-03-13 10:11:16,793 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742095_1271 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742095 for deletion
2015-03-13 10:11:16,793 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742090_1266 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742090
2015-03-13 10:11:16,793 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742086_1262 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742086
2015-03-13 10:11:16,794 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742088_1264 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742088
2015-03-13 10:11:16,794 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742095_1271 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742095
2015-03-13 10:11:16,838 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:16,839 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:16,839 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:16,839 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:16,839 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0023 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:11:16,839 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0023
2015-03-13 10:11:16,840 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0023
2015-03-13 10:11:16,840 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0023
2015-03-13 10:11:16,840 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0023 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:11:16,840 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0023, with delay of 10800 seconds
2015-03-13 10:11:16,840 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0023
2015-03-13 10:11:16,840 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0023
2015-03-13 10:11:16,961 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:16,961 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0023 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:11:16,962 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0023
2015-03-13 10:11:16,962 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0023
2015-03-13 10:11:16,962 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0023
2015-03-13 10:11:16,962 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0023 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:11:16,962 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0023, with delay of 10800 seconds
2015-03-13 10:11:16,962 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0023
2015-03-13 10:11:16,963 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0023
2015-03-13 10:11:16,973 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742096_1272 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742096 for deletion
2015-03-13 10:11:16,973 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742097_1273 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742097 for deletion
2015-03-13 10:11:16,974 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742099_1275 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742099 for deletion
2015-03-13 10:11:16,974 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742096_1272 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742096
2015-03-13 10:11:16,974 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742087_1263 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742087 for deletion
2015-03-13 10:11:16,974 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742097_1273 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742097
2015-03-13 10:11:16,974 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742088_1264 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742088 for deletion
2015-03-13 10:11:16,974 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742099_1275 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742099
2015-03-13 10:11:16,974 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742090_1266 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742090 for deletion
2015-03-13 10:11:16,974 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742091_1267 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742091 for deletion
2015-03-13 10:11:16,974 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742088_1264 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742088
2015-03-13 10:11:16,974 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742095_1271 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742095 for deletion
2015-03-13 10:11:16,974 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742087_1263 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742087
2015-03-13 10:11:16,974 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742090_1266 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742090
2015-03-13 10:11:16,975 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742091_1267 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742091
2015-03-13 10:11:16,975 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742095_1271 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742095
2015-03-13 10:11:17,116 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:11:17,228 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1426266260362_0024_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000005.tokens
2015-03-13 10:11:17,228 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0024 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0024
2015-03-13 10:11:17,328 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:11:17,463 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426266260362_0024_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000004.tokens
2015-03-13 10:11:17,463 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0024 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0024
2015-03-13 10:11:17,562 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:17,569 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:11:17,701 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0024_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000002.tokens
2015-03-13 10:11:17,702 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0024 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0024
2015-03-13 10:11:17,843 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:17,843 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:17,843 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:17,843 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:17,962 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:18,564 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:18,848 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:18,848 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:18,848 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:18,849 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:18,967 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:19,569 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:19,853 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:19,853 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:19,853 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:19,853 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:19,968 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:20,575 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:20,857 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:20,857 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:20,857 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:20,857 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:20,970 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:21,580 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:21,858 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:21,858 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:21,858 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:21,858 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:21,974 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:22,582 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:22,860 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:22,860 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:22,861 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:22,861 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:22,975 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:23,587 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:23,861 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:23,861 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:23,862 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:23,862 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:23,980 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:24,036 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.split	dst=null	perm=null
2015-03-13 10:11:24,179 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.split	dst=null	perm=null
2015-03-13 10:11:24,186 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.split	dst=null	perm=null
2015-03-13 10:11:24,246 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.split	dst=null	perm=null
2015-03-13 10:11:24,258 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62874, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0024_m_000001_0_1865062451_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742109_1285, duration: 152000
2015-03-13 10:11:24,338 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.split	dst=null	perm=null
2015-03-13 10:11:24,375 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62876, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0024_m_000003_0_312247103_1, offset: 1024, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742109_1285, duration: 176000
2015-03-13 10:11:24,385 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62878, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0024_m_000000_0_-988689571_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742109_1285, duration: 142000
2015-03-13 10:11:24,419 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62879, bytes: 1282, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0024_m_000002_0_-687252152_1, offset: 512, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742109_1285, duration: 162000
2015-03-13 10:11:24,432 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:11:24,436 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62880, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0024_m_000001_0_1865062451_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 156000
2015-03-13 10:11:24,482 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/_temporary/attempt_1426266260362_0024_m_000001_0/part-00001	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:24,492 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:11:24,497 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62882, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0024_m_000003_0_312247103_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 145000
2015-03-13 10:11:24,504 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62881, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0024_m_000004_0_-1004890562_1, offset: 1024, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742109_1285, duration: 168000
2015-03-13 10:11:24,513 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:11:24,541 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:11:24,545 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/_temporary/attempt_1426266260362_0024_m_000003_0/part-00003	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:24,545 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62879, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0024_m_000002_0_-687252152_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 131000
2015-03-13 10:11:24,552 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/_temporary/attempt_1426266260362_0024_m_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:24,589 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:24,602 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/_temporary/attempt_1426266260362_0024_m_000002_0/part-00002	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:24,622 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:11:24,625 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62883, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0024_m_000004_0_-1004890562_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 150000
2015-03-13 10:11:24,686 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/_temporary/attempt_1426266260362_0024_m_000004_0/part-00004	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:24,867 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:24,867 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:24,867 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:24,867 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:24,896 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:11:24,906 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:11:24,911 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:11:24,914 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62874, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0024_m_000001_0_1865062451_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 152000
2015-03-13 10:11:24,954 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/_temporary/attempt_1426266260362_0024_m_000001_0/part-00001. BP-1005356445-10.1.1.144-1426266257849 blk_1073742113_1289{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:11:24,981 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:24,990 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:11:24,996 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742113_1289 src: /127.0.0.1:62884 dest: /127.0.0.1:60696
2015-03-13 10:11:24,996 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:11:24,998 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742113_1289 src: /127.0.0.1:62885 dest: /127.0.0.1:60689
2015-03-13 10:11:24,999 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742113_1289 src: /127.0.0.1:62886 dest: /127.0.0.1:60693
2015-03-13 10:11:25,002 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:11:25,009 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:11:25,010 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62886, dest: /127.0.0.1:60693, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0024_m_000001_0_1865062451_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742113_1289, duration: 9559000
2015-03-13 10:11:25,010 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742113_1289, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:25,011 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742113_1289{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:11:25,011 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62885, dest: /127.0.0.1:60689, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0024_m_000001_0_1865062451_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742113_1289, duration: 10294000
2015-03-13 10:11:25,011 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742113_1289, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:25,011 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742113_1289{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:11:25,012 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62884, dest: /127.0.0.1:60696, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0024_m_000001_0_1865062451_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742113_1289, duration: 10972000
2015-03-13 10:11:25,012 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742113_1289, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:25,012 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742113_1289{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:11:25,014 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62876, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0024_m_000003_0_312247103_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 115000
2015-03-13 10:11:25,016 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/_temporary/attempt_1426266260362_0024_m_000001_0/part-00001 is closed by DFSClient_attempt_1426266260362_0024_m_000001_0_1865062451_1
2015-03-13 10:11:25,020 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:11:25,025 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:11:25,026 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/_temporary/attempt_1426266260362_0024_m_000001_0	dst=null	perm=null
2015-03-13 10:11:25,029 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62887, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0024_m_000000_0_-988689571_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 149000
2015-03-13 10:11:25,032 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/_temporary/attempt_1426266260362_0024_m_000001_0	dst=null	perm=null
2015-03-13 10:11:25,033 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/task_1426266260362_0024_m_000001	dst=null	perm=null
2015-03-13 10:11:25,035 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62878, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0024_m_000000_0_-988689571_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 147000
2015-03-13 10:11:25,036 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/_temporary/attempt_1426266260362_0024_m_000001_0	dst=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/task_1426266260362_0024_m_000001	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:11:25,042 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:11:25,046 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/_temporary/attempt_1426266260362_0024_m_000003_0/part-00003. BP-1005356445-10.1.1.144-1426266257849 blk_1073742114_1290{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:11:25,058 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0024_01_000003
2015-03-13 10:11:25,058 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0024	CONTAINERID=container_1426266260362_0024_01_000003
2015-03-13 10:11:25,058 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:11:25,058 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0024_01_000003
2015-03-13 10:11:25,058 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:25,058 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:11:25,059 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:25,059 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:25,071 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0024_01_000003 is : 143
2015-03-13 10:11:25,073 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job_1426266260362_0024_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073742115_1291{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:11:25,074 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742115_1291 src: /127.0.0.1:62889 dest: /127.0.0.1:60689
2015-03-13 10:11:25,076 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742115_1291 src: /127.0.0.1:62890 dest: /127.0.0.1:60686
2015-03-13 10:11:25,077 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742115_1291 src: /127.0.0.1:62891 dest: /127.0.0.1:60693
2015-03-13 10:11:25,081 INFO  hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job_1426266260362_0024_1.jhist for DFSClient_NONMAPREDUCE_1654895269_1
2015-03-13 10:11:25,083 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:11:25,083 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000003
2015-03-13 10:11:25,084 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000003
2015-03-13 10:11:25,084 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0024	CONTAINERID=container_1426266260362_0024_01_000003
2015-03-13 10:11:25,084 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:11:25,084 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0024_01_000003 from application application_1426266260362_0024
2015-03-13 10:11:25,084 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:25,084 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0024
2015-03-13 10:11:25,084 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000003
2015-03-13 10:11:25,084 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000003
2015-03-13 10:11:25,088 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:11:25,092 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:11:25,092 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742113_1289
2015-03-13 10:11:25,096 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62892, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0024_m_000002_0_-687252152_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 161000
2015-03-13 10:11:25,110 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742114_1290 src: /127.0.0.1:62888 dest: /127.0.0.1:60689
2015-03-13 10:11:25,111 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742114_1290 src: /127.0.0.1:62893 dest: /127.0.0.1:60696
2015-03-13 10:11:25,113 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742114_1290 src: /127.0.0.1:62894 dest: /127.0.0.1:60686
2015-03-13 10:11:25,113 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/_temporary/attempt_1426266260362_0024_m_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073742116_1292{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:11:25,123 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62894, dest: /127.0.0.1:60686, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0024_m_000003_0_312247103_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742114_1290, duration: 8646000
2015-03-13 10:11:25,123 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742114_1290, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:25,123 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742114_1290{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:25,124 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62893, dest: /127.0.0.1:60696, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0024_m_000003_0_312247103_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742114_1290, duration: 9375000
2015-03-13 10:11:25,124 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742114_1290, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:25,124 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742114_1290{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:25,124 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62888, dest: /127.0.0.1:60689, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0024_m_000003_0_312247103_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742114_1290, duration: 10169000
2015-03-13 10:11:25,125 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742114_1290, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:25,125 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742114_1290{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:25,130 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/_temporary/attempt_1426266260362_0024_m_000003_0/part-00003 is closed by DFSClient_attempt_1426266260362_0024_m_000003_0_312247103_1
2015-03-13 10:11:25,139 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/_temporary/attempt_1426266260362_0024_m_000003_0	dst=null	perm=null
2015-03-13 10:11:25,146 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/_temporary/attempt_1426266260362_0024_m_000003_0	dst=null	perm=null
2015-03-13 10:11:25,147 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/task_1426266260362_0024_m_000003	dst=null	perm=null
2015-03-13 10:11:25,150 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/_temporary/attempt_1426266260362_0024_m_000003_0	dst=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/task_1426266260362_0024_m_000003	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:11:25,160 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742116_1292 src: /127.0.0.1:62895 dest: /127.0.0.1:60693
2015-03-13 10:11:25,162 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742116_1292 src: /127.0.0.1:62896 dest: /127.0.0.1:60689
2015-03-13 10:11:25,163 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742116_1292 src: /127.0.0.1:62897 dest: /127.0.0.1:60696
2015-03-13 10:11:25,165 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0024_01_000005
2015-03-13 10:11:25,165 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0024	CONTAINERID=container_1426266260362_0024_01_000005
2015-03-13 10:11:25,165 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:11:25,165 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0024_01_000005
2015-03-13 10:11:25,165 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:25,165 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:11:25,165 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0024_01_000003
2015-03-13 10:11:25,166 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:25,166 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:11:25,166 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0024_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:11:25,166 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0024_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:11:25,166 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0024	CONTAINERID=container_1426266260362_0024_01_000003
2015-03-13 10:11:25,166 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0024_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:11:25,166 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:11:25,167 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0024_01_000003, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:25,167 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:25,167 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:11:25,167 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0024_000001 released container container_1426266260362_0024_01_000003 on node: host: 10.1.1.144:60719 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:11:25,178 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0024_01_000005 is : 143
2015-03-13 10:11:25,189 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62897, dest: /127.0.0.1:60696, bytes: 138, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0024_m_000000_0_-988689571_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742116_1292, duration: 24150000
2015-03-13 10:11:25,189 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742116_1292, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:25,190 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742116_1292{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:25,190 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62896, dest: /127.0.0.1:60689, bytes: 138, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0024_m_000000_0_-988689571_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742116_1292, duration: 24304000
2015-03-13 10:11:25,190 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742116_1292, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:25,191 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742116_1292{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:25,191 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62895, dest: /127.0.0.1:60693, bytes: 138, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0024_m_000000_0_-988689571_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742116_1292, duration: 25629000
2015-03-13 10:11:25,191 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742116_1292, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:25,192 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/_temporary/attempt_1426266260362_0024_m_000002_0/part-00002. BP-1005356445-10.1.1.144-1426266257849 blk_1073742117_1293{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:11:25,192 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742116_1292{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:25,196 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:11:25,196 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000005
2015-03-13 10:11:25,196 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000005
2015-03-13 10:11:25,197 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000005
2015-03-13 10:11:25,197 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000005
2015-03-13 10:11:25,198 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0024	CONTAINERID=container_1426266260362_0024_01_000005
2015-03-13 10:11:25,198 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:11:25,198 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0024_01_000005 from application application_1426266260362_0024
2015-03-13 10:11:25,199 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:25,199 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0024
2015-03-13 10:11:25,204 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/_temporary/attempt_1426266260362_0024_m_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0024_m_000000_0_-988689571_1
2015-03-13 10:11:25,213 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/_temporary/attempt_1426266260362_0024_m_000000_0	dst=null	perm=null
2015-03-13 10:11:25,225 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/_temporary/attempt_1426266260362_0024_m_000000_0	dst=null	perm=null
2015-03-13 10:11:25,226 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/task_1426266260362_0024_m_000000	dst=null	perm=null
2015-03-13 10:11:25,230 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/_temporary/attempt_1426266260362_0024_m_000000_0	dst=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/task_1426266260362_0024_m_000000	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:11:25,242 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742117_1293 src: /127.0.0.1:62898 dest: /127.0.0.1:60696
2015-03-13 10:11:25,244 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742117_1293 src: /127.0.0.1:62899 dest: /127.0.0.1:60689
2015-03-13 10:11:25,245 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742117_1293 src: /127.0.0.1:62900 dest: /127.0.0.1:60686
2015-03-13 10:11:25,246 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0024_01_000002
2015-03-13 10:11:25,246 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0024	CONTAINERID=container_1426266260362_0024_01_000002
2015-03-13 10:11:25,246 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:11:25,246 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0024_01_000002
2015-03-13 10:11:25,247 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:11:25,247 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:25,247 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:11:25,247 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0024_01_000005
2015-03-13 10:11:25,247 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0024_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:11:25,248 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0024_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:11:25,248 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0024	CONTAINERID=container_1426266260362_0024_01_000005
2015-03-13 10:11:25,248 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0024_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:11:25,248 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:11:25,248 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0024_01_000005, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:25,248 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:25,248 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:11:25,248 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0024_000001 released container container_1426266260362_0024_01_000005 on node: host: 10.1.1.144:60719 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:11:25,260 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0024_01_000002 is : 143
2015-03-13 10:11:25,272 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:11:25,272 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000002
2015-03-13 10:11:25,272 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000002
2015-03-13 10:11:25,273 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000002
2015-03-13 10:11:25,273 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000002
2015-03-13 10:11:25,274 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0024	CONTAINERID=container_1426266260362_0024_01_000002
2015-03-13 10:11:25,274 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:11:25,274 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0024_01_000002 from application application_1426266260362_0024
2015-03-13 10:11:25,274 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:25,275 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0024
2015-03-13 10:11:25,281 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62900, dest: /127.0.0.1:60686, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0024_m_000002_0_-687252152_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742117_1293, duration: 33432000
2015-03-13 10:11:25,281 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742117_1293, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:25,282 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62899, dest: /127.0.0.1:60689, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0024_m_000002_0_-687252152_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742117_1293, duration: 34136000
2015-03-13 10:11:25,282 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742117_1293, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:25,283 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742117_1293{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:25,283 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62898, dest: /127.0.0.1:60696, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0024_m_000002_0_-687252152_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742117_1293, duration: 35197000
2015-03-13 10:11:25,283 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742117_1293, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:25,284 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742117_1293{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:25,284 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742117_1293{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:25,291 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/_temporary/attempt_1426266260362_0024_m_000002_0/part-00002 is closed by DFSClient_attempt_1426266260362_0024_m_000002_0_-687252152_1
2015-03-13 10:11:25,300 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/_temporary/attempt_1426266260362_0024_m_000002_0	dst=null	perm=null
2015-03-13 10:11:25,306 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/_temporary/attempt_1426266260362_0024_m_000002_0	dst=null	perm=null
2015-03-13 10:11:25,307 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/task_1426266260362_0024_m_000002	dst=null	perm=null
2015-03-13 10:11:25,310 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/_temporary/attempt_1426266260362_0024_m_000002_0	dst=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/task_1426266260362_0024_m_000002	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:11:25,320 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0024_01_000004
2015-03-13 10:11:25,320 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0024	CONTAINERID=container_1426266260362_0024_01_000004
2015-03-13 10:11:25,320 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:11:25,321 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:11:25,321 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0024_01_000002
2015-03-13 10:11:25,321 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0024_01_000004
2015-03-13 10:11:25,321 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:11:25,322 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0024_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:11:25,322 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0024_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:11:25,322 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0024	CONTAINERID=container_1426266260362_0024_01_000002
2015-03-13 10:11:25,322 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0024_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:11:25,322 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:11:25,322 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0024_01_000002, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:25,322 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:25,322 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:11:25,322 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0024_000001 released container container_1426266260362_0024_01_000002 on node: host: 10.1.1.144:60719 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:11:25,323 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:11:25,334 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0024_01_000004 is : 143
2015-03-13 10:11:25,336 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:11:25,339 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:11:25,342 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62881, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0024_m_000004_0_-1004890562_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 153000
2015-03-13 10:11:25,345 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:11:25,346 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000004
2015-03-13 10:11:25,346 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000004
2015-03-13 10:11:25,346 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000004
2015-03-13 10:11:25,346 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000004
2015-03-13 10:11:25,346 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0024	CONTAINERID=container_1426266260362_0024_01_000004
2015-03-13 10:11:25,346 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:11:25,347 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0024_01_000004 from application application_1426266260362_0024
2015-03-13 10:11:25,347 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:25,347 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0024
2015-03-13 10:11:25,366 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/_temporary/attempt_1426266260362_0024_m_000004_0/part-00004. BP-1005356445-10.1.1.144-1426266257849 blk_1073742118_1294{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:11:25,401 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742118_1294 src: /127.0.0.1:62901 dest: /127.0.0.1:60696
2015-03-13 10:11:25,402 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742118_1294 src: /127.0.0.1:62902 dest: /127.0.0.1:60693
2015-03-13 10:11:25,404 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742118_1294 src: /127.0.0.1:62903 dest: /127.0.0.1:60686
2015-03-13 10:11:25,411 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62903, dest: /127.0.0.1:60686, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0024_m_000004_0_-1004890562_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742118_1294, duration: 6082000
2015-03-13 10:11:25,412 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742118_1294, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:25,412 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742118_1294{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:25,412 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62902, dest: /127.0.0.1:60693, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0024_m_000004_0_-1004890562_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742118_1294, duration: 6858000
2015-03-13 10:11:25,412 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742118_1294, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:25,413 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742118_1294{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:25,413 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62901, dest: /127.0.0.1:60696, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0024_m_000004_0_-1004890562_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742118_1294, duration: 7580000
2015-03-13 10:11:25,413 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742118_1294, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:25,413 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742118_1294{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:25,417 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/_temporary/attempt_1426266260362_0024_m_000004_0/part-00004 is closed by DFSClient_attempt_1426266260362_0024_m_000004_0_-1004890562_1
2015-03-13 10:11:25,426 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/_temporary/attempt_1426266260362_0024_m_000004_0	dst=null	perm=null
2015-03-13 10:11:25,432 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/_temporary/attempt_1426266260362_0024_m_000004_0	dst=null	perm=null
2015-03-13 10:11:25,433 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/task_1426266260362_0024_m_000004	dst=null	perm=null
2015-03-13 10:11:25,437 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/_temporary/attempt_1426266260362_0024_m_000004_0	dst=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/task_1426266260362_0024_m_000004	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:11:25,448 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0024_01_000006
2015-03-13 10:11:25,448 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0024	CONTAINERID=container_1426266260362_0024_01_000006
2015-03-13 10:11:25,448 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:11:25,449 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0024_01_000006
2015-03-13 10:11:25,449 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:11:25,453 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:25,455 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_1654895269_1
2015-03-13 10:11:25,459 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1	dst=null	perm=null
2015-03-13 10:11:25,462 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0024_01_000006 is : 143
2015-03-13 10:11:25,466 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5	dst=null	perm=null
2015-03-13 10:11:25,467 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5	dst=null	perm=null
2015-03-13 10:11:25,468 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/task_1426266260362_0024_m_000000	dst=null	perm=null
2015-03-13 10:11:25,470 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00000	dst=null	perm=null
2015-03-13 10:11:25,473 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:11:25,474 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/task_1426266260362_0024_m_000000/part-00000	dst=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:25,474 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000006
2015-03-13 10:11:25,474 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000006
2015-03-13 10:11:25,474 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000006
2015-03-13 10:11:25,475 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000006
2015-03-13 10:11:25,475 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0024	CONTAINERID=container_1426266260362_0024_01_000006
2015-03-13 10:11:25,475 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:11:25,475 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0024_01_000006 from application application_1426266260362_0024
2015-03-13 10:11:25,475 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:25,475 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0024
2015-03-13 10:11:25,477 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5	dst=null	perm=null
2015-03-13 10:11:25,478 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5	dst=null	perm=null
2015-03-13 10:11:25,479 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/task_1426266260362_0024_m_000001	dst=null	perm=null
2015-03-13 10:11:25,481 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00001	dst=null	perm=null
2015-03-13 10:11:25,482 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/task_1426266260362_0024_m_000001/part-00001	dst=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00001	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:25,483 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5	dst=null	perm=null
2015-03-13 10:11:25,484 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5	dst=null	perm=null
2015-03-13 10:11:25,485 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/task_1426266260362_0024_m_000002	dst=null	perm=null
2015-03-13 10:11:25,486 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00002	dst=null	perm=null
2015-03-13 10:11:25,488 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/task_1426266260362_0024_m_000002/part-00002	dst=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00002	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:25,489 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5	dst=null	perm=null
2015-03-13 10:11:25,489 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5	dst=null	perm=null
2015-03-13 10:11:25,490 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/task_1426266260362_0024_m_000003	dst=null	perm=null
2015-03-13 10:11:25,491 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00003	dst=null	perm=null
2015-03-13 10:11:25,493 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/task_1426266260362_0024_m_000003/part-00003	dst=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00003	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:25,494 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5	dst=null	perm=null
2015-03-13 10:11:25,494 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5	dst=null	perm=null
2015-03-13 10:11:25,495 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/task_1426266260362_0024_m_000004	dst=null	perm=null
2015-03-13 10:11:25,496 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00004	dst=null	perm=null
2015-03-13 10:11:25,498 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/task_1426266260362_0024_m_000004/part-00004	dst=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00004	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:25,501 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary	dst=null	perm=null
2015-03-13 10:11:25,505 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:25,507 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_SUCCESS is closed by DFSClient_NONMAPREDUCE_1654895269_1
2015-03-13 10:11:25,510 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:25,512 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_1654895269_1
2015-03-13 10:11:25,526 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62891, dest: /127.0.0.1:60693, bytes: 53325, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1654895269_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742115_1291, duration: 447659000
2015-03-13 10:11:25,526 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742115_1291, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:25,527 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742115_1291{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:11:25,528 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62890, dest: /127.0.0.1:60686, bytes: 53325, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1654895269_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742115_1291, duration: 448945000
2015-03-13 10:11:25,528 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742115_1291, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:25,529 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742115_1291{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:11:25,529 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62889, dest: /127.0.0.1:60689, bytes: 53325, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1654895269_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742115_1291, duration: 450345000
2015-03-13 10:11:25,529 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742115_1291, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:25,530 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742115_1291{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:11:25,532 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job_1426266260362_0024_1.jhist is closed by DFSClient_NONMAPREDUCE_1654895269_1
2015-03-13 10:11:25,534 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0024.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:25,536 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0024.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742119_1295{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:11:25,538 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742119_1295 src: /127.0.0.1:62904 dest: /127.0.0.1:60696
2015-03-13 10:11:25,539 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742119_1295 src: /127.0.0.1:62905 dest: /127.0.0.1:60693
2015-03-13 10:11:25,540 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742119_1295 src: /127.0.0.1:62906 dest: /127.0.0.1:60689
2015-03-13 10:11:25,543 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62906, dest: /127.0.0.1:60689, bytes: 419, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1654895269_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742119_1295, duration: 1344000
2015-03-13 10:11:25,543 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742119_1295, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:25,544 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62905, dest: /127.0.0.1:60693, bytes: 419, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1654895269_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742119_1295, duration: 1755000
2015-03-13 10:11:25,544 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742119_1295{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:11:25,544 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742119_1295, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:25,544 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62904, dest: /127.0.0.1:60696, bytes: 419, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1654895269_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742119_1295, duration: 2558000
2015-03-13 10:11:25,545 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742119_1295{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:11:25,545 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742119_1295, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:25,546 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742119_1295{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:11:25,549 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0024.summary_tmp is closed by DFSClient_NONMAPREDUCE_1654895269_1
2015-03-13 10:11:25,553 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0024.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:11:25,558 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job_1426266260362_0024_1.jhist	dst=null	perm=null
2015-03-13 10:11:25,559 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0024-1426266670375-soberoi-%5B716001CDD2B94A3FADE59C5DF8875A2D%2F4BC832EC1D1E4858-1426266685513-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:11:25,562 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job_1426266260362_0024_1.jhist	dst=null	perm=null
2015-03-13 10:11:25,563 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0024-1426266670375-soberoi-%5B716001CDD2B94A3FADE59C5DF8875A2D%2F4BC832EC1D1E4858-1426266685513-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:11:25,564 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job_1426266260362_0024_1.jhist	dst=null	perm=null
2015-03-13 10:11:25,567 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0024-1426266670375-soberoi-%5B716001CDD2B94A3FADE59C5DF8875A2D%2F4BC832EC1D1E4858-1426266685513-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:25,569 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62907, bytes: 53745, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1654895269_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742115_1291, duration: 177000
2015-03-13 10:11:25,571 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0024-1426266670375-soberoi-%5B716001CDD2B94A3FADE59C5DF8875A2D%2F4BC832EC1D1E4858-1426266685513-5-0-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742120_1296{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:11:25,573 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742120_1296 src: /127.0.0.1:62908 dest: /127.0.0.1:60696
2015-03-13 10:11:25,575 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742120_1296 src: /127.0.0.1:62909 dest: /127.0.0.1:60689
2015-03-13 10:11:25,576 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742120_1296 src: /127.0.0.1:62910 dest: /127.0.0.1:60686
2015-03-13 10:11:25,579 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62910, dest: /127.0.0.1:60686, bytes: 53325, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1654895269_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742120_1296, duration: 1672000
2015-03-13 10:11:25,579 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742120_1296, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:25,580 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742120_1296{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:25,580 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62909, dest: /127.0.0.1:60689, bytes: 53325, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1654895269_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742120_1296, duration: 2207000
2015-03-13 10:11:25,580 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742120_1296, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:25,580 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742120_1296{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:25,581 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62908, dest: /127.0.0.1:60696, bytes: 53325, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1654895269_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742120_1296, duration: 3023000
2015-03-13 10:11:25,581 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742120_1296, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:25,581 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742120_1296{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:25,583 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0024-1426266670375-soberoi-%5B716001CDD2B94A3FADE59C5DF8875A2D%2F4BC832EC1D1E4858-1426266685513-5-0-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_1654895269_1
2015-03-13 10:11:25,584 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0024-1426266670375-soberoi-%5B716001CDD2B94A3FADE59C5DF8875A2D%2F4BC832EC1D1E4858-1426266685513-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:11:25,585 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job_1426266260362_0024_1_conf.xml	dst=null	perm=null
2015-03-13 10:11:25,586 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0024_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:11:25,587 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job_1426266260362_0024_1_conf.xml	dst=null	perm=null
2015-03-13 10:11:25,588 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0024_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:11:25,589 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job_1426266260362_0024_1_conf.xml	dst=null	perm=null
2015-03-13 10:11:25,591 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:25,591 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0024_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:25,593 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62911, bytes: 91488, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1654895269_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742112_1288, duration: 277000
2015-03-13 10:11:25,595 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0024_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742121_1297{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:11:25,596 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742121_1297 src: /127.0.0.1:62912 dest: /127.0.0.1:60696
2015-03-13 10:11:25,597 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742121_1297 src: /127.0.0.1:62913 dest: /127.0.0.1:60689
2015-03-13 10:11:25,598 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742121_1297 src: /127.0.0.1:62914 dest: /127.0.0.1:60686
2015-03-13 10:11:25,601 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62914, dest: /127.0.0.1:60686, bytes: 90776, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1654895269_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742121_1297, duration: 1727000
2015-03-13 10:11:25,601 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742121_1297, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:25,602 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742121_1297{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:25,602 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62913, dest: /127.0.0.1:60689, bytes: 90776, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1654895269_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742121_1297, duration: 2256000
2015-03-13 10:11:25,602 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742121_1297, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:25,602 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742121_1297{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:25,602 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62912, dest: /127.0.0.1:60696, bytes: 90776, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1654895269_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742121_1297, duration: 2967000
2015-03-13 10:11:25,603 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742121_1297, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:25,603 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742121_1297{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:25,605 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0024_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_1654895269_1
2015-03-13 10:11:25,606 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0024_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:11:25,608 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0024.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0024.summary	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:11:25,610 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0024_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0024_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:11:25,612 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0024-1426266670375-soberoi-%5B716001CDD2B94A3FADE59C5DF8875A2D%2F4BC832EC1D1E4858-1426266685513-5-0-SUCCEEDED-default.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0024-1426266670375-soberoi-%5B716001CDD2B94A3FADE59C5DF8875A2D%2F4BC832EC1D1E4858-1426266685513-5-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:11:25,619 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0024_000001 State change from RUNNING to FINISHING
2015-03-13 10:11:25,619 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0024
2015-03-13 10:11:25,619 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0024 State change from RUNNING to REMOVING
2015-03-13 10:11:25,619 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0024
2015-03-13 10:11:25,619 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0024 State change from REMOVING to FINISHING
2015-03-13 10:11:26,327 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:11:26,327 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0024_01_000004
2015-03-13 10:11:26,328 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0024_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:11:26,328 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0024_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:11:26,328 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0024	CONTAINERID=container_1426266260362_0024_01_000004
2015-03-13 10:11:26,328 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0024_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:11:26,328 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:11:26,329 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0024_01_000004, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:26,329 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:26,329 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:11:26,329 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0024_000001 released container container_1426266260362_0024_01_000004 on node: host: 10.1.1.144:60719 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:11:26,454 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:11:26,454 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0024_01_000006
2015-03-13 10:11:26,455 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0024_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:11:26,455 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0024_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:11:26,455 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0024	CONTAINERID=container_1426266260362_0024_01_000006
2015-03-13 10:11:26,455 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0024_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:11:26,455 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:11:26,456 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0024_01_000006, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:26,456 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:26,456 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:11:26,456 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0024_000001 released container container_1426266260362_0024_01_000006 on node: host: 10.1.1.144:60715 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:11:26,592 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:26,626 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742108_1284 127.0.0.1:60686 127.0.0.1:60693 127.0.0.1:60689 127.0.0.1:60696 
2015-03-13 10:11:26,626 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742109_1285 127.0.0.1:60689 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60686 
2015-03-13 10:11:26,626 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742110_1286 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60696 
2015-03-13 10:11:26,626 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742111_1287 127.0.0.1:60693 127.0.0.1:60689 127.0.0.1:60696 
2015-03-13 10:11:26,627 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742115_1291 127.0.0.1:60689 127.0.0.1:60686 127.0.0.1:60693 
2015-03-13 10:11:26,627 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742112_1288 127.0.0.1:60693 127.0.0.1:60689 127.0.0.1:60686 
2015-03-13 10:11:26,627 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024	dst=null	perm=null
2015-03-13 10:11:26,652 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [upper2*lower*upper1] starting step: (1/2) ...orm/joinaroundjoinswapped
2015-03-13 10:11:26,659 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:11:26,666 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:11:26,668 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped	dst=null	perm=null
2015-03-13 10:11:26,668 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:11:26,669 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:11:26,671 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 25
2015-03-13 10:11:26,671 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025	dst=null	perm=null
2015-03-13 10:11:26,672 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025	dst=null	perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:11:26,673 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025	dst=null	perm=soberoi:supergroup:rwx------
2015-03-13 10:11:26,674 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.jar	dst=null	perm=null
2015-03-13 10:11:26,675 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:11:26,676 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073742122_1298{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:11:26,678 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742122_1298 src: /127.0.0.1:62917 dest: /127.0.0.1:60696
2015-03-13 10:11:26,679 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742122_1298 src: /127.0.0.1:62918 dest: /127.0.0.1:60686
2015-03-13 10:11:26,680 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742122_1298 src: /127.0.0.1:62919 dest: /127.0.0.1:60689
2015-03-13 10:11:26,683 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62919, dest: /127.0.0.1:60689, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742122_1298, duration: 2776000
2015-03-13 10:11:26,684 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742122_1298, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:26,684 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62918, dest: /127.0.0.1:60686, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742122_1298, duration: 2493000
2015-03-13 10:11:26,684 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742122_1298{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:11:26,684 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742122_1298, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:26,684 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742122_1298{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:11:26,685 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62917, dest: /127.0.0.1:60696, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742122_1298, duration: 3301000
2015-03-13 10:11:26,685 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742122_1298, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:26,685 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742122_1298{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:11:26,688 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:11:26,689 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.jar
2015-03-13 10:11:26,689 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.jar	dst=null	perm=null
2015-03-13 10:11:26,690 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:11:26,691 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:11:26,691 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:11:26,692 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:11:26,692 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:11:26,693 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:11:26,693 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:11:26,693 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:11:26,694 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:11:26,694 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:11:26,696 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:11:26,696 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:11:26,696 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:11:26,698 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:11:26,699 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:11:26,699 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.split
2015-03-13 10:11:26,700 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.split	dst=null	perm=null
2015-03-13 10:11:26,701 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073742123_1299{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:11:26,702 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742123_1299 src: /127.0.0.1:62920 dest: /127.0.0.1:60693
2015-03-13 10:11:26,703 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742123_1299 src: /127.0.0.1:62921 dest: /127.0.0.1:60686
2015-03-13 10:11:26,704 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742123_1299 src: /127.0.0.1:62922 dest: /127.0.0.1:60696
2015-03-13 10:11:26,705 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742123_1299 src: /127.0.0.1:62923 dest: /127.0.0.1:60689
2015-03-13 10:11:26,708 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62923, dest: /127.0.0.1:60689, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742123_1299, duration: 1520000
2015-03-13 10:11:26,708 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742123_1299, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:26,709 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742123_1299{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:11:26,709 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62922, dest: /127.0.0.1:60696, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742123_1299, duration: 1632000
2015-03-13 10:11:26,709 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742123_1299, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:26,709 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742123_1299{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:11:26,709 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62921, dest: /127.0.0.1:60686, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742123_1299, duration: 2577000
2015-03-13 10:11:26,710 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742123_1299, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:26,710 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742123_1299{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:11:26,710 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62920, dest: /127.0.0.1:60693, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742123_1299, duration: 3460000
2015-03-13 10:11:26,710 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742123_1299, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:26,711 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742123_1299{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:11:26,712 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:11:26,713 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:11:26,715 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:11:26,716 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073742124_1300{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:11:26,717 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742124_1300 src: /127.0.0.1:62924 dest: /127.0.0.1:60693
2015-03-13 10:11:26,719 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742124_1300 src: /127.0.0.1:62925 dest: /127.0.0.1:60696
2015-03-13 10:11:26,720 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742124_1300 src: /127.0.0.1:62926 dest: /127.0.0.1:60689
2015-03-13 10:11:26,723 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62926, dest: /127.0.0.1:60689, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742124_1300, duration: 1149000
2015-03-13 10:11:26,723 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742124_1300, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:26,723 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742124_1300{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:11:26,723 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62925, dest: /127.0.0.1:60696, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742124_1300, duration: 1517000
2015-03-13 10:11:26,723 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742124_1300, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:26,724 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742124_1300{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:11:26,724 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62924, dest: /127.0.0.1:60693, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742124_1300, duration: 2331000
2015-03-13 10:11:26,724 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742124_1300, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:26,725 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742124_1300{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:11:26,726 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:11:26,726 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:11:26,728 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:11:26,729 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:11:26,730 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:11:26,731 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:11:26,731 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:11:26,734 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742125_1301{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:11:26,735 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742125_1301 src: /127.0.0.1:62927 dest: /127.0.0.1:60693
2015-03-13 10:11:26,736 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742125_1301 src: /127.0.0.1:62928 dest: /127.0.0.1:60686
2015-03-13 10:11:26,737 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742125_1301 src: /127.0.0.1:62929 dest: /127.0.0.1:60696
2015-03-13 10:11:26,740 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62929, dest: /127.0.0.1:60696, bytes: 98230, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742125_1301, duration: 2117000
2015-03-13 10:11:26,740 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742125_1301, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:26,741 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742125_1301{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:26,741 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62928, dest: /127.0.0.1:60686, bytes: 98230, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742125_1301, duration: 1790000
2015-03-13 10:11:26,741 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742125_1301, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:26,741 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742125_1301{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:26,741 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62927, dest: /127.0.0.1:60693, bytes: 98230, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742125_1301, duration: 2363000
2015-03-13 10:11:26,742 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742125_1301, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:26,742 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742125_1301{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:26,743 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:11:26,743 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0025
2015-03-13 10:11:26,744 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025	dst=null	perm=null
2015-03-13 10:11:26,744 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.xml	dst=null	perm=null
2015-03-13 10:11:26,745 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.xml	dst=null	perm=null
2015-03-13 10:11:26,745 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.jar	dst=null	perm=null
2015-03-13 10:11:26,746 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.jar	dst=null	perm=null
2015-03-13 10:11:26,746 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.split	dst=null	perm=null
2015-03-13 10:11:26,746 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.split	dst=null	perm=null
2015-03-13 10:11:26,747 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:11:26,747 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:11:26,749 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:11:26,749 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:11:26,750 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:11:26,750 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:11:26,751 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:11:26,751 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:11:26,752 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 25 submitted by user soberoi
2015-03-13 10:11:26,752 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0025
2015-03-13 10:11:26,752 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	IP=10.1.1.144	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1426266260362_0025
2015-03-13 10:11:26,752 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0025
2015-03-13 10:11:26,752 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0025 State change from NEW to NEW_SAVING
2015-03-13 10:11:26,753 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0025 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:11:26,753 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0025_000001
2015-03-13 10:11:26,753 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0025_000001 State change from NEW to SUBMITTED
2015-03-13 10:11:26,753 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0025 from user: soberoi activated in queue: default
2015-03-13 10:11:26,753 INFO  capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0025 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:11:26,753 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0025 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:11:26,753 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0025_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:11:26,753 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0025 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:11:26,754 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0025_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:11:26,754 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0025 State change from SUBMITTED to ACCEPTED
2015-03-13 10:11:26,756 INFO  mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0025/
2015-03-13 10:11:26,756 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [upper2*lower*upper1] submitted hadoop job: job_1426266260362_0025
2015-03-13 10:11:26,756 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [upper2*lower*upper1] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0025/
2015-03-13 10:11:27,018 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0025_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:11:27,018 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0025	CONTAINERID=container_1426266260362_0025_01_000001
2015-03-13 10:11:27,018 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0025_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:11:27,018 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0025 container=Container: [ContainerId: container_1426266260362_0025_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0025_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:27,019 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:11:27,019 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:27,019 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0025_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:11:27,020 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0025 AttemptId: appattempt_1426266260362_0025_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0025_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ]
2015-03-13 10:11:27,020 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0025_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:11:27,020 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0025_000001
2015-03-13 10:11:27,020 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0025_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:11:27,020 INFO  amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0025_000001
2015-03-13 10:11:27,021 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0025_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] for AM appattempt_1426266260362_0025_000001
2015-03-13 10:11:27,021 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0025_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-03-13 10:11:27,023 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0025_000001 (auth:SIMPLE)
2015-03-13 10:11:27,024 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0025_01_000001 by user soberoi
2015-03-13 10:11:27,024 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0025
2015-03-13 10:11:27,024 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0025	CONTAINERID=container_1426266260362_0025_01_000001
2015-03-13 10:11:27,025 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0025 transitioned from NEW to INITING
2015-03-13 10:11:27,025 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0025_01_000001 to application application_1426266260362_0025
2015-03-13 10:11:27,025 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0025 transitioned from INITING to RUNNING
2015-03-13 10:11:27,025 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0025_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] for AM appattempt_1426266260362_0025_000001
2015-03-13 10:11:27,025 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0025_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:11:27,025 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:11:27,025 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0025
2015-03-13 10:11:27,025 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:11:27,026 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:11:27,026 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:11:27,026 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:11:27,026 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0025_01_000001
2015-03-13 10:11:27,035 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426266260362_0025_01_000001.tokens. Credentials list: 
2015-03-13 10:11:27,050 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:11:27,121 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426266260362_0025_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000001.tokens
2015-03-13 10:11:27,121 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0025 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0025
2015-03-13 10:11:27,178 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.jar	dst=null	perm=null
2015-03-13 10:11:27,179 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.jar	dst=null	perm=null
2015-03-13 10:11:27,179 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.jar	dst=null	perm=null
2015-03-13 10:11:27,186 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62933, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-912891646_13263, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742122_1298, duration: 426000
2015-03-13 10:11:27,204 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:11:27,220 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:11:27,220 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:11:27,221 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:11:27,227 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62933, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-912891646_13263, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742124_1300, duration: 173000
2015-03-13 10:11:27,238 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:11:27,254 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.split	dst=null	perm=null
2015-03-13 10:11:27,254 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.split	dst=null	perm=null
2015-03-13 10:11:27,255 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.split	dst=null	perm=null
2015-03-13 10:11:27,262 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62934, bytes: 1798, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-912891646_13263, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742123_1299, duration: 147000
2015-03-13 10:11:27,276 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:11:27,292 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.xml	dst=null	perm=null
2015-03-13 10:11:27,292 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.xml	dst=null	perm=null
2015-03-13 10:11:27,293 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.xml	dst=null	perm=null
2015-03-13 10:11:27,298 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62933, bytes: 98998, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-912891646_13263, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742125_1301, duration: 252000
2015-03-13 10:11:27,311 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:11:27,311 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:11:27,335 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:11:27,346 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:27,414 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000001/default_container_executor.sh]
2015-03-13 10:11:27,598 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:28,008 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60689 to replicate blk_1073742122_1298 to datanode(s) 127.0.0.1:60693
2015-03-13 10:11:28,009 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073742112_1288, blk_1073742115_1291, blk_1073742108_1284, blk_1073742109_1285, blk_1073742110_1286]
2015-03-13 10:11:28,009 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073742112_1288, blk_1073742115_1291, blk_1073742108_1284, blk_1073742109_1285, blk_1073742110_1286, blk_1073742111_1287]
2015-03-13 10:11:28,017 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:28,018 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0025_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:11:28,592 INFO  datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-1172757413-10.1.1.144-60689-1426266259165, infoPort=60690, ipcPort=60692, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073742122_1298 to 127.0.0.1:60693 
2015-03-13 10:11:28,592 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742112_1288 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742112 for deletion
2015-03-13 10:11:28,592 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742112_1288 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742112 for deletion
2015-03-13 10:11:28,593 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742115_1291 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742115 for deletion
2015-03-13 10:11:28,593 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742108_1284 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742108 for deletion
2015-03-13 10:11:28,593 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742109_1285 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742109 for deletion
2015-03-13 10:11:28,593 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742110_1286 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742110 for deletion
2015-03-13 10:11:28,593 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742112_1288 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742112
2015-03-13 10:11:28,593 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742112_1288 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742112
2015-03-13 10:11:28,593 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742115_1291 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742115
2015-03-13 10:11:28,593 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742109_1285 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742109
2015-03-13 10:11:28,594 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742108_1284 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742108
2015-03-13 10:11:28,592 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742115_1291 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742115 for deletion
2015-03-13 10:11:28,594 INFO  datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073742122_1298 (numBytes=254067) to /127.0.0.1:60693
2015-03-13 10:11:28,594 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742110_1286 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742110
2015-03-13 10:11:28,594 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742122_1298 src: /127.0.0.1:62935 dest: /127.0.0.1:60693
2015-03-13 10:11:28,594 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742108_1284 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742108 for deletion
2015-03-13 10:11:28,594 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742115_1291 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742115
2015-03-13 10:11:28,594 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742109_1285 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742109 for deletion
2015-03-13 10:11:28,594 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742110_1286 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742110 for deletion
2015-03-13 10:11:28,594 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742111_1287 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742111 for deletion
2015-03-13 10:11:28,595 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742108_1284 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742108
2015-03-13 10:11:28,595 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742109_1285 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742109
2015-03-13 10:11:28,595 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742110_1286 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742110
2015-03-13 10:11:28,595 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742111_1287 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742111
2015-03-13 10:11:28,596 INFO  datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073742122_1298 src: /127.0.0.1:62935 dest: /127.0.0.1:60693 of size 254067
2015-03-13 10:11:28,596 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742122_1298 size 254067
2015-03-13 10:11:28,603 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:28,974 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:11:28,998 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/COMMIT_STARTED	dst=null	perm=null
2015-03-13 10:11:28,999 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/COMMIT_SUCCESS	dst=null	perm=null
2015-03-13 10:11:29,000 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/COMMIT_FAIL	dst=null	perm=null
2015-03-13 10:11:29,019 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:29,051 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025	dst=null	perm=null
2015-03-13 10:11:29,052 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:11:29,053 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:11:29,330 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:11:29,334 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742114_1290
2015-03-13 10:11:29,337 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:11:29,393 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62937, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1195153157_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742124_1300, duration: 134000
2015-03-13 10:11:29,540 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742122_1298
2015-03-13 10:11:29,540 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742113_1289
2015-03-13 10:11:29,541 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742121_1297
2015-03-13 10:11:29,541 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742123_1299
2015-03-13 10:11:29,542 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742116_1292
2015-03-13 10:11:29,542 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742119_1295
2015-03-13 10:11:29,542 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742117_1293
2015-03-13 10:11:29,543 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742120_1296
2015-03-13 10:11:29,543 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742124_1300
2015-03-13 10:11:29,608 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:29,894 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742117_1293
2015-03-13 10:11:29,894 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742114_1290
2015-03-13 10:11:29,894 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742118_1294
2015-03-13 10:11:29,895 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742123_1299
2015-03-13 10:11:29,896 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742122_1298
2015-03-13 10:11:29,945 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742124_1300
2015-03-13 10:11:29,946 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742122_1298
2015-03-13 10:11:29,946 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742119_1295
2015-03-13 10:11:29,947 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742123_1299
2015-03-13 10:11:30,020 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:30,094 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742124_1300
2015-03-13 10:11:30,095 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742121_1297
2015-03-13 10:11:30,096 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742125_1301
2015-03-13 10:11:30,096 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742116_1292
2015-03-13 10:11:30,096 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742121_1297
2015-03-13 10:11:30,097 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742120_1296
2015-03-13 10:11:30,134 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0025_000001 (auth:SIMPLE)
2015-03-13 10:11:30,136 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0025_000001
2015-03-13 10:11:30,136 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi	IP=10.1.1.144	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1426266260362_0025	APPATTEMPTID=appattempt_1426266260362_0025_000001
2015-03-13 10:11:30,136 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0025_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:11:30,136 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0025 State change from ACCEPTED to RUNNING
2015-03-13 10:11:30,146 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742115_1291
2015-03-13 10:11:30,147 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742118_1294
2015-03-13 10:11:30,148 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742125_1301
2015-03-13 10:11:30,148 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742113_1289
2015-03-13 10:11:30,148 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742116_1292
2015-03-13 10:11:30,155 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job_1426266260362_0025_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:30,161 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:11:30,217 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job_1426266260362_0025_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:30,301 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742125_1301
2015-03-13 10:11:30,339 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job_1426266260362_0025_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742126_1302{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:11:30,384 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742126_1302 src: /127.0.0.1:62943 dest: /127.0.0.1:60689
2015-03-13 10:11:30,385 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742126_1302 src: /127.0.0.1:62944 dest: /127.0.0.1:60693
2015-03-13 10:11:30,387 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742126_1302 src: /127.0.0.1:62945 dest: /127.0.0.1:60696
2015-03-13 10:11:30,395 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62945, dest: /127.0.0.1:60696, bytes: 91021, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1195153157_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742126_1302, duration: 6460000
2015-03-13 10:11:30,395 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742126_1302, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:30,395 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742126_1302{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:30,396 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62944, dest: /127.0.0.1:60693, bytes: 91021, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1195153157_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742126_1302, duration: 7434000
2015-03-13 10:11:30,396 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742126_1302, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:30,396 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742126_1302{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:30,396 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62943, dest: /127.0.0.1:60689, bytes: 91021, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1195153157_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742126_1302, duration: 8265000
2015-03-13 10:11:30,397 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742126_1302, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:30,397 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742126_1302{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:30,401 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job_1426266260362_0025_1_conf.xml is closed by DFSClient_NONMAPREDUCE_1195153157_1
2015-03-13 10:11:30,501 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742122_1298
2015-03-13 10:11:30,501 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742123_1299
2015-03-13 10:11:30,502 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742120_1296
2015-03-13 10:11:30,502 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742126_1302
2015-03-13 10:11:30,502 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742114_1290
2015-03-13 10:11:30,503 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742119_1295
2015-03-13 10:11:30,503 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742117_1293
2015-03-13 10:11:30,503 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742118_1294
2015-03-13 10:11:30,614 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:31,013 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073742112_1288, blk_1073742115_1291, blk_1073742108_1284, blk_1073742109_1285, blk_1073742111_1287]
2015-03-13 10:11:31,013 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073742108_1284, blk_1073742109_1285, blk_1073742110_1286, blk_1073742111_1287]
2015-03-13 10:11:31,024 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:31,339 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0025_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:11:31,339 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0025	CONTAINERID=container_1426266260362_0025_01_000002
2015-03-13 10:11:31,339 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0025_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:11:31,340 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0025 container=Container: [ContainerId: container_1426266260362_0025_01_000002, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0025_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:31,340 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:11:31,340 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:31,340 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0025_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:11:31,341 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0025	CONTAINERID=container_1426266260362_0025_01_000003
2015-03-13 10:11:31,341 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0025_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:11:31,341 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0025 container=Container: [ContainerId: container_1426266260362_0025_01_000003, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0025_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:31,341 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:11:31,341 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:31,342 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0025_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:11:31,342 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0025	CONTAINERID=container_1426266260362_0025_01_000004
2015-03-13 10:11:31,342 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0025_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:11:31,342 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0025 container=Container: [ContainerId: container_1426266260362_0025_01_000004, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0025_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:31,342 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:11:31,343 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:31,343 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0025_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:11:31,343 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0025	CONTAINERID=container_1426266260362_0025_01_000005
2015-03-13 10:11:31,343 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0025_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:11:31,343 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0025 container=Container: [ContainerId: container_1426266260362_0025_01_000005, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0025_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:31,343 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:11:31,343 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:31,469 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0025_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:11:31,469 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0025	CONTAINERID=container_1426266260362_0025_01_000006
2015-03-13 10:11:31,469 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0025_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:11:31,469 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0025 container=Container: [ContainerId: container_1426266260362_0025_01_000006, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0025_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:31,470 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7
2015-03-13 10:11:31,470 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:31,615 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:31,657 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0024_01_000001 succeeded 
2015-03-13 10:11:31,657 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:11:31,657 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0024_01_000001
2015-03-13 10:11:31,668 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000001
2015-03-13 10:11:31,668 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000001
2015-03-13 10:11:31,668 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000001
2015-03-13 10:11:31,669 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000001
2015-03-13 10:11:31,669 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0024	CONTAINERID=container_1426266260362_0024_01_000001
2015-03-13 10:11:31,669 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:11:31,669 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0024_01_000001 from application application_1426266260362_0024
2015-03-13 10:11:31,669 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:31,669 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0024
2015-03-13 10:11:31,810 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742112_1288 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742112 for deletion
2015-03-13 10:11:31,810 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742115_1291 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742115 for deletion
2015-03-13 10:11:31,810 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742108_1284 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742108 for deletion
2015-03-13 10:11:31,810 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742112_1288 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742112
2015-03-13 10:11:31,810 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742109_1285 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742109 for deletion
2015-03-13 10:11:31,811 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742108_1284 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742108
2015-03-13 10:11:31,811 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742115_1291 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742115
2015-03-13 10:11:31,811 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742111_1287 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742111 for deletion
2015-03-13 10:11:31,811 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742109_1285 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742109
2015-03-13 10:11:31,811 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742111_1287 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742111
2015-03-13 10:11:31,988 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742108_1284 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742108 for deletion
2015-03-13 10:11:31,988 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742109_1285 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742109 for deletion
2015-03-13 10:11:31,988 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742110_1286 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742110 for deletion
2015-03-13 10:11:31,988 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742111_1287 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742111 for deletion
2015-03-13 10:11:31,989 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742108_1284 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742108
2015-03-13 10:11:31,989 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742109_1285 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742109
2015-03-13 10:11:31,989 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742110_1286 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742110
2015-03-13 10:11:31,989 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742111_1287 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742111
2015-03-13 10:11:32,025 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:32,171 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0025_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:11:32,171 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0025_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:11:32,171 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0025_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:11:32,172 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0025_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:11:32,172 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0025_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:11:32,198 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.jar	dst=null	perm=null
2015-03-13 10:11:32,199 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.jar	dst=null	perm=null
2015-03-13 10:11:32,207 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.xml	dst=null	perm=null
2015-03-13 10:11:32,208 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.xml	dst=null	perm=null
2015-03-13 10:11:32,210 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:11:32,212 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:11:32,217 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:11:32,218 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:11:32,220 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:11:32,221 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:11:32,292 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0025_000001 (auth:SIMPLE)
2015-03-13 10:11:32,292 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0025_000001 (auth:SIMPLE)
2015-03-13 10:11:32,296 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0025_01_000003 by user soberoi
2015-03-13 10:11:32,296 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0025
2015-03-13 10:11:32,296 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0025_01_000004 by user soberoi
2015-03-13 10:11:32,296 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0025	CONTAINERID=container_1426266260362_0025_01_000004
2015-03-13 10:11:32,297 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0025_01_000002 by user soberoi
2015-03-13 10:11:32,297 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0025 transitioned from NEW to INITING
2015-03-13 10:11:32,297 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0025_01_000003 to application application_1426266260362_0025
2015-03-13 10:11:32,297 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0025_01_000004 to application application_1426266260362_0025
2015-03-13 10:11:32,297 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0025_01_000005 by user soberoi
2015-03-13 10:11:32,297 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0025 transitioned from INITING to RUNNING
2015-03-13 10:11:32,297 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0025	CONTAINERID=container_1426266260362_0025_01_000005
2015-03-13 10:11:32,297 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:11:32,297 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:11:32,297 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0025_01_000005 to application application_1426266260362_0025
2015-03-13 10:11:32,298 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0025
2015-03-13 10:11:32,298 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0025
2015-03-13 10:11:32,298 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:11:32,298 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0025
2015-03-13 10:11:32,298 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:11:32,298 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:11:32,298 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0025
2015-03-13 10:11:32,298 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0025
2015-03-13 10:11:32,298 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:11:32,296 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0025_01_000006 by user soberoi
2015-03-13 10:11:32,299 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0025
2015-03-13 10:11:32,299 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0025	CONTAINERID=container_1426266260362_0025_01_000006
2015-03-13 10:11:32,298 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0025
2015-03-13 10:11:32,300 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0025 transitioned from NEW to INITING
2015-03-13 10:11:32,300 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0025_01_000006 to application application_1426266260362_0025
2015-03-13 10:11:32,300 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0025 transitioned from INITING to RUNNING
2015-03-13 10:11:32,298 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0025	CONTAINERID=container_1426266260362_0025_01_000002
2015-03-13 10:11:32,300 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:11:32,300 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0025
2015-03-13 10:11:32,300 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0025
2015-03-13 10:11:32,300 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:11:32,300 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0025
2015-03-13 10:11:32,301 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:11:32,301 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:11:32,301 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0025_01_000006
2015-03-13 10:11:32,296 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0025	CONTAINERID=container_1426266260362_0025_01_000003
2015-03-13 10:11:32,300 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0025_01_000002 to application application_1426266260362_0025
2015-03-13 10:11:32,302 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:11:32,302 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0025_01_000004
2015-03-13 10:11:32,302 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0025_01_000003
2015-03-13 10:11:32,303 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:11:32,303 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0025
2015-03-13 10:11:32,303 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0025
2015-03-13 10:11:32,303 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:11:32,303 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0025
2015-03-13 10:11:32,303 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0025
2015-03-13 10:11:32,304 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0025
2015-03-13 10:11:32,304 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:11:32,304 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0025
2015-03-13 10:11:32,304 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0025_01_000005
2015-03-13 10:11:32,304 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0025_01_000002
2015-03-13 10:11:32,327 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426266260362_0025_01_000006.tokens. Credentials list: 
2015-03-13 10:11:32,327 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0025_01_000002.tokens. Credentials list: 
2015-03-13 10:11:32,328 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1426266260362_0025_01_000003.tokens. Credentials list: 
2015-03-13 10:11:32,328 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0025_01_000005.tokens. Credentials list: 
2015-03-13 10:11:32,329 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1426266260362_0025_01_000004.tokens. Credentials list: 
2015-03-13 10:11:32,339 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:32,339 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:32,340 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:32,340 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:32,340 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0025_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:11:32,340 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0025_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:11:32,340 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0025_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:11:32,341 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0025_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:11:32,345 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:11:32,345 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:11:32,423 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0025_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000002.tokens
2015-03-13 10:11:32,423 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0025 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0025
2015-03-13 10:11:32,424 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426266260362_0025_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000006.tokens
2015-03-13 10:11:32,424 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0025 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0025
2015-03-13 10:11:32,469 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:32,469 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0025_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:11:32,492 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.jar	dst=null	perm=null
2015-03-13 10:11:32,493 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.jar	dst=null	perm=null
2015-03-13 10:11:32,493 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.jar	dst=null	perm=null
2015-03-13 10:11:32,493 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.jar	dst=null	perm=null
2015-03-13 10:11:32,494 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.jar	dst=null	perm=null
2015-03-13 10:11:32,494 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.jar	dst=null	perm=null
2015-03-13 10:11:32,501 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62953, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_235292084_13409, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742122_1298, duration: 432000
2015-03-13 10:11:32,501 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62952, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_647090437_13410, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742122_1298, duration: 487000
2015-03-13 10:11:32,522 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:11:32,522 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:11:32,540 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.xml	dst=null	perm=null
2015-03-13 10:11:32,540 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.xml	dst=null	perm=null
2015-03-13 10:11:32,540 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.xml	dst=null	perm=null
2015-03-13 10:11:32,540 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.xml	dst=null	perm=null
2015-03-13 10:11:32,541 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.xml	dst=null	perm=null
2015-03-13 10:11:32,541 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.xml	dst=null	perm=null
2015-03-13 10:11:32,547 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62952, bytes: 98998, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_235292084_13409, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742125_1301, duration: 252000
2015-03-13 10:11:32,548 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62954, bytes: 98998, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_647090437_13410, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742125_1301, duration: 232000
2015-03-13 10:11:32,562 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:11:32,562 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:11:32,562 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:11:32,562 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:11:32,562 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:11:32,562 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:11:32,562 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:11:32,610 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:11:32,610 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:32,611 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:11:32,611 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:32,612 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:11:32,612 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:32,612 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:11:32,612 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:32,615 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:11:32,616 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0024_01_000001
2015-03-13 10:11:32,617 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0024_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:11:32,618 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0024_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:11:32,618 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0024	CONTAINERID=container_1426266260362_0024_01_000001
2015-03-13 10:11:32,619 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0024_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60711, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:11:32,619 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:7168, vCores:6> numContainers=6 user=soberoi user-resources=<memory:7168, vCores:6>
2015-03-13 10:11:32,619 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0024_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:32,619 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:32,619 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6
2015-03-13 10:11:32,619 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0024_000001 released container container_1426266260362_0024_01_000001 on node: host: 10.1.1.144:60711 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:11:32,619 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0024_000001
2015-03-13 10:11:32,619 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0024_000001 State change from FINISHING to FINISHED
2015-03-13 10:11:32,619 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0024 State change from FINISHING to FINISHED
2015-03-13 10:11:32,619 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1426266260362_0024
2015-03-13 10:11:32,620 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0024,name=[716001CDD2B94A3FADE59C5DF8875A2D/4BC832EC1D1E4858AE3D38200A23E3C1] upper2*lower*upper1/(2/2),user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0024/jobhistory/job/job_1426266260362_0024,appMasterHost=Edinburgh.local,startTime=1426266670375,finishTime=1426266685619,finalStatus=SUCCEEDED
2015-03-13 10:11:32,619 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:11:32,620 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:32,620 INFO  capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0024_000001 is done. finalState=FINISHED
2015-03-13 10:11:32,620 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0024 requests cleared
2015-03-13 10:11:32,620 INFO  capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0024 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:11:32,620 INFO  capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0024 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:11:32,620 INFO  amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0024_000001
2015-03-13 10:11:32,624 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0024_000001 (auth:SIMPLE)
2015-03-13 10:11:32,627 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0024_01_000001
2015-03-13 10:11:32,750 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000006/default_container_executor.sh]
2015-03-13 10:11:32,757 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000005/default_container_executor.sh]
2015-03-13 10:11:32,769 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000002/default_container_executor.sh]
2015-03-13 10:11:32,773 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000004/default_container_executor.sh]
2015-03-13 10:11:32,777 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000003/default_container_executor.sh]
2015-03-13 10:11:33,029 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:33,184 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:11:33,344 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:33,344 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:33,344 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:33,344 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:33,344 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0024 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:11:33,345 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0024
2015-03-13 10:11:33,345 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0024
2015-03-13 10:11:33,345 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0024
2015-03-13 10:11:33,345 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0024 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:11:33,345 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0024, with delay of 10800 seconds
2015-03-13 10:11:33,345 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0024
2015-03-13 10:11:33,345 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0024
2015-03-13 10:11:33,470 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:33,470 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0024 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:11:33,470 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0024
2015-03-13 10:11:33,470 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0024
2015-03-13 10:11:33,470 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0024
2015-03-13 10:11:33,471 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0024 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:11:33,470 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0024
2015-03-13 10:11:33,471 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0024, with delay of 10800 seconds
2015-03-13 10:11:33,470 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0024
2015-03-13 10:11:33,594 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:11:33,616 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0024 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:11:33,616 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0024
2015-03-13 10:11:33,617 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0024
2015-03-13 10:11:33,617 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0024
2015-03-13 10:11:33,618 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0024
2015-03-13 10:11:33,618 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0024
2015-03-13 10:11:33,618 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0024 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:11:33,618 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0024, with delay of 10800 seconds
2015-03-13 10:11:33,744 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1426266260362_0025_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000004.tokens
2015-03-13 10:11:33,744 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0025 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0025
2015-03-13 10:11:33,852 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:11:33,967 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0025_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000005.tokens
2015-03-13 10:11:33,968 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0025 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0025
2015-03-13 10:11:34,031 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:34,059 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:11:34,185 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1426266260362_0025_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000003.tokens
2015-03-13 10:11:34,185 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0025 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0025
2015-03-13 10:11:34,347 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:34,347 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:34,347 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:34,347 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:34,471 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:34,551 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742126_1302
2015-03-13 10:11:35,037 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:35,153 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742126_1302
2015-03-13 10:11:35,348 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:35,348 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:35,349 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:35,349 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:35,472 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:36,041 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:36,353 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:36,353 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:36,353 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:36,353 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:36,476 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:37,046 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:37,359 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:37,359 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:37,359 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:37,359 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:37,478 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:38,051 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:38,365 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:38,365 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:38,365 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:38,365 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:38,481 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:39,056 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:39,367 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:39,367 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:39,367 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:39,367 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:39,487 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:40,059 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:40,368 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:40,368 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:40,368 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:40,369 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:40,492 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:40,709 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.split	dst=null	perm=null
2015-03-13 10:11:40,804 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.split	dst=null	perm=null
2015-03-13 10:11:40,877 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.split	dst=null	perm=null
2015-03-13 10:11:40,888 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.split	dst=null	perm=null
2015-03-13 10:11:40,902 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.split	dst=null	perm=null
2015-03-13 10:11:40,975 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62970, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000000_0_-1945362310_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742123_1299, duration: 138000
2015-03-13 10:11:41,002 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62971, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000001_0_223962474_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742123_1299, duration: 156000
2015-03-13 10:11:41,044 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62972, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000003_0_484463544_1, offset: 1024, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742123_1299, duration: 150000
2015-03-13 10:11:41,049 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62973, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000004_0_78506124_1, offset: 1024, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742123_1299, duration: 151000
2015-03-13 10:11:41,061 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:41,065 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62974, bytes: 1282, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000002_0_-112740768_1, offset: 512, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742123_1299, duration: 147000
2015-03-13 10:11:41,120 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:11:41,125 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:11:41,129 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62975, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000001_0_223962474_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 138000
2015-03-13 10:11:41,152 INFO  namenode.FSEditLog (FSEditLog.java:printStatistics(663)) - Number of transactions: 2545 Total time for transactions(ms): 118 Number of transactions batched in Syncs: 5 Number of syncs: 1450 SyncTimes(ms): 416 325 
2015-03-13 10:11:41,152 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/_temporary/attempt_1426266260362_0025_m_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:41,153 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/_temporary/attempt_1426266260362_0025_m_000001_0/part-00001	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:41,169 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:11:41,173 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62976, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000003_0_484463544_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 150000
2015-03-13 10:11:41,176 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:11:41,179 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62974, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000002_0_-112740768_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 142000
2015-03-13 10:11:41,180 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:11:41,183 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62973, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000004_0_78506124_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 152000
2015-03-13 10:11:41,195 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/_temporary/attempt_1426266260362_0025_m_000002_0/part-00002	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:41,198 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/_temporary/attempt_1426266260362_0025_m_000004_0/part-00004	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:41,200 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/_temporary/attempt_1426266260362_0025_m_000003_0/part-00003	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:41,371 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:41,371 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:41,371 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:41,371 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:41,496 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:41,556 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5	dst=null	perm=null
2015-03-13 10:11:41,561 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5	dst=null	perm=null
2015-03-13 10:11:41,563 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5	dst=null	perm=null
2015-03-13 10:11:41,586 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5	dst=null	perm=null
2015-03-13 10:11:41,591 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5	dst=null	perm=null
2015-03-13 10:11:41,592 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5	dst=null	perm=null
2015-03-13 10:11:41,593 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5	dst=null	perm=null
2015-03-13 10:11:41,597 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5	dst=null	perm=null
2015-03-13 10:11:41,599 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5	dst=null	perm=null
2015-03-13 10:11:41,638 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00000	dst=null	perm=null
2015-03-13 10:11:41,639 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00000	dst=null	perm=null
2015-03-13 10:11:41,642 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62971, bytes: 142, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000001_0_223962474_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742116_1292, duration: 152000
2015-03-13 10:11:41,651 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00000	dst=null	perm=null
2015-03-13 10:11:41,654 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00000	dst=null	perm=null
2015-03-13 10:11:41,657 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62970, bytes: 142, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000000_0_-1945362310_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742116_1292, duration: 148000
2015-03-13 10:11:41,681 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5	dst=null	perm=null
2015-03-13 10:11:41,683 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00000	dst=null	perm=null
2015-03-13 10:11:41,685 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00000	dst=null	perm=null
2015-03-13 10:11:41,686 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5	dst=null	perm=null
2015-03-13 10:11:41,687 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00001	dst=null	perm=null
2015-03-13 10:11:41,688 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5	dst=null	perm=null
2015-03-13 10:11:41,688 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5	dst=null	perm=null
2015-03-13 10:11:41,689 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00001	dst=null	perm=null
2015-03-13 10:11:41,690 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62971, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000001_0_223962474_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742113_1289, duration: 152000
2015-03-13 10:11:41,692 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62977, bytes: 142, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000002_0_-112740768_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742116_1292, duration: 142000
2015-03-13 10:11:41,694 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5	dst=null	perm=null
2015-03-13 10:11:41,694 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00002	dst=null	perm=null
2015-03-13 10:11:41,695 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00002	dst=null	perm=null
2015-03-13 10:11:41,697 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5	dst=null	perm=null
2015-03-13 10:11:41,701 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62978, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000001_0_223962474_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742117_1293, duration: 147000
2015-03-13 10:11:41,704 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00001	dst=null	perm=null
2015-03-13 10:11:41,705 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00001	dst=null	perm=null
2015-03-13 10:11:41,707 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00003	dst=null	perm=null
2015-03-13 10:11:41,707 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62970, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000000_0_-1945362310_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742113_1289, duration: 174000
2015-03-13 10:11:41,708 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00003	dst=null	perm=null
2015-03-13 10:11:41,709 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00002	dst=null	perm=null
2015-03-13 10:11:41,710 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62978, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000001_0_223962474_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742114_1290, duration: 143000
2015-03-13 10:11:41,711 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00002	dst=null	perm=null
2015-03-13 10:11:41,713 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62979, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000000_0_-1945362310_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742117_1293, duration: 151000
2015-03-13 10:11:41,713 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00004	dst=null	perm=null
2015-03-13 10:11:41,715 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00004	dst=null	perm=null
2015-03-13 10:11:41,715 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00003	dst=null	perm=null
2015-03-13 10:11:41,717 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00003	dst=null	perm=null
2015-03-13 10:11:41,717 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62978, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000001_0_223962474_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742118_1294, duration: 145000
2015-03-13 10:11:41,719 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62979, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000000_0_-1945362310_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742114_1290, duration: 146000
2015-03-13 10:11:41,720 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00001	dst=null	perm=null
2015-03-13 10:11:41,721 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00004	dst=null	perm=null
2015-03-13 10:11:41,721 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00001	dst=null	perm=null
2015-03-13 10:11:41,722 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00004	dst=null	perm=null
2015-03-13 10:11:41,725 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62970, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000000_0_-1945362310_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742118_1294, duration: 153000
2015-03-13 10:11:41,727 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62980, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000002_0_-112740768_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742113_1289, duration: 148000
2015-03-13 10:11:41,728 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62981, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000000_0_-1945362310_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 183000
2015-03-13 10:11:41,732 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00002	dst=null	perm=null
2015-03-13 10:11:41,733 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00002	dst=null	perm=null
2015-03-13 10:11:41,735 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62980, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000002_0_-112740768_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742117_1293, duration: 145000
2015-03-13 10:11:41,738 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00003	dst=null	perm=null
2015-03-13 10:11:41,739 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00003	dst=null	perm=null
2015-03-13 10:11:41,744 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62982, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000002_0_-112740768_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742114_1290, duration: 152000
2015-03-13 10:11:41,746 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00004	dst=null	perm=null
2015-03-13 10:11:41,747 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/_temporary/attempt_1426266260362_0025_m_000001_0/part-00001. BP-1005356445-10.1.1.144-1426266257849 blk_1073742127_1303{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:11:41,748 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00004	dst=null	perm=null
2015-03-13 10:11:41,750 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62980, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000002_0_-112740768_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742118_1294, duration: 148000
2015-03-13 10:11:41,754 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/_temporary/attempt_1426266260362_0025_m_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073742128_1304{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:11:41,774 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00000	dst=null	perm=null
2015-03-13 10:11:41,775 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00000	dst=null	perm=null
2015-03-13 10:11:41,779 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62985, bytes: 142, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000004_0_78506124_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742116_1292, duration: 147000
2015-03-13 10:11:41,783 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00000	dst=null	perm=null
2015-03-13 10:11:41,785 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00000	dst=null	perm=null
2015-03-13 10:11:41,787 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62986, bytes: 142, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000003_0_484463544_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742116_1292, duration: 136000
2015-03-13 10:11:41,790 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742127_1303 src: /127.0.0.1:62983 dest: /127.0.0.1:60686
2015-03-13 10:11:41,792 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742127_1303 src: /127.0.0.1:62987 dest: /127.0.0.1:60689
2015-03-13 10:11:41,793 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742127_1303 src: /127.0.0.1:62988 dest: /127.0.0.1:60693
2015-03-13 10:11:41,801 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/_temporary/attempt_1426266260362_0025_m_000002_0/part-00002. BP-1005356445-10.1.1.144-1426266257849 blk_1073742129_1305{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:11:41,803 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742128_1304 src: /127.0.0.1:62984 dest: /127.0.0.1:60689
2015-03-13 10:11:41,804 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742128_1304 src: /127.0.0.1:62989 dest: /127.0.0.1:60696
2015-03-13 10:11:41,806 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742128_1304 src: /127.0.0.1:62991 dest: /127.0.0.1:60693
2015-03-13 10:11:41,813 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62988, dest: /127.0.0.1:60693, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0025_m_000001_0_223962474_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742127_1303, duration: 18544000
2015-03-13 10:11:41,814 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742127_1303, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:41,814 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742127_1303{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:11:41,814 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62987, dest: /127.0.0.1:60689, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0025_m_000001_0_223962474_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742127_1303, duration: 19230000
2015-03-13 10:11:41,815 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742127_1303, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:41,815 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742127_1303{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:11:41,815 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62983, dest: /127.0.0.1:60686, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0025_m_000001_0_223962474_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742127_1303, duration: 20165000
2015-03-13 10:11:41,815 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742127_1303, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:41,816 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742127_1303{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:11:41,818 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62991, dest: /127.0.0.1:60693, bytes: 24, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0025_m_000000_0_-1945362310_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742128_1304, duration: 10144000
2015-03-13 10:11:41,818 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742128_1304, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:41,818 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742128_1304{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:11:41,818 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62989, dest: /127.0.0.1:60696, bytes: 24, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0025_m_000000_0_-1945362310_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742128_1304, duration: 10788000
2015-03-13 10:11:41,818 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742128_1304, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:41,819 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742128_1304{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:11:41,819 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62984, dest: /127.0.0.1:60689, bytes: 24, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0025_m_000000_0_-1945362310_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742128_1304, duration: 11500000
2015-03-13 10:11:41,819 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742128_1304, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:41,820 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742128_1304{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:11:41,824 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/_temporary/attempt_1426266260362_0025_m_000001_0/part-00001 is closed by DFSClient_attempt_1426266260362_0025_m_000001_0_223962474_1
2015-03-13 10:11:41,825 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/_temporary/attempt_1426266260362_0025_m_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0025_m_000000_0_-1945362310_1
2015-03-13 10:11:41,837 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/_temporary/attempt_1426266260362_0025_m_000001_0	dst=null	perm=null
2015-03-13 10:11:41,842 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/_temporary/attempt_1426266260362_0025_m_000000_0	dst=null	perm=null
2015-03-13 10:11:41,846 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/_temporary/attempt_1426266260362_0025_m_000001_0	dst=null	perm=null
2015-03-13 10:11:41,847 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/task_1426266260362_0025_m_000001	dst=null	perm=null
2015-03-13 10:11:41,849 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/_temporary/attempt_1426266260362_0025_m_000000_0	dst=null	perm=null
2015-03-13 10:11:41,850 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/task_1426266260362_0025_m_000000	dst=null	perm=null
2015-03-13 10:11:41,853 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/_temporary/attempt_1426266260362_0025_m_000001_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/task_1426266260362_0025_m_000001	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:11:41,855 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/_temporary/attempt_1426266260362_0025_m_000000_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/task_1426266260362_0025_m_000000	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:11:41,855 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742129_1305 src: /127.0.0.1:62990 dest: /127.0.0.1:60693
2015-03-13 10:11:41,857 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742129_1305 src: /127.0.0.1:62992 dest: /127.0.0.1:60686
2015-03-13 10:11:41,858 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742129_1305 src: /127.0.0.1:62993 dest: /127.0.0.1:60689
2015-03-13 10:11:41,866 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62993, dest: /127.0.0.1:60689, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0025_m_000002_0_-112740768_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742129_1305, duration: 6107000
2015-03-13 10:11:41,866 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742129_1305, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:41,866 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742129_1305{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:11:41,867 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62992, dest: /127.0.0.1:60686, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0025_m_000002_0_-112740768_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742129_1305, duration: 7017000
2015-03-13 10:11:41,867 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742129_1305, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:41,867 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62990, dest: /127.0.0.1:60693, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0025_m_000002_0_-112740768_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742129_1305, duration: 7792000
2015-03-13 10:11:41,868 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742129_1305{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:11:41,868 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742129_1305, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:41,868 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742129_1305{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:11:41,872 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00001	dst=null	perm=null
2015-03-13 10:11:41,878 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0025_01_000003
2015-03-13 10:11:41,879 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0025	CONTAINERID=container_1426266260362_0025_01_000003
2015-03-13 10:11:41,879 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:11:41,879 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0025_01_000003
2015-03-13 10:11:41,879 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:41,879 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:11:41,879 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:41,879 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:41,886 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00001	dst=null	perm=null
2015-03-13 10:11:41,891 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0025_01_000003 is : 143
2015-03-13 10:11:41,892 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job_1426266260362_0025_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073742130_1306{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:11:41,894 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742130_1306 src: /127.0.0.1:62994 dest: /127.0.0.1:60693
2015-03-13 10:11:41,896 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742130_1306 src: /127.0.0.1:62995 dest: /127.0.0.1:60689
2015-03-13 10:11:41,897 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742130_1306 src: /127.0.0.1:62996 dest: /127.0.0.1:60686
2015-03-13 10:11:41,898 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0025_01_000002
2015-03-13 10:11:41,898 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0025	CONTAINERID=container_1426266260362_0025_01_000002
2015-03-13 10:11:41,898 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:41,898 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: -1000
2015-03-13 10:11:41,899 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:41,899 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:41,902 INFO  hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job_1426266260362_0025_1.jhist for DFSClient_NONMAPREDUCE_1195153157_1
2015-03-13 10:11:41,903 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:11:41,904 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:11:41,904 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000003
2015-03-13 10:11:41,904 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000003
2015-03-13 10:11:41,904 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0025_01_000002
2015-03-13 10:11:41,904 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000003
2015-03-13 10:11:41,905 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000003
2015-03-13 10:11:41,911 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62997, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000003_0_484463544_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742113_1289, duration: 307000
2015-03-13 10:11:41,913 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00002	dst=null	perm=null
2015-03-13 10:11:41,917 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0025_01_000002 is : 143
2015-03-13 10:11:41,919 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00002	dst=null	perm=null
2015-03-13 10:11:41,922 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62997, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000003_0_484463544_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742117_1293, duration: 139000
2015-03-13 10:11:41,924 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00003	dst=null	perm=null
2015-03-13 10:11:41,925 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00003	dst=null	perm=null
2015-03-13 10:11:41,927 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62986, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000003_0_484463544_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742114_1290, duration: 134000
2015-03-13 10:11:41,929 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0025	CONTAINERID=container_1426266260362_0025_01_000003
2015-03-13 10:11:41,929 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:11:41,929 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:11:41,929 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0025_01_000003 from application application_1426266260362_0025
2015-03-13 10:11:41,929 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00004	dst=null	perm=null
2015-03-13 10:11:41,929 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:41,929 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0025
2015-03-13 10:11:41,930 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000002
2015-03-13 10:11:41,930 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000002
2015-03-13 10:11:41,930 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0025	CONTAINERID=container_1426266260362_0025_01_000002
2015-03-13 10:11:41,930 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:11:41,930 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0025_01_000002 from application application_1426266260362_0025
2015-03-13 10:11:41,930 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:41,930 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0025
2015-03-13 10:11:41,930 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000002
2015-03-13 10:11:41,930 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000002
2015-03-13 10:11:41,931 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00004	dst=null	perm=null
2015-03-13 10:11:41,933 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62997, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000003_0_484463544_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742118_1294, duration: 141000
2015-03-13 10:11:41,934 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/_temporary/attempt_1426266260362_0025_m_000002_0/part-00002 is closed by DFSClient_attempt_1426266260362_0025_m_000002_0_-112740768_1
2015-03-13 10:11:41,935 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00001	dst=null	perm=null
2015-03-13 10:11:41,936 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00001	dst=null	perm=null
2015-03-13 10:11:41,939 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62998, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000004_0_78506124_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742113_1289, duration: 152000
2015-03-13 10:11:41,941 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00002	dst=null	perm=null
2015-03-13 10:11:41,943 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00002	dst=null	perm=null
2015-03-13 10:11:41,944 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/_temporary/attempt_1426266260362_0025_m_000002_0	dst=null	perm=null
2015-03-13 10:11:41,946 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62999, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000004_0_78506124_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742117_1293, duration: 140000
2015-03-13 10:11:41,951 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00003	dst=null	perm=null
2015-03-13 10:11:41,952 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00003	dst=null	perm=null
2015-03-13 10:11:41,955 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/_temporary/attempt_1426266260362_0025_m_000002_0	dst=null	perm=null
2015-03-13 10:11:41,957 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/task_1426266260362_0025_m_000002	dst=null	perm=null
2015-03-13 10:11:41,958 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/_temporary/attempt_1426266260362_0025_m_000003_0/part-00003. BP-1005356445-10.1.1.144-1426266257849 blk_1073742131_1307{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:11:41,959 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63000, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000004_0_78506124_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742114_1290, duration: 136000
2015-03-13 10:11:41,961 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/_temporary/attempt_1426266260362_0025_m_000002_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/task_1426266260362_0025_m_000002	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:11:41,963 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00004	dst=null	perm=null
2015-03-13 10:11:41,965 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00004	dst=null	perm=null
2015-03-13 10:11:41,967 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62985, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000004_0_78506124_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742118_1294, duration: 146000
2015-03-13 10:11:41,976 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0025_01_000004
2015-03-13 10:11:41,977 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0025	CONTAINERID=container_1426266260362_0025_01_000004
2015-03-13 10:11:41,977 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:11:41,977 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:11:41,977 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0025_01_000002
2015-03-13 10:11:41,978 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0025_01_000004
2015-03-13 10:11:41,978 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:11:41,978 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0025_01_000003
2015-03-13 10:11:41,978 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:11:41,978 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:41,978 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0025_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:11:41,978 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0025_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:11:41,979 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0025	CONTAINERID=container_1426266260362_0025_01_000002
2015-03-13 10:11:41,979 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0025_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:11:41,979 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:11:41,979 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0025_01_000002, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:41,979 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:41,979 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:11:41,979 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0025_000001 released container container_1426266260362_0025_01_000002 on node: host: 10.1.1.144:60719 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:11:41,979 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0025_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:11:41,979 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0025_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:11:41,979 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0025	CONTAINERID=container_1426266260362_0025_01_000003
2015-03-13 10:11:41,979 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0025_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:11:41,979 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:11:41,980 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0025_01_000003, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:41,980 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:41,980 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:11:41,980 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0025_000001 released container container_1426266260362_0025_01_000003 on node: host: 10.1.1.144:60719 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:11:41,991 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0025_01_000004 is : 143
2015-03-13 10:11:42,003 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:11:42,004 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000004
2015-03-13 10:11:42,005 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000004
2015-03-13 10:11:42,005 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000004
2015-03-13 10:11:42,006 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000004
2015-03-13 10:11:42,006 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0025	CONTAINERID=container_1426266260362_0025_01_000004
2015-03-13 10:11:42,006 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:11:42,006 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0025_01_000004 from application application_1426266260362_0025
2015-03-13 10:11:42,007 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:42,007 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0025
2015-03-13 10:11:42,010 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742131_1307 src: /127.0.0.1:63001 dest: /127.0.0.1:60689
2015-03-13 10:11:42,012 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742131_1307 src: /127.0.0.1:63002 dest: /127.0.0.1:60686
2015-03-13 10:11:42,013 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742131_1307 src: /127.0.0.1:63003 dest: /127.0.0.1:60693
2015-03-13 10:11:42,022 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63003, dest: /127.0.0.1:60693, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0025_m_000003_0_484463544_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742131_1307, duration: 7423000
2015-03-13 10:11:42,022 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742131_1307, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:42,022 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742131_1307{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:11:42,023 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63002, dest: /127.0.0.1:60686, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0025_m_000003_0_484463544_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742131_1307, duration: 8105000
2015-03-13 10:11:42,023 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742131_1307, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:42,023 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742131_1307{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:11:42,023 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63001, dest: /127.0.0.1:60689, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0025_m_000003_0_484463544_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742131_1307, duration: 8944000
2015-03-13 10:11:42,024 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742131_1307, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:42,024 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742131_1307{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:11:42,036 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/_temporary/attempt_1426266260362_0025_m_000004_0/part-00004 is closed by DFSClient_attempt_1426266260362_0025_m_000004_0_78506124_1
2015-03-13 10:11:42,044 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/_temporary/attempt_1426266260362_0025_m_000003_0/part-00003 is closed by DFSClient_attempt_1426266260362_0025_m_000003_0_484463544_1
2015-03-13 10:11:42,053 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/_temporary/attempt_1426266260362_0025_m_000004_0	dst=null	perm=null
2015-03-13 10:11:42,054 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/_temporary/attempt_1426266260362_0025_m_000003_0	dst=null	perm=null
2015-03-13 10:11:42,059 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/_temporary/attempt_1426266260362_0025_m_000004_0	dst=null	perm=null
2015-03-13 10:11:42,060 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/_temporary/attempt_1426266260362_0025_m_000003_0	dst=null	perm=null
2015-03-13 10:11:42,060 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/task_1426266260362_0025_m_000004	dst=null	perm=null
2015-03-13 10:11:42,061 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/task_1426266260362_0025_m_000003	dst=null	perm=null
2015-03-13 10:11:42,062 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:42,063 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/_temporary/attempt_1426266260362_0025_m_000004_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/task_1426266260362_0025_m_000004	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:11:42,064 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/_temporary/attempt_1426266260362_0025_m_000003_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/task_1426266260362_0025_m_000003	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:11:42,073 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0025_01_000006
2015-03-13 10:11:42,073 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0025	CONTAINERID=container_1426266260362_0025_01_000006
2015-03-13 10:11:42,073 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:11:42,073 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0025_01_000006
2015-03-13 10:11:42,074 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:11:42,077 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0025_01_000005
2015-03-13 10:11:42,077 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0025	CONTAINERID=container_1426266260362_0025_01_000005
2015-03-13 10:11:42,077 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:11:42,077 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0025_01_000004
2015-03-13 10:11:42,077 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:11:42,078 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0025_01_000005
2015-03-13 10:11:42,078 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:11:42,078 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0025_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:11:42,078 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0025_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:11:42,079 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0025	CONTAINERID=container_1426266260362_0025_01_000004
2015-03-13 10:11:42,079 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0025_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:11:42,079 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:11:42,079 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0025_01_000004, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:42,079 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:42,079 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:11:42,079 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0025_000001 released container container_1426266260362_0025_01_000004 on node: host: 10.1.1.144:60719 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:11:42,082 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:42,084 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_1195153157_1
2015-03-13 10:11:42,086 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0025_01_000006 is : 143
2015-03-13 10:11:42,089 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1	dst=null	perm=null
2015-03-13 10:11:42,094 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0025_01_000005 is : 143
2015-03-13 10:11:42,096 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped	dst=null	perm=null
2015-03-13 10:11:42,097 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped	dst=null	perm=null
2015-03-13 10:11:42,098 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:11:42,098 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000006
2015-03-13 10:11:42,098 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/task_1426266260362_0025_m_000000	dst=null	perm=null
2015-03-13 10:11:42,098 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000006
2015-03-13 10:11:42,106 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000006
2015-03-13 10:11:42,107 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000006
2015-03-13 10:11:42,098 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0025	CONTAINERID=container_1426266260362_0025_01_000006
2015-03-13 10:11:42,107 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:11:42,107 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0025_01_000006 from application application_1426266260362_0025
2015-03-13 10:11:42,107 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:42,107 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0025
2015-03-13 10:11:42,108 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/part-00000	dst=null	perm=null
2015-03-13 10:11:42,111 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/task_1426266260362_0025_m_000000/part-00000	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/part-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:42,114 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped	dst=null	perm=null
2015-03-13 10:11:42,115 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped	dst=null	perm=null
2015-03-13 10:11:42,116 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/task_1426266260362_0025_m_000001	dst=null	perm=null
2015-03-13 10:11:42,118 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:11:42,118 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/part-00001	dst=null	perm=null
2015-03-13 10:11:42,118 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000005
2015-03-13 10:11:42,119 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000005
2015-03-13 10:11:42,119 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000005
2015-03-13 10:11:42,119 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/task_1426266260362_0025_m_000001/part-00001	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/part-00001	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:42,120 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000005
2015-03-13 10:11:42,121 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped	dst=null	perm=null
2015-03-13 10:11:42,121 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0025	CONTAINERID=container_1426266260362_0025_01_000005
2015-03-13 10:11:42,122 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:11:42,122 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped	dst=null	perm=null
2015-03-13 10:11:42,122 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0025_01_000005 from application application_1426266260362_0025
2015-03-13 10:11:42,122 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:42,122 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0025
2015-03-13 10:11:42,123 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/task_1426266260362_0025_m_000002	dst=null	perm=null
2015-03-13 10:11:42,124 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/part-00002	dst=null	perm=null
2015-03-13 10:11:42,126 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/task_1426266260362_0025_m_000002/part-00002	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/part-00002	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:42,127 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped	dst=null	perm=null
2015-03-13 10:11:42,127 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped	dst=null	perm=null
2015-03-13 10:11:42,128 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/task_1426266260362_0025_m_000003	dst=null	perm=null
2015-03-13 10:11:42,130 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/part-00003	dst=null	perm=null
2015-03-13 10:11:42,131 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/task_1426266260362_0025_m_000003/part-00003	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/part-00003	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:42,132 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped	dst=null	perm=null
2015-03-13 10:11:42,133 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped	dst=null	perm=null
2015-03-13 10:11:42,134 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/task_1426266260362_0025_m_000004	dst=null	perm=null
2015-03-13 10:11:42,135 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/part-00004	dst=null	perm=null
2015-03-13 10:11:42,136 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/task_1426266260362_0025_m_000004/part-00004	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/part-00004	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:42,139 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary	dst=null	perm=null
2015-03-13 10:11:42,142 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:42,144 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_SUCCESS is closed by DFSClient_NONMAPREDUCE_1195153157_1
2015-03-13 10:11:42,146 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:42,149 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_1195153157_1
2015-03-13 10:11:42,162 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62996, dest: /127.0.0.1:60686, bytes: 53349, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1195153157_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742130_1306, duration: 262383000
2015-03-13 10:11:42,163 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742130_1306, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:42,164 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742130_1306{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:42,164 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62995, dest: /127.0.0.1:60689, bytes: 53349, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1195153157_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742130_1306, duration: 263794000
2015-03-13 10:11:42,164 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742130_1306, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:42,165 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742130_1306{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:42,166 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62994, dest: /127.0.0.1:60693, bytes: 53349, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1195153157_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742130_1306, duration: 265500000
2015-03-13 10:11:42,166 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742130_1306, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:42,166 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742130_1306{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:42,168 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job_1426266260362_0025_1.jhist is closed by DFSClient_NONMAPREDUCE_1195153157_1
2015-03-13 10:11:42,170 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0025.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:42,172 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0025.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742132_1308{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:11:42,175 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742132_1308 src: /127.0.0.1:63004 dest: /127.0.0.1:60689
2015-03-13 10:11:42,176 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742132_1308 src: /127.0.0.1:63005 dest: /127.0.0.1:60693
2015-03-13 10:11:42,178 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742132_1308 src: /127.0.0.1:63006 dest: /127.0.0.1:60696
2015-03-13 10:11:42,181 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63006, dest: /127.0.0.1:60696, bytes: 448, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1195153157_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742132_1308, duration: 1416000
2015-03-13 10:11:42,181 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742132_1308, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:42,181 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742132_1308{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:42,181 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63005, dest: /127.0.0.1:60693, bytes: 448, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1195153157_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742132_1308, duration: 2021000
2015-03-13 10:11:42,182 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742132_1308, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:42,182 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742132_1308{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:42,182 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63004, dest: /127.0.0.1:60689, bytes: 448, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1195153157_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742132_1308, duration: 3074000
2015-03-13 10:11:42,183 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742132_1308, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:42,183 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742132_1308{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:42,184 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0025.summary_tmp is closed by DFSClient_NONMAPREDUCE_1195153157_1
2015-03-13 10:11:42,189 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0025.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:11:42,195 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job_1426266260362_0025_1.jhist	dst=null	perm=null
2015-03-13 10:11:42,196 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0025-1426266686752-soberoi-%5B716001CDD2B94A3FADE59C5DF8875A2D%2F9FD5B5C1ECE64C74-1426266702150-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:11:42,199 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job_1426266260362_0025_1.jhist	dst=null	perm=null
2015-03-13 10:11:42,200 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0025-1426266686752-soberoi-%5B716001CDD2B94A3FADE59C5DF8875A2D%2F9FD5B5C1ECE64C74-1426266702150-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:11:42,201 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job_1426266260362_0025_1.jhist	dst=null	perm=null
2015-03-13 10:11:42,203 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0025-1426266686752-soberoi-%5B716001CDD2B94A3FADE59C5DF8875A2D%2F9FD5B5C1ECE64C74-1426266702150-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:42,205 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63007, bytes: 53769, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1195153157_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742130_1306, duration: 184000
2015-03-13 10:11:42,207 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0025-1426266686752-soberoi-%5B716001CDD2B94A3FADE59C5DF8875A2D%2F9FD5B5C1ECE64C74-1426266702150-5-0-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742133_1309{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:11:42,209 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742133_1309 src: /127.0.0.1:63008 dest: /127.0.0.1:60696
2015-03-13 10:11:42,210 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742133_1309 src: /127.0.0.1:63009 dest: /127.0.0.1:60693
2015-03-13 10:11:42,211 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742133_1309 src: /127.0.0.1:63010 dest: /127.0.0.1:60686
2015-03-13 10:11:42,214 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63010, dest: /127.0.0.1:60686, bytes: 53349, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1195153157_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742133_1309, duration: 1651000
2015-03-13 10:11:42,214 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742133_1309, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:42,215 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63009, dest: /127.0.0.1:60693, bytes: 53349, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1195153157_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742133_1309, duration: 1987000
2015-03-13 10:11:42,215 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742133_1309{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:42,215 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742133_1309, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:42,216 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63008, dest: /127.0.0.1:60696, bytes: 53349, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1195153157_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742133_1309, duration: 3041000
2015-03-13 10:11:42,216 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742133_1309, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:42,217 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742133_1309{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:42,217 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742133_1309{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:42,218 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0025-1426266686752-soberoi-%5B716001CDD2B94A3FADE59C5DF8875A2D%2F9FD5B5C1ECE64C74-1426266702150-5-0-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_1195153157_1
2015-03-13 10:11:42,219 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0025-1426266686752-soberoi-%5B716001CDD2B94A3FADE59C5DF8875A2D%2F9FD5B5C1ECE64C74-1426266702150-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:11:42,221 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job_1426266260362_0025_1_conf.xml	dst=null	perm=null
2015-03-13 10:11:42,222 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0025_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:11:42,223 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job_1426266260362_0025_1_conf.xml	dst=null	perm=null
2015-03-13 10:11:42,224 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0025_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:11:42,225 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job_1426266260362_0025_1_conf.xml	dst=null	perm=null
2015-03-13 10:11:42,228 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0025_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:42,230 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63011, bytes: 91733, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1195153157_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742126_1302, duration: 229000
2015-03-13 10:11:42,232 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0025_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742134_1310{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:11:42,233 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742134_1310 src: /127.0.0.1:63012 dest: /127.0.0.1:60689
2015-03-13 10:11:42,235 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742134_1310 src: /127.0.0.1:63013 dest: /127.0.0.1:60686
2015-03-13 10:11:42,236 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742134_1310 src: /127.0.0.1:63014 dest: /127.0.0.1:60696
2015-03-13 10:11:42,238 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63014, dest: /127.0.0.1:60696, bytes: 91021, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1195153157_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742134_1310, duration: 1905000
2015-03-13 10:11:42,239 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742134_1310, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:42,239 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742134_1310{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:42,239 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63013, dest: /127.0.0.1:60686, bytes: 91021, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1195153157_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742134_1310, duration: 2311000
2015-03-13 10:11:42,239 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742134_1310, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:42,240 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742134_1310{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:42,240 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63012, dest: /127.0.0.1:60689, bytes: 91021, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1195153157_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742134_1310, duration: 3372000
2015-03-13 10:11:42,241 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742134_1310, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:42,242 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742134_1310{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:42,243 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0025_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_1195153157_1
2015-03-13 10:11:42,244 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0025_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:11:42,246 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0025.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0025.summary	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:11:42,248 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0025_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0025_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:11:42,249 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0025-1426266686752-soberoi-%5B716001CDD2B94A3FADE59C5DF8875A2D%2F9FD5B5C1ECE64C74-1426266702150-5-0-SUCCEEDED-default.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0025-1426266686752-soberoi-%5B716001CDD2B94A3FADE59C5DF8875A2D%2F9FD5B5C1ECE64C74-1426266702150-5-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:11:42,256 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0025_000001 State change from RUNNING to FINISHING
2015-03-13 10:11:42,256 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0025
2015-03-13 10:11:42,256 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0025 State change from RUNNING to REMOVING
2015-03-13 10:11:42,256 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0025
2015-03-13 10:11:42,257 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0025 State change from REMOVING to FINISHING
2015-03-13 10:11:43,068 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:43,078 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:11:43,079 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0025_01_000006
2015-03-13 10:11:43,079 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0025_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:11:43,079 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0025_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:11:43,079 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0025	CONTAINERID=container_1426266260362_0025_01_000006
2015-03-13 10:11:43,080 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0025_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:11:43,080 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:11:43,080 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0025_01_000006, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:43,080 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:43,080 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:11:43,080 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0025_000001 released container container_1426266260362_0025_01_000006 on node: host: 10.1.1.144:60715 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:11:43,082 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:11:43,082 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0025_01_000005
2015-03-13 10:11:43,083 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0025_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:11:43,083 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0025_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:11:43,083 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0025	CONTAINERID=container_1426266260362_0025_01_000005
2015-03-13 10:11:43,083 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0025_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:11:43,083 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:11:43,083 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0025_01_000005, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:43,083 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:43,084 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:11:43,084 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0025_000001 released container container_1426266260362_0025_01_000005 on node: host: 10.1.1.144:60719 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:11:43,264 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742122_1298 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60693 
2015-03-13 10:11:43,264 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742123_1299 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60689 
2015-03-13 10:11:43,264 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742124_1300 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60689 
2015-03-13 10:11:43,264 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742125_1301 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60696 
2015-03-13 10:11:43,265 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742130_1306 127.0.0.1:60693 127.0.0.1:60689 127.0.0.1:60686 
2015-03-13 10:11:43,265 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742126_1302 127.0.0.1:60689 127.0.0.1:60693 127.0.0.1:60696 
2015-03-13 10:11:43,265 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025	dst=null	perm=null
2015-03-13 10:11:43,303 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742116_1292 127.0.0.1:60693 127.0.0.1:60689 127.0.0.1:60696 
2015-03-13 10:11:43,303 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742113_1289 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60693 
2015-03-13 10:11:43,303 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742117_1293 127.0.0.1:60689 127.0.0.1:60696 127.0.0.1:60686 
2015-03-13 10:11:43,303 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742114_1290 127.0.0.1:60689 127.0.0.1:60696 127.0.0.1:60686 
2015-03-13 10:11:43,303 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742118_1294 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60686 
2015-03-13 10:11:43,303 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5	dst=null	perm=null
2015-03-13 10:11:43,304 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped	dst=null	perm=null
2015-03-13 10:11:43,304 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary
2015-03-13 10:11:43,305 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary	dst=null	perm=null
2015-03-13 10:11:43,312 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:11:43,312 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:11:43,313 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:11:43,314 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped	dst=null	perm=null
2015-03-13 10:11:43,314 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped	dst=null	perm=null
2015-03-13 10:11:43,315 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped	dst=null	perm=null
2015-03-13 10:11:43,316 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:11:43,317 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/part-00000	dst=null	perm=null
2015-03-13 10:11:43,319 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63016, bytes: 28, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742128_1304, duration: 207000
2015-03-13 10:11:43,320 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/part-00001	dst=null	perm=null
2015-03-13 10:11:43,321 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63016, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742127_1303, duration: 156000
2015-03-13 10:11:43,321 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/part-00002	dst=null	perm=null
2015-03-13 10:11:43,323 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63017, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742129_1305, duration: 177000
2015-03-13 10:11:43,324 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/part-00003	dst=null	perm=null
2015-03-13 10:11:43,325 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63016, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742131_1307, duration: 166000
2015-03-13 10:11:43,325 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/part-00004	dst=null	perm=null
2015-03-13 10:11:43,333 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:11:43,333 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:11:43,334 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:11:43,335 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped	dst=null	perm=null
2015-03-13 10:11:43,336 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped	dst=null	perm=null
2015-03-13 10:11:43,336 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped	dst=null	perm=null
2015-03-13 10:11:43,338 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:11:43,339 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/part-00000	dst=null	perm=null
2015-03-13 10:11:43,341 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63018, bytes: 28, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742128_1304, duration: 121000
2015-03-13 10:11:43,342 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/part-00001	dst=null	perm=null
2015-03-13 10:11:43,344 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63019, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742127_1303, duration: 134000
2015-03-13 10:11:43,344 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/part-00002	dst=null	perm=null
2015-03-13 10:11:43,345 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63017, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742129_1305, duration: 134000
2015-03-13 10:11:43,346 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/part-00003	dst=null	perm=null
2015-03-13 10:11:43,346 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63017, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742131_1307, duration: 154000
2015-03-13 10:11:43,347 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/part-00004	dst=null	perm=null
2015-03-13 10:11:43,347 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped
2015-03-13 10:11:43,348 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped	dst=null	perm=null
2015-03-13 10:11:43,348 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped	dst=null	perm=null
2015-03-13 10:11:43,349 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped	dst=null	perm=null
2015-03-13 10:11:43,349 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped	dst=null	perm=null
2015-03-13 10:11:43,350 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/part-00000	dst=null	perm=null
2015-03-13 10:11:43,351 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/part-00000	dst=null	perm=null
2015-03-13 10:11:43,352 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63016, bytes: 28, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742128_1304, duration: 233000
2015-03-13 10:11:43,353 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/part-00001	dst=null	perm=null
2015-03-13 10:11:43,353 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/part-00001	dst=null	perm=null
2015-03-13 10:11:43,354 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63016, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742127_1303, duration: 162000
2015-03-13 10:11:43,355 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/part-00002	dst=null	perm=null
2015-03-13 10:11:43,355 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/part-00002	dst=null	perm=null
2015-03-13 10:11:43,357 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63019, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742129_1305, duration: 141000
2015-03-13 10:11:43,357 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/part-00003	dst=null	perm=null
2015-03-13 10:11:43,358 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/part-00003	dst=null	perm=null
2015-03-13 10:11:43,359 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63016, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742131_1307, duration: 174000
2015-03-13 10:11:43,359 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/part-00004	dst=null	perm=null
2015-03-13 10:11:43,360 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/part-00004	dst=null	perm=null
2015-03-13 10:11:43,361 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:11:43,362 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:11:43,373 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:11:43,374 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:11:43,374 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:11:43,389 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch	dst=null	perm=null
2015-03-13 10:11:43,390 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting
2015-03-13 10:11:43,390 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt"]
2015-03-13 10:11:43,390 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-03-13 10:11:43,390 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch"]
2015-03-13 10:11:43,390 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  parallel execution is enabled: true
2015-03-13 10:11:43,390 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  starting jobs: 2
2015-03-13 10:11:43,390 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  allocating threads: 2
2015-03-13 10:11:43,391 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (2/2)
2015-03-13 10:11:43,398 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:11:43,406 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:11:43,407 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0	dst=null	perm=null
2015-03-13 10:11:43,408 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:11:43,408 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:11:43,410 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 26
2015-03-13 10:11:43,411 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026	dst=null	perm=null
2015-03-13 10:11:43,412 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026	dst=null	perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:11:43,413 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026	dst=null	perm=soberoi:supergroup:rwx------
2015-03-13 10:11:43,413 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.jar	dst=null	perm=null
2015-03-13 10:11:43,415 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:11:43,416 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073742135_1311{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:11:43,417 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742135_1311 src: /127.0.0.1:63021 dest: /127.0.0.1:60686
2015-03-13 10:11:43,418 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742135_1311 src: /127.0.0.1:63022 dest: /127.0.0.1:60693
2015-03-13 10:11:43,419 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742135_1311 src: /127.0.0.1:63023 dest: /127.0.0.1:60696
2015-03-13 10:11:43,423 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63023, dest: /127.0.0.1:60696, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742135_1311, duration: 2584000
2015-03-13 10:11:43,424 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742135_1311, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:43,424 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742135_1311{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:43,424 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63022, dest: /127.0.0.1:60693, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742135_1311, duration: 2649000
2015-03-13 10:11:43,424 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742135_1311, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:43,425 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742135_1311{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:43,425 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63021, dest: /127.0.0.1:60686, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742135_1311, duration: 3505000
2015-03-13 10:11:43,425 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742135_1311, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:43,425 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742135_1311{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:43,426 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:11:43,427 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.jar
2015-03-13 10:11:43,427 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.jar	dst=null	perm=null
2015-03-13 10:11:43,428 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:11:43,429 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:11:43,430 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:11:43,431 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:11:43,432 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:11:43,432 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:11:43,433 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:11:43,433 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:11:43,434 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:11:43,434 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:11:43,435 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:11:43,436 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:11:43,436 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:11:43,438 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:11:43,439 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:11:43,439 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.split
2015-03-13 10:11:43,440 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.split	dst=null	perm=null
2015-03-13 10:11:43,441 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073742136_1312{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:11:43,442 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742136_1312 src: /127.0.0.1:63024 dest: /127.0.0.1:60693
2015-03-13 10:11:43,443 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742136_1312 src: /127.0.0.1:63025 dest: /127.0.0.1:60696
2015-03-13 10:11:43,444 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742136_1312 src: /127.0.0.1:63026 dest: /127.0.0.1:60686
2015-03-13 10:11:43,445 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742136_1312 src: /127.0.0.1:63027 dest: /127.0.0.1:60689
2015-03-13 10:11:43,447 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63027, dest: /127.0.0.1:60689, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742136_1312, duration: 1602000
2015-03-13 10:11:43,448 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742136_1312, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:43,448 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742136_1312{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:11:43,448 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63026, dest: /127.0.0.1:60686, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742136_1312, duration: 1986000
2015-03-13 10:11:43,448 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742136_1312, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:43,449 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742136_1312{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:11:43,449 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63025, dest: /127.0.0.1:60696, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742136_1312, duration: 2802000
2015-03-13 10:11:43,449 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742136_1312, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:43,449 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742136_1312{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:11:43,450 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63024, dest: /127.0.0.1:60693, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742136_1312, duration: 3381000
2015-03-13 10:11:43,450 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742136_1312, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:43,451 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742136_1312{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:11:43,452 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:11:43,453 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:11:43,454 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:11:43,455 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073742137_1313{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:11:43,456 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742137_1313 src: /127.0.0.1:63028 dest: /127.0.0.1:60693
2015-03-13 10:11:43,457 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742137_1313 src: /127.0.0.1:63029 dest: /127.0.0.1:60686
2015-03-13 10:11:43,458 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742137_1313 src: /127.0.0.1:63030 dest: /127.0.0.1:60696
2015-03-13 10:11:43,461 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63030, dest: /127.0.0.1:60696, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742137_1313, duration: 1048000
2015-03-13 10:11:43,461 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742137_1313, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:43,461 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742137_1313{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:43,461 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63029, dest: /127.0.0.1:60686, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742137_1313, duration: 1554000
2015-03-13 10:11:43,462 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742137_1313, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:43,462 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742137_1313{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:43,462 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63028, dest: /127.0.0.1:60693, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742137_1313, duration: 2462000
2015-03-13 10:11:43,463 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742137_1313, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:43,464 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742137_1313{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:43,464 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:11:43,465 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:11:43,466 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:11:43,467 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:11:43,468 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:11:43,469 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:11:43,469 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:11:43,473 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742138_1314{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:11:43,475 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742138_1314 src: /127.0.0.1:63031 dest: /127.0.0.1:60686
2015-03-13 10:11:43,476 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742138_1314 src: /127.0.0.1:63032 dest: /127.0.0.1:60696
2015-03-13 10:11:43,477 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742138_1314 src: /127.0.0.1:63033 dest: /127.0.0.1:60693
2015-03-13 10:11:43,480 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63033, dest: /127.0.0.1:60693, bytes: 97894, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742138_1314, duration: 1418000
2015-03-13 10:11:43,480 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742138_1314, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:43,481 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742138_1314{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:11:43,481 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63032, dest: /127.0.0.1:60696, bytes: 97894, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742138_1314, duration: 1965000
2015-03-13 10:11:43,481 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742138_1314, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:43,481 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742138_1314{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:11:43,482 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63031, dest: /127.0.0.1:60686, bytes: 97894, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742138_1314, duration: 2743000
2015-03-13 10:11:43,482 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742138_1314, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:43,482 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742138_1314{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:11:43,483 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:11:43,483 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0026
2015-03-13 10:11:43,484 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026	dst=null	perm=null
2015-03-13 10:11:43,485 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.xml	dst=null	perm=null
2015-03-13 10:11:43,485 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.xml	dst=null	perm=null
2015-03-13 10:11:43,486 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.jar	dst=null	perm=null
2015-03-13 10:11:43,486 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.jar	dst=null	perm=null
2015-03-13 10:11:43,487 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.split	dst=null	perm=null
2015-03-13 10:11:43,487 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.split	dst=null	perm=null
2015-03-13 10:11:43,488 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:11:43,488 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:11:43,489 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:11:43,490 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:11:43,490 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:11:43,491 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:11:43,491 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:11:43,492 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:11:43,493 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 26 submitted by user soberoi
2015-03-13 10:11:43,493 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0026
2015-03-13 10:11:43,493 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	IP=10.1.1.144	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1426266260362_0026
2015-03-13 10:11:43,493 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0026
2015-03-13 10:11:43,493 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0026 State change from NEW to NEW_SAVING
2015-03-13 10:11:43,493 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0026 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:11:43,494 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0026_000001
2015-03-13 10:11:43,494 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0026_000001 State change from NEW to SUBMITTED
2015-03-13 10:11:43,494 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0026 from user: soberoi activated in queue: default
2015-03-13 10:11:43,494 INFO  capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0026 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:11:43,494 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0026 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:11:43,494 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0026 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:11:43,494 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0026_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:11:43,494 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0026_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:11:43,495 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0026 State change from SUBMITTED to ACCEPTED
2015-03-13 10:11:43,496 INFO  mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0026/
2015-03-13 10:11:43,496 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1426266260362_0026
2015-03-13 10:11:43,496 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0026/
2015-03-13 10:11:43,638 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0026_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:11:43,638 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0026	CONTAINERID=container_1426266260362_0026_01_000001
2015-03-13 10:11:43,638 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0026_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:11:43,638 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0026 container=Container: [ContainerId: container_1426266260362_0026_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0026_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:43,639 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:11:43,639 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0026_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:11:43,639 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:43,639 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0026 AttemptId: appattempt_1426266260362_0026_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0026_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ]
2015-03-13 10:11:43,639 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0026_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:11:43,640 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0026_000001
2015-03-13 10:11:43,640 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0026_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:11:43,640 INFO  amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0026_000001
2015-03-13 10:11:43,640 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0026_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] for AM appattempt_1426266260362_0026_000001
2015-03-13 10:11:43,640 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0026_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-03-13 10:11:43,642 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0026_000001 (auth:SIMPLE)
2015-03-13 10:11:43,643 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0026_01_000001 by user soberoi
2015-03-13 10:11:43,643 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0026
2015-03-13 10:11:43,643 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0026	CONTAINERID=container_1426266260362_0026_01_000001
2015-03-13 10:11:43,644 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0026 transitioned from NEW to INITING
2015-03-13 10:11:43,644 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0026_01_000001 to application application_1426266260362_0026
2015-03-13 10:11:43,644 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0026_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] for AM appattempt_1426266260362_0026_000001
2015-03-13 10:11:43,644 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0026 transitioned from INITING to RUNNING
2015-03-13 10:11:43,644 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0026_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:11:43,644 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:11:43,644 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0026
2015-03-13 10:11:43,644 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:11:43,644 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:11:43,645 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:11:43,645 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:11:43,645 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0026_01_000001
2015-03-13 10:11:43,654 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1426266260362_0026_01_000001.tokens. Credentials list: 
2015-03-13 10:11:43,669 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:11:43,739 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1426266260362_0026_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000001.tokens
2015-03-13 10:11:43,739 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0026 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0026
2015-03-13 10:11:43,798 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.jar	dst=null	perm=null
2015-03-13 10:11:43,799 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.jar	dst=null	perm=null
2015-03-13 10:11:43,800 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.jar	dst=null	perm=null
2015-03-13 10:11:43,806 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63017, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-878695311_13821, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742135_1311, duration: 495000
2015-03-13 10:11:43,825 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:11:43,841 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:11:43,842 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:11:43,842 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:11:43,848 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63018, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-878695311_13821, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742137_1313, duration: 164000
2015-03-13 10:11:43,861 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:11:43,878 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.split	dst=null	perm=null
2015-03-13 10:11:43,878 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.split	dst=null	perm=null
2015-03-13 10:11:43,879 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.split	dst=null	perm=null
2015-03-13 10:11:43,885 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63018, bytes: 1798, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-878695311_13821, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742136_1312, duration: 150000
2015-03-13 10:11:43,896 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:11:43,912 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.xml	dst=null	perm=null
2015-03-13 10:11:43,913 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.xml	dst=null	perm=null
2015-03-13 10:11:43,913 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.xml	dst=null	perm=null
2015-03-13 10:11:43,919 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63019, bytes: 98662, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-878695311_13821, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742138_1314, duration: 279000
2015-03-13 10:11:43,931 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:11:43,931 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:11:43,955 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:11:43,955 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:44,030 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000001/default_container_executor.sh]
2015-03-13 10:11:44,069 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:44,561 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742129_1305
2015-03-13 10:11:44,561 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742132_1308
2015-03-13 10:11:44,562 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742127_1303
2015-03-13 10:11:44,562 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742131_1307
2015-03-13 10:11:44,562 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742128_1304
2015-03-13 10:11:44,563 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742134_1310
2015-03-13 10:11:44,563 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742130_1306
2015-03-13 10:11:44,563 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742136_1312
2015-03-13 10:11:44,638 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:44,638 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0026_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:11:45,070 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:45,166 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742133_1309
2015-03-13 10:11:45,166 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742127_1303
2015-03-13 10:11:45,167 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742130_1306
2015-03-13 10:11:45,167 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742138_1314
2015-03-13 10:11:45,168 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742132_1308
2015-03-13 10:11:45,168 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742131_1307
2015-03-13 10:11:45,168 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742136_1312
2015-03-13 10:11:45,312 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742129_1305
2015-03-13 10:11:45,312 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742130_1306
2015-03-13 10:11:45,313 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742131_1307
2015-03-13 10:11:45,313 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742134_1310
2015-03-13 10:11:45,314 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742138_1314
2015-03-13 10:11:45,314 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742137_1313
2015-03-13 10:11:45,370 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742135_1311
2015-03-13 10:11:45,370 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742137_1313
2015-03-13 10:11:45,371 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742129_1305
2015-03-13 10:11:45,371 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742128_1304
2015-03-13 10:11:45,515 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742133_1309
2015-03-13 10:11:45,516 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742134_1310
2015-03-13 10:11:45,516 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742137_1313
2015-03-13 10:11:45,517 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742138_1314
2015-03-13 10:11:45,517 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742135_1311
2015-03-13 10:11:45,518 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742133_1309
2015-03-13 10:11:45,518 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742127_1303
2015-03-13 10:11:45,518 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742136_1312
2015-03-13 10:11:45,630 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:11:45,641 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:45,651 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/COMMIT_STARTED	dst=null	perm=null
2015-03-13 10:11:45,653 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/COMMIT_SUCCESS	dst=null	perm=null
2015-03-13 10:11:45,654 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/COMMIT_FAIL	dst=null	perm=null
2015-03-13 10:11:45,705 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026	dst=null	perm=null
2015-03-13 10:11:45,706 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:11:45,707 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:11:45,920 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742135_1311
2015-03-13 10:11:45,920 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742128_1304
2015-03-13 10:11:45,920 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742136_1312
2015-03-13 10:11:45,921 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742132_1308
2015-03-13 10:11:45,986 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:11:45,993 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:11:46,021 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60696 to replicate blk_1073742135_1311 to datanode(s) 127.0.0.1:60689
2015-03-13 10:11:46,021 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073742114_1290, blk_1073742130_1306, blk_1073742117_1293, blk_1073742118_1294, blk_1073742122_1298, blk_1073742123_1299, blk_1073742125_1301]
2015-03-13 10:11:46,021 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073742113_1289, blk_1073742114_1290, blk_1073742116_1292, blk_1073742117_1293, blk_1073742118_1294, blk_1073742122_1298, blk_1073742123_1299, blk_1073742124_1300, blk_1073742125_1301, blk_1073742126_1302]
2015-03-13 10:11:46,050 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63038, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_2132822748_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742137_1313, duration: 154000
2015-03-13 10:11:46,071 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:46,607 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742130_1306 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742130 for deletion
2015-03-13 10:11:46,607 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742114_1290 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742114 for deletion
2015-03-13 10:11:46,607 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742117_1293 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742117 for deletion
2015-03-13 10:11:46,607 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742118_1294 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742118 for deletion
2015-03-13 10:11:46,607 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742130_1306 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742130
2015-03-13 10:11:46,607 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742122_1298 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742122 for deletion
2015-03-13 10:11:46,607 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742123_1299 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742123 for deletion
2015-03-13 10:11:46,607 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742117_1293 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742117
2015-03-13 10:11:46,607 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742125_1301 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742125 for deletion
2015-03-13 10:11:46,607 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742114_1290 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742114
2015-03-13 10:11:46,607 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742122_1298 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742122
2015-03-13 10:11:46,608 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742118_1294 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742118
2015-03-13 10:11:46,608 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742123_1299 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742123
2015-03-13 10:11:46,608 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742125_1301 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742125
2015-03-13 10:11:46,647 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:46,841 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0026_000001 (auth:SIMPLE)
2015-03-13 10:11:46,842 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0026_000001
2015-03-13 10:11:46,842 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi	IP=10.1.1.144	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1426266260362_0026	APPATTEMPTID=appattempt_1426266260362_0026_000001
2015-03-13 10:11:46,842 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0026_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:11:46,842 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0026 State change from ACCEPTED to RUNNING
2015-03-13 10:11:46,863 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job_1426266260362_0026_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:46,865 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:11:46,922 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job_1426266260362_0026_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:46,995 INFO  datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-318492837-10.1.1.144-60696-1426266259571, infoPort=60697, ipcPort=60698, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073742135_1311 to 127.0.0.1:60689 
2015-03-13 10:11:46,995 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742113_1289 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742113 for deletion
2015-03-13 10:11:46,995 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742114_1290 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742114 for deletion
2015-03-13 10:11:46,996 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742116_1292 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742116 for deletion
2015-03-13 10:11:46,996 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742117_1293 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742117 for deletion
2015-03-13 10:11:46,996 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742113_1289 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742113
2015-03-13 10:11:46,996 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742118_1294 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742118 for deletion
2015-03-13 10:11:46,996 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742122_1298 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742122 for deletion
2015-03-13 10:11:46,996 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742123_1299 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742123 for deletion
2015-03-13 10:11:46,996 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742124_1300 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742124 for deletion
2015-03-13 10:11:46,996 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742125_1301 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742125 for deletion
2015-03-13 10:11:46,996 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742126_1302 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742126 for deletion
2015-03-13 10:11:46,996 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742116_1292 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742116
2015-03-13 10:11:46,996 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742114_1290 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742114
2015-03-13 10:11:46,997 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742118_1294 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742118
2015-03-13 10:11:46,997 INFO  datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073742135_1311 (numBytes=254067) to /127.0.0.1:60689
2015-03-13 10:11:46,997 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742117_1293 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742117
2015-03-13 10:11:46,997 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742122_1298 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742122
2015-03-13 10:11:46,997 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742123_1299 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742123
2015-03-13 10:11:46,997 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742124_1300 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742124
2015-03-13 10:11:46,997 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742125_1301 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742125
2015-03-13 10:11:46,998 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742126_1302 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742126
2015-03-13 10:11:46,997 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742135_1311 src: /127.0.0.1:63044 dest: /127.0.0.1:60689
2015-03-13 10:11:46,999 INFO  datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073742135_1311 src: /127.0.0.1:63044 dest: /127.0.0.1:60689 of size 254067
2015-03-13 10:11:47,000 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742135_1311 size 254067
2015-03-13 10:11:47,051 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job_1426266260362_0026_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742139_1315{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:11:47,075 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:47,086 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742139_1315 src: /127.0.0.1:63045 dest: /127.0.0.1:60686
2015-03-13 10:11:47,088 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742139_1315 src: /127.0.0.1:63046 dest: /127.0.0.1:60689
2015-03-13 10:11:47,089 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742139_1315 src: /127.0.0.1:63047 dest: /127.0.0.1:60696
2015-03-13 10:11:47,097 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63047, dest: /127.0.0.1:60696, bytes: 90606, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2132822748_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742139_1315, duration: 5713000
2015-03-13 10:11:47,097 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742139_1315, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:47,098 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63046, dest: /127.0.0.1:60689, bytes: 90606, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2132822748_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742139_1315, duration: 6508000
2015-03-13 10:11:47,098 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742139_1315, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:47,098 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742139_1315{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:47,099 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63045, dest: /127.0.0.1:60686, bytes: 90606, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2132822748_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742139_1315, duration: 8103000
2015-03-13 10:11:47,100 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742139_1315, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:47,101 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742139_1315{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:47,101 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742139_1315{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:47,105 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job_1426266260362_0026_1_conf.xml is closed by DFSClient_NONMAPREDUCE_2132822748_1
2015-03-13 10:11:47,652 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:48,077 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:48,078 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0026_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:11:48,078 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0026	CONTAINERID=container_1426266260362_0026_01_000002
2015-03-13 10:11:48,079 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0026_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:11:48,079 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0026 container=Container: [ContainerId: container_1426266260362_0026_01_000002, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0026_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:48,079 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:11:48,079 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:48,080 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0026_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:11:48,080 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0026	CONTAINERID=container_1426266260362_0026_01_000003
2015-03-13 10:11:48,080 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0026_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available
2015-03-13 10:11:48,080 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0026 container=Container: [ContainerId: container_1426266260362_0026_01_000003, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0026_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:48,080 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:11:48,081 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:48,091 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0026_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:11:48,091 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0026	CONTAINERID=container_1426266260362_0026_01_000004
2015-03-13 10:11:48,091 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0026_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:11:48,091 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0026 container=Container: [ContainerId: container_1426266260362_0026_01_000004, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0026_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:48,091 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:11:48,092 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:48,092 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0026_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:11:48,092 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0026	CONTAINERID=container_1426266260362_0026_01_000005
2015-03-13 10:11:48,092 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0026_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:11:48,092 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0026 container=Container: [ContainerId: container_1426266260362_0026_01_000005, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0026_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:48,093 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:11:48,093 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:48,093 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0026_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:11:48,093 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0026	CONTAINERID=container_1426266260362_0026_01_000006
2015-03-13 10:11:48,093 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0026_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:11:48,093 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0026 container=Container: [ContainerId: container_1426266260362_0026_01_000006, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0026_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:48,094 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7
2015-03-13 10:11:48,094 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:48,393 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0025_01_000001 succeeded 
2015-03-13 10:11:48,393 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:11:48,393 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0025_01_000001
2015-03-13 10:11:48,400 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000001
2015-03-13 10:11:48,400 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000001
2015-03-13 10:11:48,400 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000001
2015-03-13 10:11:48,400 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000001
2015-03-13 10:11:48,400 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0025	CONTAINERID=container_1426266260362_0025_01_000001
2015-03-13 10:11:48,400 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:11:48,401 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0025_01_000001 from application application_1426266260362_0025
2015-03-13 10:11:48,401 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:48,401 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0025
2015-03-13 10:11:48,657 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:48,874 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0026_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:11:48,874 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0026_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:11:48,875 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0026_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:11:48,875 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0026_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:11:48,875 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0026_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:11:48,901 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.jar	dst=null	perm=null
2015-03-13 10:11:48,902 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.jar	dst=null	perm=null
2015-03-13 10:11:48,911 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.xml	dst=null	perm=null
2015-03-13 10:11:48,912 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.xml	dst=null	perm=null
2015-03-13 10:11:48,914 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:11:48,915 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:11:48,935 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:11:48,938 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:11:48,940 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:11:48,941 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:11:48,997 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0026_000001 (auth:SIMPLE)
2015-03-13 10:11:48,997 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0026_000001 (auth:SIMPLE)
2015-03-13 10:11:49,000 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0026_01_000004 by user soberoi
2015-03-13 10:11:49,001 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0026_01_000003 by user soberoi
2015-03-13 10:11:49,001 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0026
2015-03-13 10:11:49,001 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0026	CONTAINERID=container_1426266260362_0026_01_000003
2015-03-13 10:11:49,001 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0026
2015-03-13 10:11:49,001 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0026	CONTAINERID=container_1426266260362_0026_01_000004
2015-03-13 10:11:49,001 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0026_01_000002 by user soberoi
2015-03-13 10:11:49,002 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0026_01_000006 by user soberoi
2015-03-13 10:11:49,002 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0026	CONTAINERID=container_1426266260362_0026_01_000002
2015-03-13 10:11:49,002 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0026	CONTAINERID=container_1426266260362_0026_01_000006
2015-03-13 10:11:49,001 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0026_01_000005 by user soberoi
2015-03-13 10:11:49,002 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0026 transitioned from NEW to INITING
2015-03-13 10:11:49,002 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0026	CONTAINERID=container_1426266260362_0026_01_000005
2015-03-13 10:11:49,002 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0026 transitioned from NEW to INITING
2015-03-13 10:11:49,002 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0026_01_000003 to application application_1426266260362_0026
2015-03-13 10:11:49,002 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0026_01_000002 to application application_1426266260362_0026
2015-03-13 10:11:49,003 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0026 transitioned from INITING to RUNNING
2015-03-13 10:11:49,003 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:11:49,003 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:11:49,003 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0026
2015-03-13 10:11:49,003 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0026
2015-03-13 10:11:49,003 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:11:49,003 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0026
2015-03-13 10:11:49,003 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:11:49,003 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:11:49,004 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0026
2015-03-13 10:11:49,004 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0026
2015-03-13 10:11:49,004 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:11:49,004 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0026
2015-03-13 10:11:49,002 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0026_01_000004 to application application_1426266260362_0026
2015-03-13 10:11:49,004 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0026_01_000006 to application application_1426266260362_0026
2015-03-13 10:11:49,004 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0026_01_000002
2015-03-13 10:11:49,004 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0026_01_000005 to application application_1426266260362_0026
2015-03-13 10:11:49,005 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0026 transitioned from INITING to RUNNING
2015-03-13 10:11:49,005 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0026_01_000003
2015-03-13 10:11:49,005 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:11:49,005 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:11:49,005 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:11:49,005 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0026
2015-03-13 10:11:49,005 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0026
2015-03-13 10:11:49,005 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:11:49,005 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0026
2015-03-13 10:11:49,005 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:11:49,006 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:11:49,006 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0026
2015-03-13 10:11:49,006 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0026
2015-03-13 10:11:49,006 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:11:49,006 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0026
2015-03-13 10:11:49,006 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0026
2015-03-13 10:11:49,006 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0026
2015-03-13 10:11:49,006 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:11:49,006 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0026
2015-03-13 10:11:49,006 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0026_01_000006
2015-03-13 10:11:49,008 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0026_01_000004
2015-03-13 10:11:49,008 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0026_01_000005
2015-03-13 10:11:49,022 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073742113_1289, blk_1073742130_1306, blk_1073742116_1292, blk_1073742118_1294, blk_1073742122_1298, blk_1073742123_1299, blk_1073742124_1300, blk_1073742125_1301, blk_1073742126_1302]
2015-03-13 10:11:49,022 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073742113_1289, blk_1073742114_1290, blk_1073742130_1306, blk_1073742116_1292, blk_1073742117_1293, blk_1073742122_1298, blk_1073742123_1299, blk_1073742124_1300, blk_1073742126_1302]
2015-03-13 10:11:49,030 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426266260362_0026_01_000002.tokens. Credentials list: 
2015-03-13 10:11:49,030 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1426266260362_0026_01_000006.tokens. Credentials list: 
2015-03-13 10:11:49,031 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426266260362_0026_01_000005.tokens. Credentials list: 
2015-03-13 10:11:49,031 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426266260362_0026_01_000003.tokens. Credentials list: 
2015-03-13 10:11:49,031 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426266260362_0026_01_000004.tokens. Credentials list: 
2015-03-13 10:11:49,047 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:11:49,048 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:11:49,082 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:11:49,082 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0025_01_000001
2015-03-13 10:11:49,082 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:49,082 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:49,083 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0026_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:11:49,083 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0026_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:11:49,083 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0025_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:11:49,083 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0025_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:11:49,083 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0025	CONTAINERID=container_1426266260362_0025_01_000001
2015-03-13 10:11:49,083 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0025_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60723, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:11:49,083 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:7168, vCores:6> numContainers=6 user=soberoi user-resources=<memory:7168, vCores:6>
2015-03-13 10:11:49,084 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0025_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:49,084 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:49,084 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6
2015-03-13 10:11:49,084 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0025_000001 released container container_1426266260362_0025_01_000001 on node: host: 10.1.1.144:60723 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:11:49,083 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0025_000001
2015-03-13 10:11:49,084 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0025_000001 State change from FINISHING to FINISHED
2015-03-13 10:11:49,084 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0025 State change from FINISHING to FINISHED
2015-03-13 10:11:49,084 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1426266260362_0025
2015-03-13 10:11:49,084 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0025,name=[716001CDD2B94A3FADE59C5DF8875A2D/9FD5B5C1ECE64C749C8E187DBF5C6990] upper2*lower*upper1/(1/2) ...orm/joinaroundjoinswapped,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0025/jobhistory/job/job_1426266260362_0025,appMasterHost=Edinburgh.local,startTime=1426266686752,finishTime=1426266702257,finalStatus=SUCCEEDED
2015-03-13 10:11:49,085 INFO  capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0025_000001 is done. finalState=FINISHED
2015-03-13 10:11:49,085 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0025 requests cleared
2015-03-13 10:11:49,085 INFO  capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0025 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:11:49,085 INFO  capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0025 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:11:49,085 INFO  amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0025_000001
2015-03-13 10:11:49,088 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0025_000001 (auth:SIMPLE)
2015-03-13 10:11:49,089 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0025_01_000001
2015-03-13 10:11:49,091 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:49,092 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:49,092 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:49,092 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0025 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:11:49,092 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0026_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:11:49,092 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0026_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:11:49,092 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0026_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:11:49,093 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0025
2015-03-13 10:11:49,093 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0025 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:11:49,093 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0025, with delay of 10800 seconds
2015-03-13 10:11:49,093 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0025
2015-03-13 10:11:49,093 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0025
2015-03-13 10:11:49,093 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0025
2015-03-13 10:11:49,092 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0025
2015-03-13 10:11:49,097 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0025 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:11:49,097 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0025
2015-03-13 10:11:49,097 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0025
2015-03-13 10:11:49,097 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0025 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:11:49,097 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0025, with delay of 10800 seconds
2015-03-13 10:11:49,097 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0025
2015-03-13 10:11:49,098 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0025
2015-03-13 10:11:49,098 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0025
2015-03-13 10:11:49,134 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1426266260362_0026_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000006.tokens
2015-03-13 10:11:49,134 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426266260362_0026_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000002.tokens
2015-03-13 10:11:49,135 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0026 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0026
2015-03-13 10:11:49,135 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0026 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0026
2015-03-13 10:11:49,206 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.jar	dst=null	perm=null
2015-03-13 10:11:49,207 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.jar	dst=null	perm=null
2015-03-13 10:11:49,208 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.jar	dst=null	perm=null
2015-03-13 10:11:49,208 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.jar	dst=null	perm=null
2015-03-13 10:11:49,209 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.jar	dst=null	perm=null
2015-03-13 10:11:49,209 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.jar	dst=null	perm=null
2015-03-13 10:11:49,216 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63056, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1632195503_13967, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742135_1311, duration: 362000
2015-03-13 10:11:49,216 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63055, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-2042911970_13966, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742135_1311, duration: 553000
2015-03-13 10:11:49,238 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:11:49,238 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:11:49,257 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.xml	dst=null	perm=null
2015-03-13 10:11:49,257 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.xml	dst=null	perm=null
2015-03-13 10:11:49,257 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.xml	dst=null	perm=null
2015-03-13 10:11:49,257 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.xml	dst=null	perm=null
2015-03-13 10:11:49,258 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.xml	dst=null	perm=null
2015-03-13 10:11:49,258 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.xml	dst=null	perm=null
2015-03-13 10:11:49,266 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63057, bytes: 98662, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-2042911970_13966, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742138_1314, duration: 261000
2015-03-13 10:11:49,266 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63058, bytes: 98662, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1632195503_13967, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742138_1314, duration: 281000
2015-03-13 10:11:49,280 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:11:49,280 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:11:49,280 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:11:49,280 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:11:49,281 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:11:49,281 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:11:49,281 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:11:49,341 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:11:49,341 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:49,341 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:11:49,341 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:49,342 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:11:49,342 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:49,342 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:11:49,342 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:49,343 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:11:49,343 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:49,491 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000004/default_container_executor.sh]
2015-03-13 10:11:49,496 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000003/default_container_executor.sh]
2015-03-13 10:11:49,504 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000005/default_container_executor.sh]
2015-03-13 10:11:49,505 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000002/default_container_executor.sh]
2015-03-13 10:11:49,505 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000006/default_container_executor.sh]
2015-03-13 10:11:49,568 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742139_1315
2015-03-13 10:11:49,610 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742113_1289 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742113 for deletion
2015-03-13 10:11:49,610 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742130_1306 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742130 for deletion
2015-03-13 10:11:49,610 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742114_1290 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742114 for deletion
2015-03-13 10:11:49,611 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742116_1292 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742116 for deletion
2015-03-13 10:11:49,611 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742117_1293 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742117 for deletion
2015-03-13 10:11:49,611 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742113_1289 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742113
2015-03-13 10:11:49,611 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742122_1298 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742122 for deletion
2015-03-13 10:11:49,611 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742123_1299 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742123 for deletion
2015-03-13 10:11:49,611 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742124_1300 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742124 for deletion
2015-03-13 10:11:49,611 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742114_1290 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742114
2015-03-13 10:11:49,611 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742126_1302 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742126 for deletion
2015-03-13 10:11:49,611 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742117_1293 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742117
2015-03-13 10:11:49,611 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742130_1306 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742130
2015-03-13 10:11:49,611 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742122_1298 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742122
2015-03-13 10:11:49,612 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742116_1292 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742116
2015-03-13 10:11:49,612 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742124_1300 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742124
2015-03-13 10:11:49,612 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742123_1299 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742123
2015-03-13 10:11:49,612 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742126_1302 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742126
2015-03-13 10:11:49,659 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:49,770 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742135_1311
2015-03-13 10:11:49,817 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742113_1289 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742113 for deletion
2015-03-13 10:11:49,817 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742130_1306 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742130 for deletion
2015-03-13 10:11:49,817 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742116_1292 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742116 for deletion
2015-03-13 10:11:49,817 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742118_1294 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742118 for deletion
2015-03-13 10:11:49,817 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742122_1298 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742122 for deletion
2015-03-13 10:11:49,817 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742113_1289 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742113
2015-03-13 10:11:49,817 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742130_1306 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742130
2015-03-13 10:11:49,817 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742123_1299 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742123 for deletion
2015-03-13 10:11:49,818 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742124_1300 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742124 for deletion
2015-03-13 10:11:49,818 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742118_1294 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742118
2015-03-13 10:11:49,818 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742116_1292 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742116
2015-03-13 10:11:49,818 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742125_1301 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742125 for deletion
2015-03-13 10:11:49,818 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742126_1302 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742126 for deletion
2015-03-13 10:11:49,818 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742123_1299 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742123
2015-03-13 10:11:49,818 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742122_1298 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742122
2015-03-13 10:11:49,818 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742125_1301 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742125
2015-03-13 10:11:49,818 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742126_1302 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742126
2015-03-13 10:11:49,818 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742124_1300 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742124
2015-03-13 10:11:49,888 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:11:50,085 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:50,085 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:50,085 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0025 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:11:50,086 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0025
2015-03-13 10:11:50,086 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0025
2015-03-13 10:11:50,086 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0025
2015-03-13 10:11:50,086 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0025
2015-03-13 10:11:50,086 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0025 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:11:50,086 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0025, with delay of 10800 seconds
2015-03-13 10:11:50,086 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0025
2015-03-13 10:11:50,094 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:50,094 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:50,094 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:50,309 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:11:50,310 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:11:50,421 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426266260362_0026_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000003.tokens
2015-03-13 10:11:50,421 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0026 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0026
2015-03-13 10:11:50,422 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426266260362_0026_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000004.tokens
2015-03-13 10:11:50,422 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0026 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0026
2015-03-13 10:11:50,522 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742139_1315
2015-03-13 10:11:50,524 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:11:50,663 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:50,668 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426266260362_0026_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000005.tokens
2015-03-13 10:11:50,668 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0026 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0026
2015-03-13 10:11:50,926 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742139_1315
2015-03-13 10:11:51,090 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:51,091 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:51,096 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:51,096 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:51,096 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:51,667 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:52,093 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:52,093 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:52,100 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:52,100 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:52,100 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:52,668 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:53,099 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:53,099 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:53,103 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:53,103 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:53,103 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:53,670 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:54,103 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:54,103 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:54,109 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:54,109 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:54,109 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:54,672 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:55,106 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:55,107 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:55,112 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:55,112 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:55,112 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:55,675 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:56,111 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:56,111 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:56,117 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:56,117 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:56,117 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:56,680 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:57,116 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:57,116 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:57,122 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:57,123 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:57,123 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:57,637 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.split	dst=null	perm=null
2015-03-13 10:11:57,657 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.split	dst=null	perm=null
2015-03-13 10:11:57,659 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.split	dst=null	perm=null
2015-03-13 10:11:57,677 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.split	dst=null	perm=null
2015-03-13 10:11:57,682 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:57,808 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.split	dst=null	perm=null
2015-03-13 10:11:57,848 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63071, bytes: 1282, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0026_m_000002_0_-806430223_1, offset: 512, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742136_1312, duration: 167000
2015-03-13 10:11:57,857 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63072, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0026_m_000001_0_-1838224352_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742136_1312, duration: 148000
2015-03-13 10:11:57,874 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63074, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0026_m_000004_0_154616194_1, offset: 1024, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742136_1312, duration: 147000
2015-03-13 10:11:57,874 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63075, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0026_m_000003_0_1152914215_1, offset: 1024, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742136_1312, duration: 120000
2015-03-13 10:11:57,955 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63076, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0026_m_000000_0_928189797_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742136_1312, duration: 147000
2015-03-13 10:11:57,986 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:11:57,987 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:11:57,991 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63072, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0026_m_000001_0_-1838224352_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 168000
2015-03-13 10:11:57,994 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63077, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0026_m_000002_0_-806430223_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 164000
2015-03-13 10:11:57,994 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:11:57,999 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63078, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0026_m_000003_0_1152914215_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 147000
2015-03-13 10:11:58,009 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:11:58,013 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63079, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0026_m_000004_0_154616194_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 145000
2015-03-13 10:11:58,059 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:11:58,121 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:58,121 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:58,126 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:58,126 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:58,127 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:58,480 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/_temporary/1/_temporary/attempt_1426266260362_0026_m_000002_0	dst=null	perm=null
2015-03-13 10:11:58,490 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/_temporary/1/_temporary/attempt_1426266260362_0026_m_000003_0	dst=null	perm=null
2015-03-13 10:11:58,497 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/_temporary/1/_temporary/attempt_1426266260362_0026_m_000001_0	dst=null	perm=null
2015-03-13 10:11:58,512 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0026_01_000004
2015-03-13 10:11:58,512 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0026_01_000005
2015-03-13 10:11:58,513 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:11:58,512 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0026	CONTAINERID=container_1426266260362_0026_01_000004
2015-03-13 10:11:58,513 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0026_01_000004
2015-03-13 10:11:58,513 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0026	CONTAINERID=container_1426266260362_0026_01_000005
2015-03-13 10:11:58,513 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:11:58,513 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:58,513 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:58,526 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0026_01_000004 is : 143
2015-03-13 10:11:58,529 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job_1426266260362_0026_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073742140_1316{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:11:58,531 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742140_1316 src: /127.0.0.1:63080 dest: /127.0.0.1:60693
2015-03-13 10:11:58,533 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742140_1316 src: /127.0.0.1:63081 dest: /127.0.0.1:60686
2015-03-13 10:11:58,534 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742140_1316 src: /127.0.0.1:63082 dest: /127.0.0.1:60696
2015-03-13 10:11:58,539 INFO  hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job_1426266260362_0026_1.jhist for DFSClient_NONMAPREDUCE_2132822748_1
2015-03-13 10:11:58,540 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:11:58,541 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:11:58,541 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0026_01_000005
2015-03-13 10:11:58,554 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0026_01_000005 is : 143
2015-03-13 10:11:58,556 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/_temporary/1/_temporary/attempt_1426266260362_0026_m_000004_0	dst=null	perm=null
2015-03-13 10:11:58,566 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000004
2015-03-13 10:11:58,566 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000004
2015-03-13 10:11:58,567 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000004
2015-03-13 10:11:58,567 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000004
2015-03-13 10:11:58,567 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:11:58,567 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0026	CONTAINERID=container_1426266260362_0026_01_000004
2015-03-13 10:11:58,567 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:11:58,567 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000005
2015-03-13 10:11:58,568 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000005
2015-03-13 10:11:58,568 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000005
2015-03-13 10:11:58,568 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000005
2015-03-13 10:11:58,567 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0026_01_000004 from application application_1426266260362_0026
2015-03-13 10:11:58,568 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:58,568 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0026
2015-03-13 10:11:58,568 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0026	CONTAINERID=container_1426266260362_0026_01_000005
2015-03-13 10:11:58,568 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:11:58,568 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0026_01_000005 from application application_1426266260362_0026
2015-03-13 10:11:58,569 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:58,569 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0026
2015-03-13 10:11:58,575 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0026_01_000003
2015-03-13 10:11:58,575 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0026	CONTAINERID=container_1426266260362_0026_01_000003
2015-03-13 10:11:58,575 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:11:58,575 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0026_01_000003
2015-03-13 10:11:58,576 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:58,576 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:11:58,579 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0026_01_000006
2015-03-13 10:11:58,580 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0026	CONTAINERID=container_1426266260362_0026_01_000006
2015-03-13 10:11:58,580 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:11:58,580 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0026_01_000006
2015-03-13 10:11:58,580 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:11:58,580 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0026_01_000004
2015-03-13 10:11:58,581 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:11:58,581 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0026_01_000005
2015-03-13 10:11:58,581 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:11:58,581 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0026_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:11:58,582 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0026_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:11:58,582 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0026	CONTAINERID=container_1426266260362_0026_01_000004
2015-03-13 10:11:58,582 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0026_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:11:58,582 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:11:58,582 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0026_01_000004, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:58,582 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:58,582 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:11:58,582 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0026_000001 released container container_1426266260362_0026_01_000004 on node: host: 10.1.1.144:60715 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:11:58,582 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0026_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:11:58,582 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0026_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:11:58,582 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0026	CONTAINERID=container_1426266260362_0026_01_000005
2015-03-13 10:11:58,583 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0026_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:11:58,583 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:11:58,583 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0026_01_000005, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:58,583 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:58,583 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:11:58,583 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0026_000001 released container container_1426266260362_0026_01_000005 on node: host: 10.1.1.144:60715 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:11:58,591 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0026_01_000003 is : 143
2015-03-13 10:11:58,595 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0026_01_000006 is : 143
2015-03-13 10:11:58,603 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:11:58,603 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000006
2015-03-13 10:11:58,604 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0026	CONTAINERID=container_1426266260362_0026_01_000006
2015-03-13 10:11:58,604 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:11:58,604 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:11:58,604 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000006
2015-03-13 10:11:58,604 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000006
2015-03-13 10:11:58,604 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0026	CONTAINERID=container_1426266260362_0026_01_000003
2015-03-13 10:11:58,605 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:11:58,605 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0026_01_000003 from application application_1426266260362_0026
2015-03-13 10:11:58,605 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:58,605 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0026
2015-03-13 10:11:58,604 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0026_01_000006 from application application_1426266260362_0026
2015-03-13 10:11:58,605 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:58,605 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0026
2015-03-13 10:11:58,604 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000006
2015-03-13 10:11:58,605 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000003
2015-03-13 10:11:58,606 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000003
2015-03-13 10:11:58,605 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000003
2015-03-13 10:11:58,605 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000003
2015-03-13 10:11:58,622 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63083, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0026_m_000000_0_928189797_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 160000
2015-03-13 10:11:58,646 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/_temporary/1/_temporary/attempt_1426266260362_0026_m_000000_0	dst=null	perm=null
2015-03-13 10:11:58,667 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0026_01_000002
2015-03-13 10:11:58,667 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0026	CONTAINERID=container_1426266260362_0026_01_000002
2015-03-13 10:11:58,667 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:11:58,667 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0026_01_000002
2015-03-13 10:11:58,667 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:11:58,667 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:11:58,668 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0026_01_000003
2015-03-13 10:11:58,668 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0026_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:11:58,668 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0026_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:11:58,668 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0026	CONTAINERID=container_1426266260362_0026_01_000003
2015-03-13 10:11:58,668 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0026_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:11:58,668 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:11:58,669 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0026_01_000003, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:58,669 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:58,669 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:11:58,669 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0026_000001 released container container_1426266260362_0026_01_000003 on node: host: 10.1.1.144:60723 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:11:58,679 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0026_01_000002 is : 143
2015-03-13 10:11:58,691 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:58,695 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:11:58,695 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000002
2015-03-13 10:11:58,695 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000002
2015-03-13 10:11:58,695 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000002
2015-03-13 10:11:58,695 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0026	CONTAINERID=container_1426266260362_0026_01_000002
2015-03-13 10:11:58,695 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000002
2015-03-13 10:11:58,695 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:11:58,696 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0026_01_000002 from application application_1426266260362_0026
2015-03-13 10:11:58,696 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:58,696 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0026
2015-03-13 10:11:59,583 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:11:59,583 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0026_01_000006
2015-03-13 10:11:59,583 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0026_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:11:59,584 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0026_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:11:59,584 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0026	CONTAINERID=container_1426266260362_0026_01_000006
2015-03-13 10:11:59,584 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0026_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:11:59,584 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:11:59,584 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0026_01_000006, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:59,584 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:59,584 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:11:59,585 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0026_000001 released container container_1426266260362_0026_01_000006 on node: host: 10.1.1.144:60715 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:11:59,671 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:11:59,671 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0026_01_000002
2015-03-13 10:11:59,672 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0026_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:11:59,672 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0026_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:11:59,672 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0026	CONTAINERID=container_1426266260362_0026_01_000002
2015-03-13 10:11:59,672 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0026_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:11:59,672 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:11:59,673 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0026_01_000002, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:59,673 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:59,673 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:11:59,673 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0026_000001 released container container_1426266260362_0026_01_000002 on node: host: 10.1.1.144:60723 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:11:59,693 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:00,133 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0026_01_000007 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:12:00,133 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0026	CONTAINERID=container_1426266260362_0026_01_000007
2015-03-13 10:12:00,133 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0026_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:12:00,133 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0026 container=Container: [ContainerId: container_1426266260362_0026_01_000007, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0026_01_000007 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:00,133 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:12:00,133 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:00,695 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:00,939 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0026_01_000007 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:12:00,950 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0026_000001 (auth:SIMPLE)
2015-03-13 10:12:00,951 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0026_01_000007 by user soberoi
2015-03-13 10:12:00,952 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0026
2015-03-13 10:12:00,952 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0026	CONTAINERID=container_1426266260362_0026_01_000007
2015-03-13 10:12:00,952 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0026 transitioned from NEW to INITING
2015-03-13 10:12:00,952 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0026_01_000007 to application application_1426266260362_0026
2015-03-13 10:12:00,952 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0026 transitioned from INITING to RUNNING
2015-03-13 10:12:00,952 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000007 transitioned from NEW to LOCALIZING
2015-03-13 10:12:00,952 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0026
2015-03-13 10:12:00,952 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0026
2015-03-13 10:12:00,952 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:12:00,953 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0026
2015-03-13 10:12:00,953 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:12:00,953 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:12:00,953 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0026_01_000007
2015-03-13 10:12:00,962 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426266260362_0026_01_000007.tokens. Credentials list: 
2015-03-13 10:12:00,977 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:12:01,041 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426266260362_0026_01_000007.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000007.tokens
2015-03-13 10:12:01,041 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0026 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0026
2015-03-13 10:12:01,096 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.jar	dst=null	perm=null
2015-03-13 10:12:01,097 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.jar	dst=null	perm=null
2015-03-13 10:12:01,097 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.jar	dst=null	perm=null
2015-03-13 10:12:01,104 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63087, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1926691887_14282, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742135_1311, duration: 445000
2015-03-13 10:12:01,122 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:12:01,133 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:01,134 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0026_01_000007 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:12:01,138 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.xml	dst=null	perm=null
2015-03-13 10:12:01,139 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.xml	dst=null	perm=null
2015-03-13 10:12:01,140 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.xml	dst=null	perm=null
2015-03-13 10:12:01,146 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63088, bytes: 98662, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1926691887_14282, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742138_1314, duration: 310000
2015-03-13 10:12:01,158 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:12:01,159 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000007 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:12:01,185 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000007 transitioned from LOCALIZED to RUNNING
2015-03-13 10:12:01,185 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:01,250 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000007/default_container_executor.sh]
2015-03-13 10:12:01,695 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:01,946 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:12:02,138 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:02,700 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:03,142 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:03,671 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/_temporary/1/_temporary/attempt_1426266260362_0026_r_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:03,699 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/_temporary/1/_temporary/attempt_1426266260362_0026_r_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073742141_1317{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:12:03,705 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:03,757 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742141_1317 src: /127.0.0.1:63093 dest: /127.0.0.1:60696
2015-03-13 10:12:03,758 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742141_1317 src: /127.0.0.1:63094 dest: /127.0.0.1:60693
2015-03-13 10:12:03,759 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742141_1317 src: /127.0.0.1:63095 dest: /127.0.0.1:60686
2015-03-13 10:12:03,772 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63095, dest: /127.0.0.1:60686, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0026_r_000000_0_929310349_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742141_1317, duration: 10769000
2015-03-13 10:12:03,772 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742141_1317, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:03,772 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63094, dest: /127.0.0.1:60693, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0026_r_000000_0_929310349_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742141_1317, duration: 11104000
2015-03-13 10:12:03,772 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742141_1317{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:12:03,773 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742141_1317, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:03,773 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742141_1317{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:12:03,773 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63093, dest: /127.0.0.1:60696, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0026_r_000000_0_929310349_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742141_1317, duration: 11770000
2015-03-13 10:12:03,773 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742141_1317, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:03,774 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742141_1317{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:12:03,776 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/_temporary/1/_temporary/attempt_1426266260362_0026_r_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0026_r_000000_0_929310349_1
2015-03-13 10:12:03,783 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/_temporary/1/_temporary/attempt_1426266260362_0026_r_000000_0	dst=null	perm=null
2015-03-13 10:12:03,789 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/_temporary/1/_temporary/attempt_1426266260362_0026_r_000000_0	dst=null	perm=null
2015-03-13 10:12:03,790 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/_temporary/1/task_1426266260362_0026_r_000000	dst=null	perm=null
2015-03-13 10:12:03,793 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/_temporary/1/_temporary/attempt_1426266260362_0026_r_000000_0	dst=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/_temporary/1/task_1426266260362_0026_r_000000	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:12:03,800 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0026_01_000007
2015-03-13 10:12:03,801 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0026	CONTAINERID=container_1426266260362_0026_01_000007
2015-03-13 10:12:03,801 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000007 transitioned from RUNNING to KILLING
2015-03-13 10:12:03,801 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0026_01_000007
2015-03-13 10:12:03,801 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:12:03,807 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:03,809 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_2132822748_1
2015-03-13 10:12:03,813 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0026_01_000007 is : 143
2015-03-13 10:12:03,814 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/_temporary/1	dst=null	perm=null
2015-03-13 10:12:03,820 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0	dst=null	perm=null
2015-03-13 10:12:03,822 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0	dst=null	perm=null
2015-03-13 10:12:03,822 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000007 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:12:03,823 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0026	CONTAINERID=container_1426266260362_0026_01_000007
2015-03-13 10:12:03,823 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000007 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:12:03,823 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0026_01_000007 from application application_1426266260362_0026
2015-03-13 10:12:03,823 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:03,823 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0026
2015-03-13 10:12:03,823 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000007
2015-03-13 10:12:03,823 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000007
2015-03-13 10:12:03,824 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000007
2015-03-13 10:12:03,824 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000007
2015-03-13 10:12:03,825 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/_temporary/1/task_1426266260362_0026_r_000000	dst=null	perm=null
2015-03-13 10:12:03,827 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/part-00000	dst=null	perm=null
2015-03-13 10:12:03,829 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/_temporary/1/task_1426266260362_0026_r_000000/part-00000	dst=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/part-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:03,834 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/_temporary	dst=null	perm=null
2015-03-13 10:12:03,837 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:03,839 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/_SUCCESS is closed by DFSClient_NONMAPREDUCE_2132822748_1
2015-03-13 10:12:03,840 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:03,842 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_2132822748_1
2015-03-13 10:12:03,855 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63082, dest: /127.0.0.1:60696, bytes: 63387, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2132822748_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742140_1316, duration: 5319467000
2015-03-13 10:12:03,855 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742140_1316, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:03,856 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742140_1316{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:03,857 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63081, dest: /127.0.0.1:60686, bytes: 63387, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2132822748_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742140_1316, duration: 5320199000
2015-03-13 10:12:03,857 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742140_1316, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:03,858 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742140_1316{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:03,858 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63080, dest: /127.0.0.1:60693, bytes: 63387, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2132822748_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742140_1316, duration: 5321683000
2015-03-13 10:12:03,858 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742140_1316, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:03,859 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742140_1316{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:03,860 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job_1426266260362_0026_1.jhist is closed by DFSClient_NONMAPREDUCE_2132822748_1
2015-03-13 10:12:03,862 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0026.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:03,864 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0026.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742142_1318{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:12:03,866 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742142_1318 src: /127.0.0.1:63096 dest: /127.0.0.1:60686
2015-03-13 10:12:03,867 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742142_1318 src: /127.0.0.1:63097 dest: /127.0.0.1:60696
2015-03-13 10:12:03,868 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742142_1318 src: /127.0.0.1:63098 dest: /127.0.0.1:60693
2015-03-13 10:12:03,871 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63098, dest: /127.0.0.1:60693, bytes: 426, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2132822748_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742142_1318, duration: 1233000
2015-03-13 10:12:03,871 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742142_1318, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:03,872 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742142_1318{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:03,872 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63097, dest: /127.0.0.1:60696, bytes: 426, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2132822748_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742142_1318, duration: 1696000
2015-03-13 10:12:03,872 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742142_1318, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:03,872 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742142_1318{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:03,873 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63096, dest: /127.0.0.1:60686, bytes: 426, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2132822748_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742142_1318, duration: 2533000
2015-03-13 10:12:03,873 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742142_1318, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:03,873 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742142_1318{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:03,875 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0026.summary_tmp is closed by DFSClient_NONMAPREDUCE_2132822748_1
2015-03-13 10:12:03,878 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0026.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:12:03,883 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job_1426266260362_0026_1.jhist	dst=null	perm=null
2015-03-13 10:12:03,884 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0026-1426266703493-soberoi-%5BD22FDB06DDD24032BF29C6EAE9E54D4B%2F116CA5A33C1047FA-1426266723843-5-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:12:03,887 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job_1426266260362_0026_1.jhist	dst=null	perm=null
2015-03-13 10:12:03,888 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0026-1426266703493-soberoi-%5BD22FDB06DDD24032BF29C6EAE9E54D4B%2F116CA5A33C1047FA-1426266723843-5-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:12:03,889 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job_1426266260362_0026_1.jhist	dst=null	perm=null
2015-03-13 10:12:03,892 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0026-1426266703493-soberoi-%5BD22FDB06DDD24032BF29C6EAE9E54D4B%2F116CA5A33C1047FA-1426266723843-5-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:03,897 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63099, bytes: 63883, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_2132822748_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742140_1316, duration: 212000
2015-03-13 10:12:03,899 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0026-1426266703493-soberoi-%5BD22FDB06DDD24032BF29C6EAE9E54D4B%2F116CA5A33C1047FA-1426266723843-5-1-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742143_1319{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:12:03,900 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742143_1319 src: /127.0.0.1:63100 dest: /127.0.0.1:60689
2015-03-13 10:12:03,902 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742143_1319 src: /127.0.0.1:63101 dest: /127.0.0.1:60693
2015-03-13 10:12:03,903 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742143_1319 src: /127.0.0.1:63102 dest: /127.0.0.1:60696
2015-03-13 10:12:03,906 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63102, dest: /127.0.0.1:60696, bytes: 63387, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2132822748_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742143_1319, duration: 2198000
2015-03-13 10:12:03,907 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742143_1319, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:03,907 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742143_1319{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:03,907 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63101, dest: /127.0.0.1:60693, bytes: 63387, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2132822748_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742143_1319, duration: 2532000
2015-03-13 10:12:03,907 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742143_1319, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:03,908 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742143_1319{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:03,908 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63100, dest: /127.0.0.1:60689, bytes: 63387, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2132822748_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742143_1319, duration: 3303000
2015-03-13 10:12:03,908 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742143_1319, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:03,908 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742143_1319{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:03,910 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0026-1426266703493-soberoi-%5BD22FDB06DDD24032BF29C6EAE9E54D4B%2F116CA5A33C1047FA-1426266723843-5-1-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_2132822748_1
2015-03-13 10:12:03,911 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0026-1426266703493-soberoi-%5BD22FDB06DDD24032BF29C6EAE9E54D4B%2F116CA5A33C1047FA-1426266723843-5-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:12:03,912 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job_1426266260362_0026_1_conf.xml	dst=null	perm=null
2015-03-13 10:12:03,914 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0026_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:12:03,915 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job_1426266260362_0026_1_conf.xml	dst=null	perm=null
2015-03-13 10:12:03,916 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0026_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:12:03,917 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job_1426266260362_0026_1_conf.xml	dst=null	perm=null
2015-03-13 10:12:03,919 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0026_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:03,922 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63099, bytes: 91314, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_2132822748_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742139_1315, duration: 310000
2015-03-13 10:12:03,924 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0026_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742144_1320{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:12:03,926 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742144_1320 src: /127.0.0.1:63103 dest: /127.0.0.1:60696
2015-03-13 10:12:03,927 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742144_1320 src: /127.0.0.1:63104 dest: /127.0.0.1:60686
2015-03-13 10:12:03,928 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742144_1320 src: /127.0.0.1:63105 dest: /127.0.0.1:60689
2015-03-13 10:12:03,932 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63105, dest: /127.0.0.1:60689, bytes: 90606, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2132822748_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742144_1320, duration: 1784000
2015-03-13 10:12:03,932 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742144_1320, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:03,932 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742144_1320{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:12:03,932 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63104, dest: /127.0.0.1:60686, bytes: 90606, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2132822748_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742144_1320, duration: 2482000
2015-03-13 10:12:03,933 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742144_1320, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:03,933 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742144_1320{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:12:03,933 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63103, dest: /127.0.0.1:60696, bytes: 90606, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2132822748_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742144_1320, duration: 3226000
2015-03-13 10:12:03,933 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742144_1320, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:03,934 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742144_1320{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:12:03,935 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0026_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_2132822748_1
2015-03-13 10:12:03,936 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0026_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:12:03,938 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0026.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0026.summary	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:12:03,939 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0026_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0026_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:12:03,941 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0026-1426266703493-soberoi-%5BD22FDB06DDD24032BF29C6EAE9E54D4B%2F116CA5A33C1047FA-1426266723843-5-1-SUCCEEDED-default.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0026-1426266703493-soberoi-%5BD22FDB06DDD24032BF29C6EAE9E54D4B%2F116CA5A33C1047FA-1426266723843-5-1-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:12:03,946 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0026_000001 State change from RUNNING to FINISHING
2015-03-13 10:12:03,946 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0026
2015-03-13 10:12:03,946 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0026 State change from RUNNING to REMOVING
2015-03-13 10:12:03,946 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0026
2015-03-13 10:12:03,946 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0026 State change from REMOVING to FINISHING
2015-03-13 10:12:04,710 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:04,779 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742143_1319
2015-03-13 10:12:04,780 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742144_1320
2015-03-13 10:12:04,802 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:12:04,802 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0026_01_000007
2015-03-13 10:12:04,802 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0026_01_000007 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:12:04,802 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0026_01_000007 in state: COMPLETED event:FINISHED
2015-03-13 10:12:04,803 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0026	CONTAINERID=container_1426266260362_0026_01_000007
2015-03-13 10:12:04,803 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0026_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:12:04,803 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:12:04,803 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0026_01_000007, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:04,803 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:04,803 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:12:04,804 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0026_000001 released container container_1426266260362_0026_01_000007 on node: host: 10.1.1.144:60719 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:12:04,958 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742135_1311 127.0.0.1:60686 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60689 
2015-03-13 10:12:04,958 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742136_1312 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60689 
2015-03-13 10:12:04,958 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742137_1313 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60696 
2015-03-13 10:12:04,958 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742138_1314 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60693 
2015-03-13 10:12:04,959 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742140_1316 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60696 
2015-03-13 10:12:04,959 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742139_1315 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60696 
2015-03-13 10:12:04,959 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026	dst=null	perm=null
2015-03-13 10:12:04,987 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (1/2) ...atform/joinfilteredbranch
2015-03-13 10:12:04,994 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:12:05,002 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:12:05,004 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch	dst=null	perm=null
2015-03-13 10:12:05,005 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:12:05,006 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:12:05,008 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 27
2015-03-13 10:12:05,010 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027	dst=null	perm=null
2015-03-13 10:12:05,011 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027	dst=null	perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:12:05,012 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027	dst=null	perm=soberoi:supergroup:rwx------
2015-03-13 10:12:05,013 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.jar	dst=null	perm=null
2015-03-13 10:12:05,014 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:05,015 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073742145_1321{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:12:05,017 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742145_1321 src: /127.0.0.1:63108 dest: /127.0.0.1:60686
2015-03-13 10:12:05,018 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742145_1321 src: /127.0.0.1:63109 dest: /127.0.0.1:60689
2015-03-13 10:12:05,019 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742145_1321 src: /127.0.0.1:63110 dest: /127.0.0.1:60696
2015-03-13 10:12:05,023 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63110, dest: /127.0.0.1:60696, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742145_1321, duration: 2607000
2015-03-13 10:12:05,023 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742145_1321, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:05,023 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742145_1321{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:05,023 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63109, dest: /127.0.0.1:60689, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742145_1321, duration: 2755000
2015-03-13 10:12:05,023 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742145_1321, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:05,024 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742145_1321{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:05,024 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63108, dest: /127.0.0.1:60686, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742145_1321, duration: 3542000
2015-03-13 10:12:05,024 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742145_1321, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:05,025 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742145_1321{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:05,025 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:12:05,026 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.jar
2015-03-13 10:12:05,026 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.jar	dst=null	perm=null
2015-03-13 10:12:05,027 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:05,028 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:12:05,029 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:12:05,030 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:12:05,031 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:12:05,031 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:12:05,032 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:12:05,033 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:12:05,033 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:12:05,034 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:12:05,035 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:12:05,035 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:12:05,036 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:12:05,037 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:05,038 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:05,039 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.split
2015-03-13 10:12:05,039 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.split	dst=null	perm=null
2015-03-13 10:12:05,040 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073742146_1322{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:12:05,041 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742146_1322 src: /127.0.0.1:63111 dest: /127.0.0.1:60686
2015-03-13 10:12:05,042 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742146_1322 src: /127.0.0.1:63112 dest: /127.0.0.1:60696
2015-03-13 10:12:05,043 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742146_1322 src: /127.0.0.1:63113 dest: /127.0.0.1:60693
2015-03-13 10:12:05,044 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742146_1322 src: /127.0.0.1:63114 dest: /127.0.0.1:60689
2015-03-13 10:12:05,047 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63114, dest: /127.0.0.1:60689, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742146_1322, duration: 1582000
2015-03-13 10:12:05,047 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742146_1322, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:05,047 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742146_1322{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:12:05,047 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63113, dest: /127.0.0.1:60693, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742146_1322, duration: 1797000
2015-03-13 10:12:05,048 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742146_1322, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:05,048 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742146_1322{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:12:05,048 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63112, dest: /127.0.0.1:60696, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742146_1322, duration: 2746000
2015-03-13 10:12:05,048 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742146_1322, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:05,049 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742146_1322{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:12:05,049 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63111, dest: /127.0.0.1:60686, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742146_1322, duration: 3109000
2015-03-13 10:12:05,049 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742146_1322, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:05,049 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742146_1322{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:12:05,051 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:12:05,052 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:05,053 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:05,054 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073742147_1323{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:12:05,055 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742147_1323 src: /127.0.0.1:63115 dest: /127.0.0.1:60689
2015-03-13 10:12:05,056 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742147_1323 src: /127.0.0.1:63116 dest: /127.0.0.1:60686
2015-03-13 10:12:05,057 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742147_1323 src: /127.0.0.1:63117 dest: /127.0.0.1:60693
2015-03-13 10:12:05,060 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63117, dest: /127.0.0.1:60693, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742147_1323, duration: 1173000
2015-03-13 10:12:05,060 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742147_1323, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:05,060 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742147_1323{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:05,060 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63116, dest: /127.0.0.1:60686, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742147_1323, duration: 1570000
2015-03-13 10:12:05,061 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742147_1323, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:05,061 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742147_1323{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:05,061 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63115, dest: /127.0.0.1:60689, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742147_1323, duration: 2564000
2015-03-13 10:12:05,061 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742147_1323, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:05,062 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742147_1323{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:05,063 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:12:05,063 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:12:05,066 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:05,067 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:05,068 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:12:05,069 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:12:05,069 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:12:05,074 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742148_1324{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:12:05,075 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742148_1324 src: /127.0.0.1:63118 dest: /127.0.0.1:60686
2015-03-13 10:12:05,076 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742148_1324 src: /127.0.0.1:63119 dest: /127.0.0.1:60693
2015-03-13 10:12:05,077 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742148_1324 src: /127.0.0.1:63120 dest: /127.0.0.1:60696
2015-03-13 10:12:05,080 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63120, dest: /127.0.0.1:60696, bytes: 98188, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742148_1324, duration: 1353000
2015-03-13 10:12:05,080 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742148_1324, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:05,080 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742148_1324{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:05,081 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63119, dest: /127.0.0.1:60693, bytes: 98188, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742148_1324, duration: 1762000
2015-03-13 10:12:05,081 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742148_1324, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:05,081 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742148_1324{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:05,081 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63118, dest: /127.0.0.1:60686, bytes: 98188, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742148_1324, duration: 2439000
2015-03-13 10:12:05,081 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742148_1324, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:05,082 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742148_1324{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:05,083 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:12:05,083 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0027
2015-03-13 10:12:05,083 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027	dst=null	perm=null
2015-03-13 10:12:05,084 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.xml	dst=null	perm=null
2015-03-13 10:12:05,084 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.xml	dst=null	perm=null
2015-03-13 10:12:05,085 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.jar	dst=null	perm=null
2015-03-13 10:12:05,085 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.jar	dst=null	perm=null
2015-03-13 10:12:05,086 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.split	dst=null	perm=null
2015-03-13 10:12:05,086 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.split	dst=null	perm=null
2015-03-13 10:12:05,087 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:12:05,087 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:12:05,089 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:12:05,089 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:12:05,090 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:12:05,090 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:12:05,091 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:12:05,091 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:12:05,092 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 27 submitted by user soberoi
2015-03-13 10:12:05,092 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0027
2015-03-13 10:12:05,092 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	IP=10.1.1.144	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1426266260362_0027
2015-03-13 10:12:05,092 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0027
2015-03-13 10:12:05,092 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0027 State change from NEW to NEW_SAVING
2015-03-13 10:12:05,093 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0027 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:12:05,093 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0027_000001
2015-03-13 10:12:05,093 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0027_000001 State change from NEW to SUBMITTED
2015-03-13 10:12:05,093 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0027 from user: soberoi activated in queue: default
2015-03-13 10:12:05,093 INFO  capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0027 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:12:05,093 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0027 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:12:05,093 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0027 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:12:05,093 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0027_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:12:05,094 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0027_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:12:05,095 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0027 State change from SUBMITTED to ACCEPTED
2015-03-13 10:12:05,095 INFO  mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0027/
2015-03-13 10:12:05,096 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1426266260362_0027
2015-03-13 10:12:05,096 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0027/
2015-03-13 10:12:05,389 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742141_1317
2015-03-13 10:12:05,390 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742147_1323
2015-03-13 10:12:05,391 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742140_1316
2015-03-13 10:12:05,391 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742142_1318
2015-03-13 10:12:05,391 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742146_1322
2015-03-13 10:12:05,392 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742148_1324
2015-03-13 10:12:05,392 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742143_1319
2015-03-13 10:12:05,534 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742146_1322
2015-03-13 10:12:05,535 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742147_1323
2015-03-13 10:12:05,536 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742145_1321
2015-03-13 10:12:05,537 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742142_1318
2015-03-13 10:12:05,537 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742148_1324
2015-03-13 10:12:05,602 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0027_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:12:05,602 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0027	CONTAINERID=container_1426266260362_0027_01_000001
2015-03-13 10:12:05,602 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0027_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:12:05,602 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0027 container=Container: [ContainerId: container_1426266260362_0027_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0027_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:05,602 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:12:05,603 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0027_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:12:05,603 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:05,604 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0027 AttemptId: appattempt_1426266260362_0027_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0027_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ]
2015-03-13 10:12:05,604 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0027_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:12:05,604 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0027_000001
2015-03-13 10:12:05,604 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0027_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:12:05,604 INFO  amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0027_000001
2015-03-13 10:12:05,605 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0027_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] for AM appattempt_1426266260362_0027_000001
2015-03-13 10:12:05,605 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0027_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-03-13 10:12:05,607 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0027_000001 (auth:SIMPLE)
2015-03-13 10:12:05,608 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0027_01_000001 by user soberoi
2015-03-13 10:12:05,608 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0027
2015-03-13 10:12:05,608 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0027	CONTAINERID=container_1426266260362_0027_01_000001
2015-03-13 10:12:05,609 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0027 transitioned from NEW to INITING
2015-03-13 10:12:05,609 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0027_01_000001 to application application_1426266260362_0027
2015-03-13 10:12:05,609 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0027 transitioned from INITING to RUNNING
2015-03-13 10:12:05,609 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0027_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] for AM appattempt_1426266260362_0027_000001
2015-03-13 10:12:05,609 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0027_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:12:05,609 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:12:05,609 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0027
2015-03-13 10:12:05,609 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:12:05,610 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:12:05,610 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:12:05,610 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:12:05,610 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0027_01_000001
2015-03-13 10:12:05,619 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426266260362_0027_01_000001.tokens. Credentials list: 
2015-03-13 10:12:05,634 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:12:05,701 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426266260362_0027_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000001.tokens
2015-03-13 10:12:05,701 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0027 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0027
2015-03-13 10:12:05,719 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:05,738 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742140_1316
2015-03-13 10:12:05,739 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742144_1320
2015-03-13 10:12:05,739 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742141_1317
2015-03-13 10:12:05,766 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.jar	dst=null	perm=null
2015-03-13 10:12:05,766 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.jar	dst=null	perm=null
2015-03-13 10:12:05,767 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.jar	dst=null	perm=null
2015-03-13 10:12:05,774 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63124, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-387356058_14425, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742145_1321, duration: 502000
2015-03-13 10:12:05,792 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:12:05,808 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:12:05,809 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:12:05,810 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:12:05,816 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63125, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-387356058_14425, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742147_1323, duration: 128000
2015-03-13 10:12:05,829 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:12:05,845 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.split	dst=null	perm=null
2015-03-13 10:12:05,845 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.split	dst=null	perm=null
2015-03-13 10:12:05,846 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.split	dst=null	perm=null
2015-03-13 10:12:05,852 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63126, bytes: 1798, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-387356058_14425, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742146_1322, duration: 189000
2015-03-13 10:12:05,865 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:12:05,881 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.xml	dst=null	perm=null
2015-03-13 10:12:05,882 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.xml	dst=null	perm=null
2015-03-13 10:12:05,882 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.xml	dst=null	perm=null
2015-03-13 10:12:05,888 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63126, bytes: 98956, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-387356058_14425, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742148_1324, duration: 306000
2015-03-13 10:12:05,900 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:12:05,900 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:12:05,926 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:12:05,926 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:05,938 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742146_1322
2015-03-13 10:12:05,939 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742144_1320
2015-03-13 10:12:05,995 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000001/default_container_executor.sh]
2015-03-13 10:12:06,140 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742145_1321
2015-03-13 10:12:06,140 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742140_1316
2015-03-13 10:12:06,141 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742143_1319
2015-03-13 10:12:06,141 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742141_1317
2015-03-13 10:12:06,142 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742142_1318
2015-03-13 10:12:06,340 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742148_1324
2015-03-13 10:12:06,603 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:06,603 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0027_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:12:06,720 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:07,043 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60689 to replicate blk_1073742145_1321 to datanode(s) 127.0.0.1:60693
2015-03-13 10:12:07,043 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073742135_1311, blk_1073742136_1312, blk_1073742137_1313, blk_1073742138_1314, blk_1073742139_1315, blk_1073742140_1316]
2015-03-13 10:12:07,044 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073742135_1311, blk_1073742136_1312, blk_1073742137_1313, blk_1073742138_1314, blk_1073742139_1315, blk_1073742140_1316]
2015-03-13 10:12:07,571 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:12:07,592 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/COMMIT_STARTED	dst=null	perm=null
2015-03-13 10:12:07,593 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/COMMIT_SUCCESS	dst=null	perm=null
2015-03-13 10:12:07,594 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/COMMIT_FAIL	dst=null	perm=null
2015-03-13 10:12:07,607 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:07,621 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742135_1311 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742135 for deletion
2015-03-13 10:12:07,621 INFO  datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-1172757413-10.1.1.144-60689-1426266259165, infoPort=60690, ipcPort=60692, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073742145_1321 to 127.0.0.1:60693 
2015-03-13 10:12:07,621 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742135_1311 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742135
2015-03-13 10:12:07,621 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742136_1312 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742136 for deletion
2015-03-13 10:12:07,621 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742137_1313 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742137 for deletion
2015-03-13 10:12:07,621 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742138_1314 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742138 for deletion
2015-03-13 10:12:07,621 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742139_1315 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742139 for deletion
2015-03-13 10:12:07,621 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742136_1312 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742136
2015-03-13 10:12:07,622 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742138_1314 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742138
2015-03-13 10:12:07,622 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742137_1313 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742137
2015-03-13 10:12:07,622 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742140_1316 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742140 for deletion
2015-03-13 10:12:07,622 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742139_1315 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742139
2015-03-13 10:12:07,622 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742140_1316 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742140
2015-03-13 10:12:07,623 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742145_1321 src: /127.0.0.1:63128 dest: /127.0.0.1:60693
2015-03-13 10:12:07,623 INFO  datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073742145_1321 (numBytes=254067) to /127.0.0.1:60693
2015-03-13 10:12:07,624 INFO  datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073742145_1321 src: /127.0.0.1:63128 dest: /127.0.0.1:60693 of size 254067
2015-03-13 10:12:07,625 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742145_1321 size 254067
2015-03-13 10:12:07,652 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027	dst=null	perm=null
2015-03-13 10:12:07,654 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:12:07,655 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:12:07,725 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:07,930 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:12:07,937 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:12:07,993 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63129, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-147161382_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742147_1323, duration: 131000
2015-03-13 10:12:08,011 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742135_1311 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742135 for deletion
2015-03-13 10:12:08,011 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742136_1312 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742136 for deletion
2015-03-13 10:12:08,011 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742137_1313 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742137 for deletion
2015-03-13 10:12:08,011 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742138_1314 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742138 for deletion
2015-03-13 10:12:08,011 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742136_1312 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742136
2015-03-13 10:12:08,012 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742139_1315 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742139 for deletion
2015-03-13 10:12:08,011 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742135_1311 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742135
2015-03-13 10:12:08,012 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742140_1316 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742140 for deletion
2015-03-13 10:12:08,012 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742138_1314 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742138
2015-03-13 10:12:08,012 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742137_1313 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742137
2015-03-13 10:12:08,012 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742140_1316 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742140
2015-03-13 10:12:08,012 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742139_1315 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742139
2015-03-13 10:12:08,612 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:08,726 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:08,768 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0027_000001 (auth:SIMPLE)
2015-03-13 10:12:08,769 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0027_000001
2015-03-13 10:12:08,769 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi	IP=10.1.1.144	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1426266260362_0027	APPATTEMPTID=appattempt_1426266260362_0027_000001
2015-03-13 10:12:08,770 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0027_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:12:08,770 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0027 State change from ACCEPTED to RUNNING
2015-03-13 10:12:08,792 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job_1426266260362_0027_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:08,795 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:12:08,865 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job_1426266260362_0027_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:08,977 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job_1426266260362_0027_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742149_1325{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:12:09,018 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742149_1325 src: /127.0.0.1:63135 dest: /127.0.0.1:60686
2015-03-13 10:12:09,019 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742149_1325 src: /127.0.0.1:63136 dest: /127.0.0.1:60696
2015-03-13 10:12:09,021 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742149_1325 src: /127.0.0.1:63137 dest: /127.0.0.1:60693
2015-03-13 10:12:09,030 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63137, dest: /127.0.0.1:60693, bytes: 90990, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-147161382_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742149_1325, duration: 6637000
2015-03-13 10:12:09,031 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742149_1325, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:09,031 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742149_1325{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:09,031 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63136, dest: /127.0.0.1:60696, bytes: 90990, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-147161382_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742149_1325, duration: 7479000
2015-03-13 10:12:09,032 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742149_1325, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:09,033 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742149_1325{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:09,033 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63135, dest: /127.0.0.1:60686, bytes: 90990, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-147161382_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742149_1325, duration: 9059000
2015-03-13 10:12:09,033 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742149_1325, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:09,034 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742149_1325{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:09,037 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job_1426266260362_0027_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-147161382_1
2015-03-13 10:12:09,617 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:09,731 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:09,785 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742146_1322
2015-03-13 10:12:09,786 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742145_1321
2015-03-13 10:12:09,786 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742147_1323
2015-03-13 10:12:09,820 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0027_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:12:09,820 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0027	CONTAINERID=container_1426266260362_0027_01_000002
2015-03-13 10:12:09,820 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0027_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:12:09,820 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0027 container=Container: [ContainerId: container_1426266260362_0027_01_000002, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0027_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:09,820 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:12:09,821 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:09,821 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0027_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:12:09,821 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0027	CONTAINERID=container_1426266260362_0027_01_000003
2015-03-13 10:12:09,821 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0027_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:12:09,822 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0027 container=Container: [ContainerId: container_1426266260362_0027_01_000003, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0027_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:09,822 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:12:09,822 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:09,823 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0027_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:12:09,823 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0027	CONTAINERID=container_1426266260362_0027_01_000004
2015-03-13 10:12:09,823 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0027_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:12:09,823 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0027 container=Container: [ContainerId: container_1426266260362_0027_01_000004, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0027_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:09,823 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:12:09,823 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:09,823 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0027_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:12:09,823 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0027	CONTAINERID=container_1426266260362_0027_01_000005
2015-03-13 10:12:09,823 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0027_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:12:09,824 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0027 container=Container: [ContainerId: container_1426266260362_0027_01_000005, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0027_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:09,824 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:12:09,824 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:10,049 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073742135_1311, blk_1073742136_1312, blk_1073742137_1313, blk_1073742138_1314, blk_1073742140_1316]
2015-03-13 10:12:10,050 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073742135_1311, blk_1073742136_1312, blk_1073742139_1315]
2015-03-13 10:12:10,090 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0026_01_000001 succeeded 
2015-03-13 10:12:10,090 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:12:10,090 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0026_01_000001
2015-03-13 10:12:10,097 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000001
2015-03-13 10:12:10,098 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000001
2015-03-13 10:12:10,098 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000001
2015-03-13 10:12:10,098 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000001
2015-03-13 10:12:10,098 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0026	CONTAINERID=container_1426266260362_0026_01_000001
2015-03-13 10:12:10,098 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:12:10,098 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0026_01_000001 from application application_1426266260362_0026
2015-03-13 10:12:10,098 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:10,098 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0026
2015-03-13 10:12:10,395 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742149_1325
2015-03-13 10:12:10,600 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742145_1321
2015-03-13 10:12:10,620 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:10,621 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0027_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:12:10,621 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0027	CONTAINERID=container_1426266260362_0027_01_000006
2015-03-13 10:12:10,622 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0027_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:12:10,622 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742135_1311 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742135 for deletion
2015-03-13 10:12:10,622 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0027 container=Container: [ContainerId: container_1426266260362_0027_01_000006, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0027_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:10,622 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742136_1312 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742136 for deletion
2015-03-13 10:12:10,622 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7
2015-03-13 10:12:10,622 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742139_1315 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742139 for deletion
2015-03-13 10:12:10,622 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742135_1311 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742135
2015-03-13 10:12:10,622 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:10,623 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742136_1312 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742136
2015-03-13 10:12:10,623 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742139_1315 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742139
2015-03-13 10:12:10,733 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:12:10,733 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0026_01_000001
2015-03-13 10:12:10,734 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0026_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:12:10,734 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0026_000001
2015-03-13 10:12:10,734 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0026_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:12:10,734 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0026	CONTAINERID=container_1426266260362_0026_01_000001
2015-03-13 10:12:10,734 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0026_000001 State change from FINISHING to FINISHED
2015-03-13 10:12:10,734 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0026_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60711, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:12:10,735 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0026 State change from FINISHING to FINISHED
2015-03-13 10:12:10,735 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:7168, vCores:6> numContainers=6 user=soberoi user-resources=<memory:7168, vCores:6>
2015-03-13 10:12:10,735 INFO  amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0026_000001
2015-03-13 10:12:10,735 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0026_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:10,735 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1426266260362_0026
2015-03-13 10:12:10,735 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:10,735 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0026,name=[D22FDB06DDD24032BF29C6EAE9E54D4B/116CA5A33C1047FAA2216FF3C2C5902D] lower*upper/(2/2),user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0026/jobhistory/job/job_1426266260362_0026,appMasterHost=Edinburgh.local,startTime=1426266703493,finishTime=1426266723946,finalStatus=SUCCEEDED
2015-03-13 10:12:10,735 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6
2015-03-13 10:12:10,736 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0026_000001 released container container_1426266260362_0026_01_000001 on node: host: 10.1.1.144:60711 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:12:10,736 INFO  capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0026_000001 is done. finalState=FINISHED
2015-03-13 10:12:10,736 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0026 requests cleared
2015-03-13 10:12:10,736 INFO  capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0026 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:12:10,736 INFO  capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0026 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:12:10,738 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0026_000001 (auth:SIMPLE)
2015-03-13 10:12:10,739 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0026_01_000001
2015-03-13 10:12:10,747 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742149_1325
2015-03-13 10:12:10,803 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0027_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:12:10,803 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0027_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:12:10,803 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0027_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:12:10,803 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0027_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:12:10,803 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0027_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:12:10,823 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0026 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:12:10,823 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0026
2015-03-13 10:12:10,823 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0026
2015-03-13 10:12:10,823 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0026
2015-03-13 10:12:10,824 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0026
2015-03-13 10:12:10,824 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0026
2015-03-13 10:12:10,824 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0026 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:12:10,824 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0026, with delay of 10800 seconds
2015-03-13 10:12:10,830 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.jar	dst=null	perm=null
2015-03-13 10:12:10,831 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.jar	dst=null	perm=null
2015-03-13 10:12:10,839 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.xml	dst=null	perm=null
2015-03-13 10:12:10,840 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742135_1311 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742135 for deletion
2015-03-13 10:12:10,840 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742136_1312 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742136 for deletion
2015-03-13 10:12:10,840 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742137_1313 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742137 for deletion
2015-03-13 10:12:10,840 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742138_1314 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742138 for deletion
2015-03-13 10:12:10,840 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742140_1316 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742140 for deletion
2015-03-13 10:12:10,840 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742135_1311 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742135
2015-03-13 10:12:10,840 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742136_1312 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742136
2015-03-13 10:12:10,840 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.xml	dst=null	perm=null
2015-03-13 10:12:10,841 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742137_1313 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742137
2015-03-13 10:12:10,841 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742138_1314 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742138
2015-03-13 10:12:10,841 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742140_1316 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742140
2015-03-13 10:12:10,843 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:12:10,844 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:12:10,848 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:12:10,850 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:12:10,852 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:12:10,853 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:12:10,929 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0027_000001 (auth:SIMPLE)
2015-03-13 10:12:10,929 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0027_000001 (auth:SIMPLE)
2015-03-13 10:12:10,932 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0027_01_000002 by user soberoi
2015-03-13 10:12:10,932 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0027
2015-03-13 10:12:10,932 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0027_01_000004 by user soberoi
2015-03-13 10:12:10,932 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0027	CONTAINERID=container_1426266260362_0027_01_000002
2015-03-13 10:12:10,933 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0027_01_000003 by user soberoi
2015-03-13 10:12:10,933 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0027_01_000005 by user soberoi
2015-03-13 10:12:10,933 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0027	CONTAINERID=container_1426266260362_0027_01_000003
2015-03-13 10:12:10,933 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0027	CONTAINERID=container_1426266260362_0027_01_000005
2015-03-13 10:12:10,932 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0027 transitioned from NEW to INITING
2015-03-13 10:12:10,934 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0027_01_000002 to application application_1426266260362_0027
2015-03-13 10:12:10,934 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0027_01_000004 to application application_1426266260362_0027
2015-03-13 10:12:10,934 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0027_01_000003 to application application_1426266260362_0027
2015-03-13 10:12:10,934 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0027_01_000005 to application application_1426266260362_0027
2015-03-13 10:12:10,934 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0027 transitioned from INITING to RUNNING
2015-03-13 10:12:10,932 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0027	CONTAINERID=container_1426266260362_0027_01_000004
2015-03-13 10:12:10,934 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:12:10,933 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0027_01_000006 by user soberoi
2015-03-13 10:12:10,935 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0027	CONTAINERID=container_1426266260362_0027_01_000006
2015-03-13 10:12:10,934 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:12:10,935 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:12:10,935 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:12:10,935 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0027
2015-03-13 10:12:10,935 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0027
2015-03-13 10:12:10,935 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:12:10,935 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0027
2015-03-13 10:12:10,936 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:12:10,936 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:12:10,935 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0027_01_000006 to application application_1426266260362_0027
2015-03-13 10:12:10,936 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0027
2015-03-13 10:12:10,936 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0027
2015-03-13 10:12:10,936 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:12:10,936 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:12:10,936 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0027
2015-03-13 10:12:10,936 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0027
2015-03-13 10:12:10,936 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:12:10,936 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0027
2015-03-13 10:12:10,936 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0027
2015-03-13 10:12:10,936 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0027
2015-03-13 10:12:10,936 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0027
2015-03-13 10:12:10,936 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:12:10,936 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:12:10,937 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0027
2015-03-13 10:12:10,937 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0027
2015-03-13 10:12:10,937 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0027
2015-03-13 10:12:10,937 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:12:10,937 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0027
2015-03-13 10:12:10,937 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0027_01_000005
2015-03-13 10:12:10,938 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0027_01_000003
2015-03-13 10:12:10,941 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0027_01_000004
2015-03-13 10:12:10,943 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0027_01_000002
2015-03-13 10:12:10,959 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426266260362_0027_01_000002.tokens. Credentials list: 
2015-03-13 10:12:10,961 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0027_01_000005.tokens. Credentials list: 
2015-03-13 10:12:10,962 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426266260362_0027_01_000003.tokens. Credentials list: 
2015-03-13 10:12:10,964 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1426266260362_0027_01_000004.tokens. Credentials list: 
2015-03-13 10:12:10,977 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:12:10,977 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:10,980 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:12:11,045 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000006/default_container_executor.sh]
2015-03-13 10:12:11,053 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426266260362_0027_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000002.tokens
2015-03-13 10:12:11,054 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0027 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0027
2015-03-13 10:12:11,114 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.jar	dst=null	perm=null
2015-03-13 10:12:11,115 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.jar	dst=null	perm=null
2015-03-13 10:12:11,115 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.jar	dst=null	perm=null
2015-03-13 10:12:11,122 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63143, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_2011957545_14561, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742145_1321, duration: 367000
2015-03-13 10:12:11,143 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:12:11,160 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.xml	dst=null	perm=null
2015-03-13 10:12:11,161 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.xml	dst=null	perm=null
2015-03-13 10:12:11,162 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.xml	dst=null	perm=null
2015-03-13 10:12:11,170 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63144, bytes: 98956, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_2011957545_14561, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742148_1324, duration: 309000
2015-03-13 10:12:11,186 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:12:11,186 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:12:11,186 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:12:11,186 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:12:11,186 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:12:11,269 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:12:11,269 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:12:11,269 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:11,269 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:11,269 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:12:11,269 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:11,270 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:12:11,270 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:11,346 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742149_1325
2015-03-13 10:12:11,400 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000005/default_container_executor.sh]
2015-03-13 10:12:11,416 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000002/default_container_executor.sh]
2015-03-13 10:12:11,417 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000004/default_container_executor.sh]
2015-03-13 10:12:11,418 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000003/default_container_executor.sh]
2015-03-13 10:12:11,622 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:11,622 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:11,622 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0026 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:12:11,623 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0027_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:12:11,623 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0026
2015-03-13 10:12:11,623 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0026
2015-03-13 10:12:11,623 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0026
2015-03-13 10:12:11,623 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0026
2015-03-13 10:12:11,623 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0026
2015-03-13 10:12:11,623 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0026 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:12:11,624 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0026, with delay of 10800 seconds
2015-03-13 10:12:11,713 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0026 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:12:11,713 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0026
2015-03-13 10:12:11,713 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0026
2015-03-13 10:12:11,713 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0026 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:12:11,713 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0026, with delay of 10800 seconds
2015-03-13 10:12:11,714 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0026
2015-03-13 10:12:11,714 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0026
2015-03-13 10:12:11,715 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0026
2015-03-13 10:12:11,738 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0026 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:12:11,738 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0026
2015-03-13 10:12:11,738 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0026
2015-03-13 10:12:11,739 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0026 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:12:11,739 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0026, with delay of 10800 seconds
2015-03-13 10:12:11,739 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0026
2015-03-13 10:12:11,739 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0026
2015-03-13 10:12:11,740 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0026
2015-03-13 10:12:11,818 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:12:11,825 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:11,825 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:11,825 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:11,825 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:11,826 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0027_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:12:11,826 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0027_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:12:11,826 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0027_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:12:11,826 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0027_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:12:12,226 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:12:12,356 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1426266260362_0027_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000004.tokens
2015-03-13 10:12:12,356 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0027 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0027
2015-03-13 10:12:12,463 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:12:12,586 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426266260362_0027_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000003.tokens
2015-03-13 10:12:12,586 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0027 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0027
2015-03-13 10:12:12,625 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:12,625 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:12,685 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:12:12,805 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0027_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000005.tokens
2015-03-13 10:12:12,805 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0027 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0027
2015-03-13 10:12:12,828 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:12,828 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:12,828 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:12,828 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:13,631 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:13,631 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:13,833 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:13,833 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:13,834 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:13,834 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:14,633 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:14,633 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:14,837 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:14,837 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:14,837 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:14,838 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:15,634 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:15,635 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:15,843 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:15,843 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:15,844 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:15,844 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:16,638 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:16,638 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:16,844 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:16,844 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:16,845 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:16,845 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:17,639 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:17,639 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:17,850 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:17,851 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:17,851 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:17,851 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:18,643 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:18,643 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:18,720 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.split	dst=null	perm=null
2015-03-13 10:12:18,854 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:18,854 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:18,854 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:18,854 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:18,958 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63154, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0027_m_000004_0_1216806613_1, offset: 1024, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742146_1322, duration: 145000
2015-03-13 10:12:18,980 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.split	dst=null	perm=null
2015-03-13 10:12:19,051 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.split	dst=null	perm=null
2015-03-13 10:12:19,113 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.split	dst=null	perm=null
2015-03-13 10:12:19,142 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.split	dst=null	perm=null
2015-03-13 10:12:19,153 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:12:19,158 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63160, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0027_m_000004_0_1216806613_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 142000
2015-03-13 10:12:19,174 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/_temporary/attempt_1426266260362_0027_m_000004_0/part-00004	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:19,204 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63159, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0027_m_000001_0_-383774985_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742146_1322, duration: 152000
2015-03-13 10:12:19,219 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63161, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0027_m_000003_0_-857504959_1, offset: 1024, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742146_1322, duration: 145000
2015-03-13 10:12:19,246 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63162, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0027_m_000000_0_-85006992_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742146_1322, duration: 155000
2015-03-13 10:12:19,306 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63163, bytes: 1282, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0027_m_000002_0_412761673_1, offset: 512, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742146_1322, duration: 179000
2015-03-13 10:12:19,347 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:12:19,351 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63164, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0027_m_000001_0_-383774985_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 147000
2015-03-13 10:12:19,367 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:12:19,371 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63165, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0027_m_000003_0_-857504959_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 138000
2015-03-13 10:12:19,372 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/_temporary/attempt_1426266260362_0027_m_000001_0/part-00001	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:19,384 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:12:19,388 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/_temporary/attempt_1426266260362_0027_m_000003_0/part-00003	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:19,407 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/_temporary/attempt_1426266260362_0027_m_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:19,423 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:12:19,427 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63163, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0027_m_000002_0_412761673_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 156000
2015-03-13 10:12:19,462 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/_temporary/attempt_1426266260362_0027_m_000002_0/part-00002	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:19,612 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0	dst=null	perm=null
2015-03-13 10:12:19,617 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0	dst=null	perm=null
2015-03-13 10:12:19,620 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0	dst=null	perm=null
2015-03-13 10:12:19,647 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:19,647 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:19,672 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/part-00000	dst=null	perm=null
2015-03-13 10:12:19,673 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/part-00000	dst=null	perm=null
2015-03-13 10:12:19,676 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63166, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0027_m_000004_0_1216806613_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742141_1317, duration: 184000
2015-03-13 10:12:19,698 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/_temporary/attempt_1426266260362_0027_m_000004_0/part-00004 is closed by DFSClient_attempt_1426266260362_0027_m_000004_0_1216806613_1
2015-03-13 10:12:19,706 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/_temporary/attempt_1426266260362_0027_m_000004_0	dst=null	perm=null
2015-03-13 10:12:19,712 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/_temporary/attempt_1426266260362_0027_m_000004_0	dst=null	perm=null
2015-03-13 10:12:19,713 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/task_1426266260362_0027_m_000004	dst=null	perm=null
2015-03-13 10:12:19,727 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/_temporary/attempt_1426266260362_0027_m_000004_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/task_1426266260362_0027_m_000004	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:12:19,748 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0027_01_000006
2015-03-13 10:12:19,748 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0027	CONTAINERID=container_1426266260362_0027_01_000006
2015-03-13 10:12:19,748 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:12:19,748 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0027_01_000006
2015-03-13 10:12:19,748 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:19,748 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:12:19,761 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0027_01_000006 is : 143
2015-03-13 10:12:19,762 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job_1426266260362_0027_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073742150_1326{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:12:19,764 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742150_1326 src: /127.0.0.1:63167 dest: /127.0.0.1:60686
2015-03-13 10:12:19,765 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742150_1326 src: /127.0.0.1:63168 dest: /127.0.0.1:60689
2015-03-13 10:12:19,767 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742150_1326 src: /127.0.0.1:63169 dest: /127.0.0.1:60696
2015-03-13 10:12:19,771 INFO  hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job_1426266260362_0027_1.jhist for DFSClient_NONMAPREDUCE_-147161382_1
2015-03-13 10:12:19,772 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:12:19,773 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000006
2015-03-13 10:12:19,773 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000006
2015-03-13 10:12:19,773 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000006
2015-03-13 10:12:19,773 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000006
2015-03-13 10:12:19,773 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0027	CONTAINERID=container_1426266260362_0027_01_000006
2015-03-13 10:12:19,774 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:12:19,774 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0027_01_000006 from application application_1426266260362_0027
2015-03-13 10:12:19,774 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:19,774 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0027
2015-03-13 10:12:19,802 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0	dst=null	perm=null
2015-03-13 10:12:19,807 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0	dst=null	perm=null
2015-03-13 10:12:19,807 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0	dst=null	perm=null
2015-03-13 10:12:19,810 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0	dst=null	perm=null
2015-03-13 10:12:19,812 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0	dst=null	perm=null
2015-03-13 10:12:19,815 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0	dst=null	perm=null
2015-03-13 10:12:19,833 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/part-00000	dst=null	perm=null
2015-03-13 10:12:19,834 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/part-00000	dst=null	perm=null
2015-03-13 10:12:19,838 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63170, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0027_m_000001_0_-383774985_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742141_1317, duration: 146000
2015-03-13 10:12:19,846 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0	dst=null	perm=null
2015-03-13 10:12:19,852 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0	dst=null	perm=null
2015-03-13 10:12:19,854 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/part-00000	dst=null	perm=null
2015-03-13 10:12:19,855 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0	dst=null	perm=null
2015-03-13 10:12:19,855 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/part-00000	dst=null	perm=null
2015-03-13 10:12:19,857 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63161, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0027_m_000003_0_-857504959_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742141_1317, duration: 159000
2015-03-13 10:12:19,858 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:19,859 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:19,859 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:19,859 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:19,880 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/_temporary/attempt_1426266260362_0027_m_000001_0/part-00001. BP-1005356445-10.1.1.144-1426266257849 blk_1073742151_1327{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:12:19,882 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0	dst=null	perm=null
2015-03-13 10:12:19,884 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/part-00000	dst=null	perm=null
2015-03-13 10:12:19,885 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/part-00000	dst=null	perm=null
2015-03-13 10:12:19,889 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63172, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0027_m_000000_0_-85006992_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742141_1317, duration: 150000
2015-03-13 10:12:19,892 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0	dst=null	perm=null
2015-03-13 10:12:19,895 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0	dst=null	perm=null
2015-03-13 10:12:19,912 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/_temporary/attempt_1426266260362_0027_m_000003_0/part-00003. BP-1005356445-10.1.1.144-1426266257849 blk_1073742152_1328{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:12:19,913 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63173, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0027_m_000000_0_-85006992_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 146000
2015-03-13 10:12:19,921 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742151_1327 src: /127.0.0.1:63171 dest: /127.0.0.1:60689
2015-03-13 10:12:19,923 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742151_1327 src: /127.0.0.1:63175 dest: /127.0.0.1:60686
2015-03-13 10:12:19,924 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742151_1327 src: /127.0.0.1:63176 dest: /127.0.0.1:60693
2015-03-13 10:12:19,933 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63176, dest: /127.0.0.1:60693, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0027_m_000001_0_-383774985_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742151_1327, duration: 7453000
2015-03-13 10:12:19,933 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742151_1327, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:19,934 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742151_1327{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:19,934 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63175, dest: /127.0.0.1:60686, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0027_m_000001_0_-383774985_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742151_1327, duration: 8247000
2015-03-13 10:12:19,934 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742151_1327, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:19,934 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742151_1327{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:19,935 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63171, dest: /127.0.0.1:60689, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0027_m_000001_0_-383774985_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742151_1327, duration: 8959000
2015-03-13 10:12:19,935 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742151_1327, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:19,935 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742151_1327{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:19,941 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/_temporary/attempt_1426266260362_0027_m_000001_0/part-00001 is closed by DFSClient_attempt_1426266260362_0027_m_000001_0_-383774985_1
2015-03-13 10:12:19,948 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/part-00000	dst=null	perm=null
2015-03-13 10:12:19,949 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/_temporary/attempt_1426266260362_0027_m_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073742153_1329{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:12:19,949 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/part-00000	dst=null	perm=null
2015-03-13 10:12:19,951 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/_temporary/attempt_1426266260362_0027_m_000001_0	dst=null	perm=null
2015-03-13 10:12:19,958 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63178, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0027_m_000002_0_412761673_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742141_1317, duration: 152000
2015-03-13 10:12:19,960 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/_temporary/attempt_1426266260362_0027_m_000001_0	dst=null	perm=null
2015-03-13 10:12:19,962 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/task_1426266260362_0027_m_000001	dst=null	perm=null
2015-03-13 10:12:19,968 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742152_1328 src: /127.0.0.1:63174 dest: /127.0.0.1:60689
2015-03-13 10:12:19,969 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742152_1328 src: /127.0.0.1:63179 dest: /127.0.0.1:60696
2015-03-13 10:12:19,970 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742152_1328 src: /127.0.0.1:63180 dest: /127.0.0.1:60686
2015-03-13 10:12:19,978 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/_temporary/attempt_1426266260362_0027_m_000001_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/task_1426266260362_0027_m_000001	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:12:19,989 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63180, dest: /127.0.0.1:60686, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0027_m_000003_0_-857504959_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742152_1328, duration: 17108000
2015-03-13 10:12:19,989 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0027_01_000003
2015-03-13 10:12:19,989 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0027	CONTAINERID=container_1426266260362_0027_01_000003
2015-03-13 10:12:19,990 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742152_1328{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:12:19,989 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742152_1328, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:19,990 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:12:19,990 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0027_01_000003
2015-03-13 10:12:20,003 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:20,003 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742153_1329 src: /127.0.0.1:63177 dest: /127.0.0.1:60686
2015-03-13 10:12:20,003 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63179, dest: /127.0.0.1:60696, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0027_m_000003_0_-857504959_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742152_1328, duration: 17832000
2015-03-13 10:12:20,004 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742152_1328, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:20,004 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:12:20,004 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742152_1328{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:12:20,004 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:20,004 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:20,004 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63174, dest: /127.0.0.1:60689, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0027_m_000003_0_-857504959_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742152_1328, duration: 32396000
2015-03-13 10:12:20,005 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742152_1328, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:20,006 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742153_1329 src: /127.0.0.1:63181 dest: /127.0.0.1:60689
2015-03-13 10:12:20,006 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742152_1328{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:12:20,007 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742153_1329 src: /127.0.0.1:63182 dest: /127.0.0.1:60693
2015-03-13 10:12:20,013 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/_temporary/attempt_1426266260362_0027_m_000003_0/part-00003 is closed by DFSClient_attempt_1426266260362_0027_m_000003_0_-857504959_1
2015-03-13 10:12:20,015 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63182, dest: /127.0.0.1:60693, bytes: 28, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0027_m_000000_0_-85006992_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742153_1329, duration: 6824000
2015-03-13 10:12:20,016 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742153_1329, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:20,016 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63181, dest: /127.0.0.1:60689, bytes: 28, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0027_m_000000_0_-85006992_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742153_1329, duration: 7753000
2015-03-13 10:12:20,017 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742153_1329, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:20,017 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0027_01_000003 is : 143
2015-03-13 10:12:20,018 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63177, dest: /127.0.0.1:60686, bytes: 28, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0027_m_000000_0_-85006992_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742153_1329, duration: 9169000
2015-03-13 10:12:20,018 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742153_1329, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:20,018 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742153_1329{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:20,018 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742153_1329{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:20,019 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742153_1329{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:20,026 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/_temporary/attempt_1426266260362_0027_m_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0027_m_000000_0_-85006992_1
2015-03-13 10:12:20,029 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/_temporary/attempt_1426266260362_0027_m_000003_0	dst=null	perm=null
2015-03-13 10:12:20,032 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:12:20,032 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000003
2015-03-13 10:12:20,032 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000003
2015-03-13 10:12:20,032 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000003
2015-03-13 10:12:20,032 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000003
2015-03-13 10:12:20,033 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0027	CONTAINERID=container_1426266260362_0027_01_000003
2015-03-13 10:12:20,033 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:12:20,033 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0027_01_000003 from application application_1426266260362_0027
2015-03-13 10:12:20,033 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:20,033 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0027
2015-03-13 10:12:20,036 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/_temporary/attempt_1426266260362_0027_m_000003_0	dst=null	perm=null
2015-03-13 10:12:20,037 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/task_1426266260362_0027_m_000003	dst=null	perm=null
2015-03-13 10:12:20,040 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/_temporary/attempt_1426266260362_0027_m_000003_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/task_1426266260362_0027_m_000003	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:12:20,041 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/_temporary/attempt_1426266260362_0027_m_000000_0	dst=null	perm=null
2015-03-13 10:12:20,047 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/_temporary/attempt_1426266260362_0027_m_000000_0	dst=null	perm=null
2015-03-13 10:12:20,048 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/task_1426266260362_0027_m_000000	dst=null	perm=null
2015-03-13 10:12:20,050 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/_temporary/attempt_1426266260362_0027_m_000002_0/part-00002. BP-1005356445-10.1.1.144-1426266257849 blk_1073742154_1330{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:12:20,052 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0027_01_000005
2015-03-13 10:12:20,052 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0027	CONTAINERID=container_1426266260362_0027_01_000005
2015-03-13 10:12:20,052 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:12:20,052 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/_temporary/attempt_1426266260362_0027_m_000000_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/task_1426266260362_0027_m_000000	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:12:20,052 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:20,052 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0027_01_000005
2015-03-13 10:12:20,052 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:12:20,053 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0027_01_000003
2015-03-13 10:12:20,053 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:20,053 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:12:20,053 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0027_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:12:20,053 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0027_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:12:20,054 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0027	CONTAINERID=container_1426266260362_0027_01_000003
2015-03-13 10:12:20,054 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0027_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:12:20,054 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:12:20,054 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0027_01_000003, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:20,054 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:20,054 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:12:20,054 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0027_000001 released container container_1426266260362_0027_01_000003 on node: host: 10.1.1.144:60719 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:12:20,064 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0027_01_000005 is : 143
2015-03-13 10:12:20,067 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0027_01_000002
2015-03-13 10:12:20,067 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0027	CONTAINERID=container_1426266260362_0027_01_000002
2015-03-13 10:12:20,068 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:20,068 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:20,068 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: -1000
2015-03-13 10:12:20,077 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:12:20,077 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:12:20,077 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000005
2015-03-13 10:12:20,077 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000005
2015-03-13 10:12:20,078 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000005
2015-03-13 10:12:20,078 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000005
2015-03-13 10:12:20,078 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0027_01_000002
2015-03-13 10:12:20,089 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0027_01_000002 is : 143
2015-03-13 10:12:20,095 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742154_1330 src: /127.0.0.1:63183 dest: /127.0.0.1:60696
2015-03-13 10:12:20,096 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0027	CONTAINERID=container_1426266260362_0027_01_000005
2015-03-13 10:12:20,097 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:12:20,097 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742154_1330 src: /127.0.0.1:63184 dest: /127.0.0.1:60689
2015-03-13 10:12:20,097 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:12:20,097 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0027_01_000005 from application application_1426266260362_0027
2015-03-13 10:12:20,097 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:20,097 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0027
2015-03-13 10:12:20,098 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000002
2015-03-13 10:12:20,098 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742154_1330 src: /127.0.0.1:63185 dest: /127.0.0.1:60693
2015-03-13 10:12:20,098 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000002
2015-03-13 10:12:20,099 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000002
2015-03-13 10:12:20,100 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000002
2015-03-13 10:12:20,100 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0027	CONTAINERID=container_1426266260362_0027_01_000002
2015-03-13 10:12:20,100 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:12:20,100 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0027_01_000002 from application application_1426266260362_0027
2015-03-13 10:12:20,100 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:20,100 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0027
2015-03-13 10:12:20,105 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63185, dest: /127.0.0.1:60693, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0027_m_000002_0_412761673_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742154_1330, duration: 5775000
2015-03-13 10:12:20,105 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742154_1330, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:20,106 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742154_1330{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:20,106 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63184, dest: /127.0.0.1:60689, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0027_m_000002_0_412761673_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742154_1330, duration: 6175000
2015-03-13 10:12:20,106 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742154_1330, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:20,106 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742154_1330{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:20,106 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63183, dest: /127.0.0.1:60696, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0027_m_000002_0_412761673_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742154_1330, duration: 7106000
2015-03-13 10:12:20,107 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742154_1330, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:20,107 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742154_1330{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:20,111 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/_temporary/attempt_1426266260362_0027_m_000002_0/part-00002 is closed by DFSClient_attempt_1426266260362_0027_m_000002_0_412761673_1
2015-03-13 10:12:20,119 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/_temporary/attempt_1426266260362_0027_m_000002_0	dst=null	perm=null
2015-03-13 10:12:20,125 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/_temporary/attempt_1426266260362_0027_m_000002_0	dst=null	perm=null
2015-03-13 10:12:20,126 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/task_1426266260362_0027_m_000002	dst=null	perm=null
2015-03-13 10:12:20,130 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/_temporary/attempt_1426266260362_0027_m_000002_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/task_1426266260362_0027_m_000002	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:12:20,139 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0027_01_000004
2015-03-13 10:12:20,139 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0027	CONTAINERID=container_1426266260362_0027_01_000004
2015-03-13 10:12:20,139 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:12:20,139 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0027_01_000004
2015-03-13 10:12:20,140 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:12:20,140 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0027_01_000002
2015-03-13 10:12:20,140 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:12:20,140 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:12:20,140 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0027_01_000005
2015-03-13 10:12:20,140 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0027_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:12:20,141 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0027_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:12:20,141 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0027	CONTAINERID=container_1426266260362_0027_01_000002
2015-03-13 10:12:20,141 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0027_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:12:20,141 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:12:20,141 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0027_01_000002, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:20,141 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:20,141 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:12:20,141 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0027_000001 released container container_1426266260362_0027_01_000002 on node: host: 10.1.1.144:60719 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:12:20,141 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0027_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:12:20,141 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0027_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:12:20,141 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0027	CONTAINERID=container_1426266260362_0027_01_000005
2015-03-13 10:12:20,141 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0027_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:12:20,142 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:12:20,142 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0027_01_000005, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:20,142 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:20,142 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:12:20,142 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0027_000001 released container container_1426266260362_0027_01_000005 on node: host: 10.1.1.144:60719 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:12:20,143 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:20,145 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-147161382_1
2015-03-13 10:12:20,149 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1	dst=null	perm=null
2015-03-13 10:12:20,149 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0027_01_000004 is : 143
2015-03-13 10:12:20,154 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch	dst=null	perm=null
2015-03-13 10:12:20,155 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch	dst=null	perm=null
2015-03-13 10:12:20,156 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/task_1426266260362_0027_m_000000	dst=null	perm=null
2015-03-13 10:12:20,157 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/part-00000	dst=null	perm=null
2015-03-13 10:12:20,158 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:12:20,158 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000004
2015-03-13 10:12:20,159 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000004
2015-03-13 10:12:20,159 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0027	CONTAINERID=container_1426266260362_0027_01_000004
2015-03-13 10:12:20,159 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:12:20,159 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0027_01_000004 from application application_1426266260362_0027
2015-03-13 10:12:20,159 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:20,159 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0027
2015-03-13 10:12:20,159 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000004
2015-03-13 10:12:20,159 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000004
2015-03-13 10:12:20,161 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/task_1426266260362_0027_m_000000/part-00000	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/part-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:20,164 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch	dst=null	perm=null
2015-03-13 10:12:20,164 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch	dst=null	perm=null
2015-03-13 10:12:20,165 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/task_1426266260362_0027_m_000001	dst=null	perm=null
2015-03-13 10:12:20,167 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/part-00001	dst=null	perm=null
2015-03-13 10:12:20,169 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/task_1426266260362_0027_m_000001/part-00001	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/part-00001	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:20,170 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch	dst=null	perm=null
2015-03-13 10:12:20,171 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch	dst=null	perm=null
2015-03-13 10:12:20,172 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/task_1426266260362_0027_m_000002	dst=null	perm=null
2015-03-13 10:12:20,173 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/part-00002	dst=null	perm=null
2015-03-13 10:12:20,175 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/task_1426266260362_0027_m_000002/part-00002	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/part-00002	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:20,176 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch	dst=null	perm=null
2015-03-13 10:12:20,177 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch	dst=null	perm=null
2015-03-13 10:12:20,178 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/task_1426266260362_0027_m_000003	dst=null	perm=null
2015-03-13 10:12:20,180 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/part-00003	dst=null	perm=null
2015-03-13 10:12:20,181 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/task_1426266260362_0027_m_000003/part-00003	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/part-00003	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:20,182 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch	dst=null	perm=null
2015-03-13 10:12:20,184 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch	dst=null	perm=null
2015-03-13 10:12:20,184 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/task_1426266260362_0027_m_000004	dst=null	perm=null
2015-03-13 10:12:20,185 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/part-00004	dst=null	perm=null
2015-03-13 10:12:20,187 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/task_1426266260362_0027_m_000004/part-00004	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/part-00004	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:20,190 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary	dst=null	perm=null
2015-03-13 10:12:20,193 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:20,195 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-147161382_1
2015-03-13 10:12:20,196 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:20,198 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-147161382_1
2015-03-13 10:12:20,208 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63169, dest: /127.0.0.1:60696, bytes: 53329, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-147161382_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742150_1326, duration: 440089000
2015-03-13 10:12:20,208 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742150_1326, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:20,209 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742150_1326{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:20,209 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63168, dest: /127.0.0.1:60689, bytes: 53329, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-147161382_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742150_1326, duration: 441231000
2015-03-13 10:12:20,210 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742150_1326, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:20,210 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742150_1326{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:20,211 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63167, dest: /127.0.0.1:60686, bytes: 53329, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-147161382_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742150_1326, duration: 442534000
2015-03-13 10:12:20,211 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742150_1326, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:20,211 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742150_1326{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:20,212 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job_1426266260362_0027_1.jhist is closed by DFSClient_NONMAPREDUCE_-147161382_1
2015-03-13 10:12:20,215 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0027.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:20,217 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0027.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742155_1331{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:12:20,219 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742155_1331 src: /127.0.0.1:63186 dest: /127.0.0.1:60686
2015-03-13 10:12:20,220 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742155_1331 src: /127.0.0.1:63187 dest: /127.0.0.1:60693
2015-03-13 10:12:20,222 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742155_1331 src: /127.0.0.1:63188 dest: /127.0.0.1:60689
2015-03-13 10:12:20,224 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63188, dest: /127.0.0.1:60689, bytes: 440, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-147161382_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742155_1331, duration: 1233000
2015-03-13 10:12:20,225 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742155_1331, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:20,225 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742155_1331{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:12:20,225 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63187, dest: /127.0.0.1:60693, bytes: 440, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-147161382_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742155_1331, duration: 1821000
2015-03-13 10:12:20,225 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742155_1331, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:20,226 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742155_1331{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:12:20,226 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63186, dest: /127.0.0.1:60686, bytes: 440, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-147161382_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742155_1331, duration: 2683000
2015-03-13 10:12:20,226 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742155_1331, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:20,226 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742155_1331{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:12:20,228 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0027.summary_tmp is closed by DFSClient_NONMAPREDUCE_-147161382_1
2015-03-13 10:12:20,231 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0027.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:12:20,236 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job_1426266260362_0027_1.jhist	dst=null	perm=null
2015-03-13 10:12:20,237 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0027-1426266725092-soberoi-%5BD22FDB06DDD24032BF29C6EAE9E54D4B%2F55AECEF510524BE2-1426266740198-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:12:20,239 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job_1426266260362_0027_1.jhist	dst=null	perm=null
2015-03-13 10:12:20,240 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0027-1426266725092-soberoi-%5BD22FDB06DDD24032BF29C6EAE9E54D4B%2F55AECEF510524BE2-1426266740198-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:12:20,241 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job_1426266260362_0027_1.jhist	dst=null	perm=null
2015-03-13 10:12:20,243 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0027-1426266725092-soberoi-%5BD22FDB06DDD24032BF29C6EAE9E54D4B%2F55AECEF510524BE2-1426266740198-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:20,245 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63189, bytes: 53749, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-147161382_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742150_1326, duration: 151000
2015-03-13 10:12:20,247 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0027-1426266725092-soberoi-%5BD22FDB06DDD24032BF29C6EAE9E54D4B%2F55AECEF510524BE2-1426266740198-5-0-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742156_1332{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:12:20,249 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742156_1332 src: /127.0.0.1:63190 dest: /127.0.0.1:60689
2015-03-13 10:12:20,250 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742156_1332 src: /127.0.0.1:63191 dest: /127.0.0.1:60693
2015-03-13 10:12:20,251 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742156_1332 src: /127.0.0.1:63192 dest: /127.0.0.1:60696
2015-03-13 10:12:20,254 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63192, dest: /127.0.0.1:60696, bytes: 53329, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-147161382_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742156_1332, duration: 1608000
2015-03-13 10:12:20,254 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742156_1332, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:20,254 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742156_1332{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:20,254 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63191, dest: /127.0.0.1:60693, bytes: 53329, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-147161382_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742156_1332, duration: 2109000
2015-03-13 10:12:20,254 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742156_1332, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:20,255 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742156_1332{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:20,255 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63190, dest: /127.0.0.1:60689, bytes: 53329, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-147161382_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742156_1332, duration: 2829000
2015-03-13 10:12:20,255 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742156_1332, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:20,255 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742156_1332{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:20,257 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0027-1426266725092-soberoi-%5BD22FDB06DDD24032BF29C6EAE9E54D4B%2F55AECEF510524BE2-1426266740198-5-0-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-147161382_1
2015-03-13 10:12:20,258 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0027-1426266725092-soberoi-%5BD22FDB06DDD24032BF29C6EAE9E54D4B%2F55AECEF510524BE2-1426266740198-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:12:20,259 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job_1426266260362_0027_1_conf.xml	dst=null	perm=null
2015-03-13 10:12:20,260 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0027_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:12:20,261 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job_1426266260362_0027_1_conf.xml	dst=null	perm=null
2015-03-13 10:12:20,262 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0027_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:12:20,263 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job_1426266260362_0027_1_conf.xml	dst=null	perm=null
2015-03-13 10:12:20,266 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0027_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:20,269 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63193, bytes: 91702, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-147161382_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742149_1325, duration: 274000
2015-03-13 10:12:20,272 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0027_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742157_1333{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:12:20,274 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742157_1333 src: /127.0.0.1:63194 dest: /127.0.0.1:60689
2015-03-13 10:12:20,276 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742157_1333 src: /127.0.0.1:63195 dest: /127.0.0.1:60693
2015-03-13 10:12:20,278 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742157_1333 src: /127.0.0.1:63196 dest: /127.0.0.1:60696
2015-03-13 10:12:20,282 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63196, dest: /127.0.0.1:60696, bytes: 90990, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-147161382_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742157_1333, duration: 2131000
2015-03-13 10:12:20,282 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742157_1333, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:20,283 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742157_1333{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:20,283 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63195, dest: /127.0.0.1:60693, bytes: 90990, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-147161382_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742157_1333, duration: 2769000
2015-03-13 10:12:20,283 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742157_1333, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:20,284 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742157_1333{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:20,284 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63194, dest: /127.0.0.1:60689, bytes: 90990, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-147161382_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742157_1333, duration: 3848000
2015-03-13 10:12:20,284 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742157_1333, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:20,285 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742157_1333{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:20,286 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0027_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-147161382_1
2015-03-13 10:12:20,288 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0027_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:12:20,289 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0027.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0027.summary	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:12:20,291 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0027_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0027_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:12:20,292 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0027-1426266725092-soberoi-%5BD22FDB06DDD24032BF29C6EAE9E54D4B%2F55AECEF510524BE2-1426266740198-5-0-SUCCEEDED-default.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0027-1426266725092-soberoi-%5BD22FDB06DDD24032BF29C6EAE9E54D4B%2F55AECEF510524BE2-1426266740198-5-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:12:20,298 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0027_000001 State change from RUNNING to FINISHING
2015-03-13 10:12:20,298 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0027
2015-03-13 10:12:20,298 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0027 State change from RUNNING to REMOVING
2015-03-13 10:12:20,298 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0027
2015-03-13 10:12:20,298 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0027 State change from REMOVING to FINISHING
2015-03-13 10:12:20,609 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742155_1331
2015-03-13 10:12:20,610 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742156_1332
2015-03-13 10:12:20,610 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742151_1327
2015-03-13 10:12:20,611 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742153_1329
2015-03-13 10:12:20,611 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742154_1330
2015-03-13 10:12:20,612 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742157_1333
2015-03-13 10:12:20,754 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:20,754 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:12:20,754 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0027_01_000006
2015-03-13 10:12:20,755 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0027_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:12:20,755 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0027_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:12:20,755 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0027	CONTAINERID=container_1426266260362_0027_01_000006
2015-03-13 10:12:20,755 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0027_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:12:20,755 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:12:20,756 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0027_01_000006, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:20,756 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:20,756 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:12:20,756 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742153_1329
2015-03-13 10:12:20,756 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0027_000001 released container container_1426266260362_0027_01_000006 on node: host: 10.1.1.144:60715 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:12:20,757 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742150_1326
2015-03-13 10:12:20,757 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742152_1328
2015-03-13 10:12:20,757 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742151_1327
2015-03-13 10:12:20,758 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742155_1331
2015-03-13 10:12:21,141 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:12:21,141 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0027_01_000004
2015-03-13 10:12:21,142 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0027_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:12:21,142 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0027_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:12:21,142 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0027	CONTAINERID=container_1426266260362_0027_01_000004
2015-03-13 10:12:21,142 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0027_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:12:21,143 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:12:21,143 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0027_01_000004, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:21,143 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:21,143 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:12:21,143 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0027_000001 released container container_1426266260362_0027_01_000004 on node: host: 10.1.1.144:60719 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:12:21,309 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742145_1321 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60696 127.0.0.1:60693 
2015-03-13 10:12:21,310 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742146_1322 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60689 
2015-03-13 10:12:21,310 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742147_1323 127.0.0.1:60689 127.0.0.1:60686 127.0.0.1:60693 
2015-03-13 10:12:21,310 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742148_1324 127.0.0.1:60686 127.0.0.1:60693 127.0.0.1:60696 
2015-03-13 10:12:21,310 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742150_1326 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60696 
2015-03-13 10:12:21,310 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742149_1325 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60693 
2015-03-13 10:12:21,311 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027	dst=null	perm=null
2015-03-13 10:12:21,341 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742141_1317 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60686 
2015-03-13 10:12:21,341 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0	dst=null	perm=null
2015-03-13 10:12:21,342 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch	dst=null	perm=null
2015-03-13 10:12:21,342 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary
2015-03-13 10:12:21,343 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary	dst=null	perm=null
2015-03-13 10:12:21,349 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:12:21,350 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:12:21,350 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:12:21,351 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch	dst=null	perm=null
2015-03-13 10:12:21,351 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742154_1330
2015-03-13 10:12:21,351 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch	dst=null	perm=null
2015-03-13 10:12:21,352 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742156_1332
2015-03-13 10:12:21,352 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch	dst=null	perm=null
2015-03-13 10:12:21,352 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742157_1333
2015-03-13 10:12:21,353 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742150_1326
2015-03-13 10:12:21,353 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742152_1328
2015-03-13 10:12:21,354 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:12:21,354 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/part-00000	dst=null	perm=null
2015-03-13 10:12:21,356 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63199, bytes: 32, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742153_1329, duration: 151000
2015-03-13 10:12:21,357 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/part-00001	dst=null	perm=null
2015-03-13 10:12:21,358 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63200, bytes: 18, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742151_1327, duration: 154000
2015-03-13 10:12:21,359 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/part-00002	dst=null	perm=null
2015-03-13 10:12:21,361 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63201, bytes: 18, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742154_1330, duration: 156000
2015-03-13 10:12:21,362 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/part-00003	dst=null	perm=null
2015-03-13 10:12:21,363 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63201, bytes: 18, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742152_1328, duration: 151000
2015-03-13 10:12:21,364 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/part-00004	dst=null	perm=null
2015-03-13 10:12:21,372 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:12:21,372 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:12:21,373 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:12:21,374 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch	dst=null	perm=null
2015-03-13 10:12:21,375 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch	dst=null	perm=null
2015-03-13 10:12:21,375 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch	dst=null	perm=null
2015-03-13 10:12:21,377 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:12:21,378 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/part-00000	dst=null	perm=null
2015-03-13 10:12:21,379 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63199, bytes: 32, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742153_1329, duration: 165000
2015-03-13 10:12:21,380 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/part-00001	dst=null	perm=null
2015-03-13 10:12:21,381 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63200, bytes: 18, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742151_1327, duration: 139000
2015-03-13 10:12:21,382 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/part-00002	dst=null	perm=null
2015-03-13 10:12:21,383 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63201, bytes: 18, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742154_1330, duration: 117000
2015-03-13 10:12:21,384 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/part-00003	dst=null	perm=null
2015-03-13 10:12:21,385 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63201, bytes: 18, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742152_1328, duration: 107000
2015-03-13 10:12:21,385 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/part-00004	dst=null	perm=null
2015-03-13 10:12:21,386 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch
2015-03-13 10:12:21,386 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch	dst=null	perm=null
2015-03-13 10:12:21,387 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch	dst=null	perm=null
2015-03-13 10:12:21,387 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch	dst=null	perm=null
2015-03-13 10:12:21,388 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch	dst=null	perm=null
2015-03-13 10:12:21,389 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/part-00000	dst=null	perm=null
2015-03-13 10:12:21,389 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/part-00000	dst=null	perm=null
2015-03-13 10:12:21,390 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63199, bytes: 32, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742153_1329, duration: 131000
2015-03-13 10:12:21,391 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/part-00001	dst=null	perm=null
2015-03-13 10:12:21,391 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/part-00001	dst=null	perm=null
2015-03-13 10:12:21,393 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63199, bytes: 18, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742151_1327, duration: 140000
2015-03-13 10:12:21,393 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/part-00002	dst=null	perm=null
2015-03-13 10:12:21,394 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/part-00002	dst=null	perm=null
2015-03-13 10:12:21,395 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63202, bytes: 18, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742154_1330, duration: 153000
2015-03-13 10:12:21,396 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/part-00003	dst=null	perm=null
2015-03-13 10:12:21,397 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/part-00003	dst=null	perm=null
2015-03-13 10:12:21,398 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63200, bytes: 18, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742152_1328, duration: 115000
2015-03-13 10:12:21,398 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/part-00004	dst=null	perm=null
2015-03-13 10:12:21,399 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/part-00004	dst=null	perm=null
2015-03-13 10:12:21,400 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:12:21,400 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:12:21,410 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:12:21,411 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:12:21,411 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:12:21,435 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin	dst=null	perm=null
2015-03-13 10:12:21,436 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper1*upper2] starting
2015-03-13 10:12:21,436 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper1*upper2]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt"]
2015-03-13 10:12:21,436 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper1*upper2]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-03-13 10:12:21,436 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper1*upper2]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt"]
2015-03-13 10:12:21,436 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper1*upper2]  sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin"]
2015-03-13 10:12:21,437 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper1*upper2]  parallel execution is enabled: true
2015-03-13 10:12:21,437 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper1*upper2]  starting jobs: 3
2015-03-13 10:12:21,437 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper1*upper2]  allocating threads: 3
2015-03-13 10:12:21,438 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper1*upper2] starting step: (3/3)
2015-03-13 10:12:21,445 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:12:21,453 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:12:21,454 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5	dst=null	perm=null
2015-03-13 10:12:21,455 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:12:21,455 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:12:21,457 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 28
2015-03-13 10:12:21,458 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028	dst=null	perm=null
2015-03-13 10:12:21,459 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028	dst=null	perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:12:21,460 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028	dst=null	perm=soberoi:supergroup:rwx------
2015-03-13 10:12:21,461 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.jar	dst=null	perm=null
2015-03-13 10:12:21,462 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:21,463 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073742158_1334{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:12:21,465 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742158_1334 src: /127.0.0.1:63204 dest: /127.0.0.1:60689
2015-03-13 10:12:21,466 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742158_1334 src: /127.0.0.1:63205 dest: /127.0.0.1:60693
2015-03-13 10:12:21,467 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742158_1334 src: /127.0.0.1:63206 dest: /127.0.0.1:60696
2015-03-13 10:12:21,470 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63206, dest: /127.0.0.1:60696, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742158_1334, duration: 1875000
2015-03-13 10:12:21,471 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742158_1334, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:21,471 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742158_1334{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:21,471 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63205, dest: /127.0.0.1:60693, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742158_1334, duration: 2186000
2015-03-13 10:12:21,471 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742158_1334, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:21,472 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742158_1334{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:21,472 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63204, dest: /127.0.0.1:60689, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742158_1334, duration: 3495000
2015-03-13 10:12:21,472 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742158_1334, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:21,473 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742158_1334{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:21,474 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:12:21,475 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.jar
2015-03-13 10:12:21,475 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.jar	dst=null	perm=null
2015-03-13 10:12:21,476 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:21,477 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:12:21,478 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:12:21,479 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:12:21,480 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:12:21,480 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:12:21,481 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:12:21,481 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:12:21,482 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:12:21,482 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:12:21,484 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:12:21,484 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:12:21,485 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:12:21,486 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:21,487 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:21,488 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.split
2015-03-13 10:12:21,488 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.split	dst=null	perm=null
2015-03-13 10:12:21,489 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073742159_1335{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:12:21,490 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742159_1335 src: /127.0.0.1:63207 dest: /127.0.0.1:60696
2015-03-13 10:12:21,491 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742159_1335 src: /127.0.0.1:63208 dest: /127.0.0.1:60689
2015-03-13 10:12:21,493 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742159_1335 src: /127.0.0.1:63209 dest: /127.0.0.1:60693
2015-03-13 10:12:21,493 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742159_1335 src: /127.0.0.1:63210 dest: /127.0.0.1:60686
2015-03-13 10:12:21,496 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63210, dest: /127.0.0.1:60686, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742159_1335, duration: 1776000
2015-03-13 10:12:21,496 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742159_1335, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:21,497 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742159_1335{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:12:21,497 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63209, dest: /127.0.0.1:60693, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742159_1335, duration: 2040000
2015-03-13 10:12:21,497 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742159_1335, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:21,497 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742159_1335{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:12:21,498 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63208, dest: /127.0.0.1:60689, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742159_1335, duration: 3069000
2015-03-13 10:12:21,498 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742159_1335, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:21,498 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742159_1335{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:12:21,498 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63207, dest: /127.0.0.1:60696, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742159_1335, duration: 3444000
2015-03-13 10:12:21,499 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742159_1335, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:21,499 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742159_1335{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:12:21,500 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:12:21,502 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:21,503 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:21,504 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073742160_1336{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:12:21,505 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742160_1336 src: /127.0.0.1:63211 dest: /127.0.0.1:60696
2015-03-13 10:12:21,506 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742160_1336 src: /127.0.0.1:63212 dest: /127.0.0.1:60689
2015-03-13 10:12:21,507 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742160_1336 src: /127.0.0.1:63213 dest: /127.0.0.1:60686
2015-03-13 10:12:21,509 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63213, dest: /127.0.0.1:60686, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742160_1336, duration: 1233000
2015-03-13 10:12:21,510 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742160_1336, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:21,510 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742160_1336{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:12:21,510 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63212, dest: /127.0.0.1:60689, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742160_1336, duration: 1751000
2015-03-13 10:12:21,510 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742160_1336, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:21,510 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742160_1336{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:12:21,511 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63211, dest: /127.0.0.1:60696, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742160_1336, duration: 2541000
2015-03-13 10:12:21,511 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742160_1336, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:21,511 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742160_1336{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:12:21,512 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:12:21,512 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:12:21,514 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:21,515 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:21,516 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:12:21,517 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:12:21,517 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:12:21,522 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742161_1337{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:12:21,523 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742161_1337 src: /127.0.0.1:63214 dest: /127.0.0.1:60693
2015-03-13 10:12:21,524 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742161_1337 src: /127.0.0.1:63215 dest: /127.0.0.1:60696
2015-03-13 10:12:21,526 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742161_1337 src: /127.0.0.1:63216 dest: /127.0.0.1:60686
2015-03-13 10:12:21,529 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63216, dest: /127.0.0.1:60686, bytes: 96469, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742161_1337, duration: 1416000
2015-03-13 10:12:21,529 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742161_1337, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:21,529 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742161_1337{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:12:21,529 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63215, dest: /127.0.0.1:60696, bytes: 96469, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742161_1337, duration: 1964000
2015-03-13 10:12:21,530 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742161_1337, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:21,530 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742161_1337{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:12:21,530 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63214, dest: /127.0.0.1:60693, bytes: 96469, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742161_1337, duration: 2829000
2015-03-13 10:12:21,530 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742161_1337, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:21,531 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742161_1337{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:12:21,532 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:12:21,532 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0028
2015-03-13 10:12:21,533 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028	dst=null	perm=null
2015-03-13 10:12:21,534 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.xml	dst=null	perm=null
2015-03-13 10:12:21,534 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.xml	dst=null	perm=null
2015-03-13 10:12:21,535 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.jar	dst=null	perm=null
2015-03-13 10:12:21,535 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.jar	dst=null	perm=null
2015-03-13 10:12:21,536 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.split	dst=null	perm=null
2015-03-13 10:12:21,536 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.split	dst=null	perm=null
2015-03-13 10:12:21,536 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:12:21,537 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:12:21,545 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:12:21,546 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:12:21,546 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:12:21,547 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:12:21,547 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:12:21,548 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:12:21,549 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 28 submitted by user soberoi
2015-03-13 10:12:21,549 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0028
2015-03-13 10:12:21,549 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	IP=10.1.1.144	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1426266260362_0028
2015-03-13 10:12:21,549 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0028
2015-03-13 10:12:21,549 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0028 State change from NEW to NEW_SAVING
2015-03-13 10:12:21,549 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0028 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:12:21,549 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0028_000001
2015-03-13 10:12:21,549 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0028_000001 State change from NEW to SUBMITTED
2015-03-13 10:12:21,550 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0028 from user: soberoi activated in queue: default
2015-03-13 10:12:21,550 INFO  capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0028 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:12:21,550 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0028 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:12:21,550 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0028 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:12:21,550 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0028_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:12:21,550 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0028_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:12:21,551 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0028 State change from SUBMITTED to ACCEPTED
2015-03-13 10:12:21,552 INFO  mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0028/
2015-03-13 10:12:21,552 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper1*upper2] submitted hadoop job: job_1426266260362_0028
2015-03-13 10:12:21,552 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper1*upper2] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0028/
2015-03-13 10:12:21,748 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0028_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:12:21,748 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0028	CONTAINERID=container_1426266260362_0028_01_000001
2015-03-13 10:12:21,748 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0028_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:12:21,748 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0028 container=Container: [ContainerId: container_1426266260362_0028_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0028_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:21,749 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:12:21,749 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:21,749 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0028_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:12:21,752 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0028 AttemptId: appattempt_1426266260362_0028_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0028_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ]
2015-03-13 10:12:21,752 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0028_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:12:21,752 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0028_000001
2015-03-13 10:12:21,752 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0028_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:12:21,752 INFO  amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0028_000001
2015-03-13 10:12:21,753 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0028_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] for AM appattempt_1426266260362_0028_000001
2015-03-13 10:12:21,753 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0028_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-03-13 10:12:21,755 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0028_000001 (auth:SIMPLE)
2015-03-13 10:12:21,756 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0028_01_000001 by user soberoi
2015-03-13 10:12:21,757 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0028
2015-03-13 10:12:21,757 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0028	CONTAINERID=container_1426266260362_0028_01_000001
2015-03-13 10:12:21,757 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0028 transitioned from NEW to INITING
2015-03-13 10:12:21,757 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0028_01_000001 to application application_1426266260362_0028
2015-03-13 10:12:21,757 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0028_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] for AM appattempt_1426266260362_0028_000001
2015-03-13 10:12:21,757 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0028 transitioned from INITING to RUNNING
2015-03-13 10:12:21,757 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0028_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:12:21,757 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:12:21,757 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0028
2015-03-13 10:12:21,758 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:12:21,758 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:21,758 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:12:21,758 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:12:21,758 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:12:21,758 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0028_01_000001
2015-03-13 10:12:21,768 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426266260362_0028_01_000001.tokens. Credentials list: 
2015-03-13 10:12:21,783 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:12:21,851 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426266260362_0028_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000001.tokens
2015-03-13 10:12:21,852 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0028 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0028
2015-03-13 10:12:21,910 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.jar	dst=null	perm=null
2015-03-13 10:12:21,911 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.jar	dst=null	perm=null
2015-03-13 10:12:21,912 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.jar	dst=null	perm=null
2015-03-13 10:12:21,918 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63200, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_340277465_14925, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742158_1334, duration: 503000
2015-03-13 10:12:21,936 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:12:21,951 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:12:21,952 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:12:21,953 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:12:21,958 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63201, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_340277465_14925, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742160_1336, duration: 144000
2015-03-13 10:12:21,971 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:12:21,987 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.split	dst=null	perm=null
2015-03-13 10:12:21,987 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.split	dst=null	perm=null
2015-03-13 10:12:21,988 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.split	dst=null	perm=null
2015-03-13 10:12:21,995 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63201, bytes: 1798, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_340277465_14925, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742159_1335, duration: 143000
2015-03-13 10:12:22,008 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:12:22,027 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.xml	dst=null	perm=null
2015-03-13 10:12:22,028 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.xml	dst=null	perm=null
2015-03-13 10:12:22,028 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.xml	dst=null	perm=null
2015-03-13 10:12:22,034 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63199, bytes: 97225, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_340277465_14925, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742161_1337, duration: 231000
2015-03-13 10:12:22,048 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:12:22,048 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:12:22,064 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60696 to replicate blk_1073742158_1334 to datanode(s) 127.0.0.1:60686
2015-03-13 10:12:22,064 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073742145_1321, blk_1073742146_1322, blk_1073742147_1323, blk_1073742150_1326]
2015-03-13 10:12:22,064 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073742145_1321, blk_1073742146_1322, blk_1073742147_1323, blk_1073742148_1324, blk_1073742149_1325, blk_1073742150_1326, blk_1073742141_1317]
2015-03-13 10:12:22,075 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:12:22,075 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:22,148 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000001/default_container_executor.sh]
2015-03-13 10:12:22,628 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742145_1321 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742145 for deletion
2015-03-13 10:12:22,628 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742146_1322 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742146 for deletion
2015-03-13 10:12:22,628 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742147_1323 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742147 for deletion
2015-03-13 10:12:22,628 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742148_1324 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742148 for deletion
2015-03-13 10:12:22,628 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742149_1325 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742149 for deletion
2015-03-13 10:12:22,629 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742150_1326 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742150 for deletion
2015-03-13 10:12:22,629 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742141_1317 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742141 for deletion
2015-03-13 10:12:22,629 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742145_1321 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742145 for deletion
2015-03-13 10:12:22,629 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742146_1322 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742146 for deletion
2015-03-13 10:12:22,629 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742147_1323 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742147 for deletion
2015-03-13 10:12:22,629 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742150_1326 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742150 for deletion
2015-03-13 10:12:22,629 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742145_1321 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742145
2015-03-13 10:12:22,630 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742147_1323 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742147
2015-03-13 10:12:22,630 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742149_1325 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742149
2015-03-13 10:12:22,630 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742145_1321 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742145
2015-03-13 10:12:22,630 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742146_1322 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742146
2015-03-13 10:12:22,630 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742146_1322 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742146
2015-03-13 10:12:22,630 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742148_1324 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742148
2015-03-13 10:12:22,631 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742150_1326 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742150
2015-03-13 10:12:22,631 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742141_1317 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742141
2015-03-13 10:12:22,630 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742147_1323 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742147
2015-03-13 10:12:22,631 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742150_1326 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742150
2015-03-13 10:12:22,748 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:22,749 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0028_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:12:22,761 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:23,021 INFO  datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-318492837-10.1.1.144-60696-1426266259571, infoPort=60697, ipcPort=60698, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073742158_1334 to 127.0.0.1:60686 
2015-03-13 10:12:23,022 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742158_1334 src: /127.0.0.1:63220 dest: /127.0.0.1:60686
2015-03-13 10:12:23,022 INFO  datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073742158_1334 (numBytes=254067) to /127.0.0.1:60686
2015-03-13 10:12:23,023 INFO  datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073742158_1334 src: /127.0.0.1:63220 dest: /127.0.0.1:60686 of size 254067
2015-03-13 10:12:23,024 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742158_1334 size 254067
2015-03-13 10:12:23,727 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:12:23,749 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:23,749 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/COMMIT_STARTED	dst=null	perm=null
2015-03-13 10:12:23,750 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/COMMIT_SUCCESS	dst=null	perm=null
2015-03-13 10:12:23,751 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/COMMIT_FAIL	dst=null	perm=null
2015-03-13 10:12:23,761 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:23,802 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028	dst=null	perm=null
2015-03-13 10:12:23,803 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:12:23,804 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:12:24,092 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:12:24,099 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:12:24,155 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63222, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_308547630_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742160_1336, duration: 190000
2015-03-13 10:12:24,755 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:24,765 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:24,800 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742151_1327
2015-03-13 10:12:24,800 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742160_1336
2015-03-13 10:12:24,800 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742153_1329
2015-03-13 10:12:24,801 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742156_1332
2015-03-13 10:12:24,801 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742152_1328
2015-03-13 10:12:24,801 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742155_1331
2015-03-13 10:12:24,930 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0028_000001 (auth:SIMPLE)
2015-03-13 10:12:24,931 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0028_000001
2015-03-13 10:12:24,931 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi	IP=10.1.1.144	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1426266260362_0028	APPATTEMPTID=appattempt_1426266260362_0028_000001
2015-03-13 10:12:24,932 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0028_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:12:24,932 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0028 State change from ACCEPTED to RUNNING
2015-03-13 10:12:24,952 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job_1426266260362_0028_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:24,953 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:12:25,004 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742158_1334
2015-03-13 10:12:25,005 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742154_1330
2015-03-13 10:12:25,005 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742159_1335
2015-03-13 10:12:25,006 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742157_1333
2015-03-13 10:12:25,014 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job_1426266260362_0028_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:25,066 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073742145_1321, blk_1073742146_1322, blk_1073742147_1323, blk_1073742148_1324, blk_1073742149_1325, blk_1073742141_1317]
2015-03-13 10:12:25,066 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073742145_1321, blk_1073742146_1322, blk_1073742148_1324, blk_1073742149_1325, blk_1073742150_1326, blk_1073742141_1317]
2015-03-13 10:12:25,137 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job_1426266260362_0028_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742162_1338{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:12:25,184 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742162_1338 src: /127.0.0.1:63228 dest: /127.0.0.1:60689
2015-03-13 10:12:25,185 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742162_1338 src: /127.0.0.1:63229 dest: /127.0.0.1:60693
2015-03-13 10:12:25,186 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742162_1338 src: /127.0.0.1:63230 dest: /127.0.0.1:60696
2015-03-13 10:12:25,193 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63230, dest: /127.0.0.1:60696, bytes: 89373, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_308547630_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742162_1338, duration: 5242000
2015-03-13 10:12:25,193 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742162_1338, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:25,193 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742162_1338{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:25,194 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63229, dest: /127.0.0.1:60693, bytes: 89373, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_308547630_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742162_1338, duration: 6117000
2015-03-13 10:12:25,194 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742162_1338, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:25,194 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742162_1338{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:25,195 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63228, dest: /127.0.0.1:60689, bytes: 89373, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_308547630_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742162_1338, duration: 6911000
2015-03-13 10:12:25,195 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742162_1338, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:25,195 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742162_1338{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:25,198 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job_1426266260362_0028_1_conf.xml is closed by DFSClient_NONMAPREDUCE_308547630_1
2015-03-13 10:12:25,618 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742162_1338
2015-03-13 10:12:25,758 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:25,764 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742158_1334
2015-03-13 10:12:25,764 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742160_1336
2015-03-13 10:12:25,766 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:25,820 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742158_1334
2015-03-13 10:12:25,821 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742161_1337
2015-03-13 10:12:25,822 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742159_1335
2015-03-13 10:12:25,849 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742145_1321 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742145 for deletion
2015-03-13 10:12:25,850 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742146_1322 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742146 for deletion
2015-03-13 10:12:25,850 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742147_1323 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742147 for deletion
2015-03-13 10:12:25,850 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742145_1321 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742145
2015-03-13 10:12:25,850 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742148_1324 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742148 for deletion
2015-03-13 10:12:25,850 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742149_1325 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742149 for deletion
2015-03-13 10:12:25,850 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742146_1322 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742146
2015-03-13 10:12:25,851 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742141_1317 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742141 for deletion
2015-03-13 10:12:25,851 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742147_1323 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742147
2015-03-13 10:12:25,851 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742148_1324 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742148
2015-03-13 10:12:25,851 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742141_1317 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742141
2015-03-13 10:12:25,851 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742149_1325 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742149
2015-03-13 10:12:25,963 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742161_1337
2015-03-13 10:12:25,963 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742159_1335
2015-03-13 10:12:26,024 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742145_1321 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742145 for deletion
2015-03-13 10:12:26,024 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742146_1322 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742146 for deletion
2015-03-13 10:12:26,024 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742148_1324 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742148 for deletion
2015-03-13 10:12:26,024 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742145_1321 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742145
2015-03-13 10:12:26,024 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742149_1325 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742149 for deletion
2015-03-13 10:12:26,025 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742150_1326 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742150 for deletion
2015-03-13 10:12:26,025 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742148_1324 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742148
2015-03-13 10:12:26,025 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742146_1322 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742146
2015-03-13 10:12:26,025 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742141_1317 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742141 for deletion
2015-03-13 10:12:26,025 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742150_1326 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742150
2015-03-13 10:12:26,025 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742149_1325 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742149
2015-03-13 10:12:26,025 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742141_1317 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742141
2015-03-13 10:12:26,158 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0028_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:12:26,159 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0028	CONTAINERID=container_1426266260362_0028_01_000002
2015-03-13 10:12:26,159 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0028_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:12:26,159 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0028 container=Container: [ContainerId: container_1426266260362_0028_01_000002, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0028_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:26,159 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:12:26,159 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:26,160 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0028_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:12:26,160 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0028	CONTAINERID=container_1426266260362_0028_01_000003
2015-03-13 10:12:26,160 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0028_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:12:26,160 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0028 container=Container: [ContainerId: container_1426266260362_0028_01_000003, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0028_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:26,160 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:12:26,161 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:26,161 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0028_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:12:26,161 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0028	CONTAINERID=container_1426266260362_0028_01_000004
2015-03-13 10:12:26,161 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0028_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:12:26,161 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0028 container=Container: [ContainerId: container_1426266260362_0028_01_000004, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0028_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:26,161 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:12:26,162 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:26,162 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0028_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:12:26,162 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0028	CONTAINERID=container_1426266260362_0028_01_000005
2015-03-13 10:12:26,162 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0028_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:12:26,162 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0028 container=Container: [ContainerId: container_1426266260362_0028_01_000005, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0028_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:26,162 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:12:26,162 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:26,337 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0027_01_000001 succeeded 
2015-03-13 10:12:26,337 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:12:26,337 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0027_01_000001
2015-03-13 10:12:26,343 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000001
2015-03-13 10:12:26,344 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000001
2015-03-13 10:12:26,344 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000001
2015-03-13 10:12:26,343 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000001
2015-03-13 10:12:26,344 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0027	CONTAINERID=container_1426266260362_0027_01_000001
2015-03-13 10:12:26,344 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:12:26,344 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0027_01_000001 from application application_1426266260362_0027
2015-03-13 10:12:26,344 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:26,344 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0027
2015-03-13 10:12:26,360 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742159_1335
2015-03-13 10:12:26,361 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742161_1337
2015-03-13 10:12:26,362 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742162_1338
2015-03-13 10:12:26,563 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742158_1334
2015-03-13 10:12:26,563 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742160_1336
2015-03-13 10:12:26,761 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:26,762 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0028_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:12:26,762 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0028	CONTAINERID=container_1426266260362_0028_01_000006
2015-03-13 10:12:26,763 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0028_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:12:26,763 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0028 container=Container: [ContainerId: container_1426266260362_0028_01_000006, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0028_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:26,763 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7
2015-03-13 10:12:26,763 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:26,767 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:12:26,767 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0027_01_000001
2015-03-13 10:12:26,767 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0027_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:12:26,767 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0027_000001
2015-03-13 10:12:26,767 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0027_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:12:26,768 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0027_000001 State change from FINISHING to FINISHED
2015-03-13 10:12:26,768 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0027	CONTAINERID=container_1426266260362_0027_01_000001
2015-03-13 10:12:26,768 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0027 State change from FINISHING to FINISHED
2015-03-13 10:12:26,768 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0027_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60715, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:12:26,768 INFO  amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0027_000001
2015-03-13 10:12:26,768 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:7168, vCores:6> numContainers=6 user=soberoi user-resources=<memory:7168, vCores:6>
2015-03-13 10:12:26,768 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1426266260362_0027
2015-03-13 10:12:26,768 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0027_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:26,768 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0027,name=[D22FDB06DDD24032BF29C6EAE9E54D4B/55AECEF510524BE28EDC4742DCE94B2F] lower*upper/(1/2) ...atform/joinfilteredbranch,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0027/jobhistory/job/job_1426266260362_0027,appMasterHost=Edinburgh.local,startTime=1426266725092,finishTime=1426266740298,finalStatus=SUCCEEDED
2015-03-13 10:12:26,768 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:26,769 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6
2015-03-13 10:12:26,769 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0027_000001 released container container_1426266260362_0027_01_000001 on node: host: 10.1.1.144:60715 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:12:26,769 INFO  capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0027_000001 is done. finalState=FINISHED
2015-03-13 10:12:26,769 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0027 requests cleared
2015-03-13 10:12:26,769 INFO  capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0027 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:12:26,769 INFO  capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0027 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:12:26,770 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0027_000001 (auth:SIMPLE)
2015-03-13 10:12:26,771 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0027_01_000001
2015-03-13 10:12:26,962 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0028_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:12:26,963 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0028_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:12:26,963 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0028_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:12:26,963 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0028_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:12:26,963 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0028_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:12:26,989 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.jar	dst=null	perm=null
2015-03-13 10:12:26,990 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.jar	dst=null	perm=null
2015-03-13 10:12:26,998 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.xml	dst=null	perm=null
2015-03-13 10:12:26,999 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.xml	dst=null	perm=null
2015-03-13 10:12:27,001 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:12:27,002 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:12:27,007 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:12:27,008 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:12:27,010 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:12:27,011 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:12:27,086 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0028_000001 (auth:SIMPLE)
2015-03-13 10:12:27,086 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0028_000001 (auth:SIMPLE)
2015-03-13 10:12:27,089 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0028_01_000006 by user soberoi
2015-03-13 10:12:27,089 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0028_01_000004 by user soberoi
2015-03-13 10:12:27,089 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0028	CONTAINERID=container_1426266260362_0028_01_000006
2015-03-13 10:12:27,090 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0028_01_000005 by user soberoi
2015-03-13 10:12:27,090 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0028	CONTAINERID=container_1426266260362_0028_01_000005
2015-03-13 10:12:27,090 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0028_01_000003 by user soberoi
2015-03-13 10:12:27,090 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0028	CONTAINERID=container_1426266260362_0028_01_000003
2015-03-13 10:12:27,090 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0028_01_000002 by user soberoi
2015-03-13 10:12:27,089 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0028
2015-03-13 10:12:27,090 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0028_01_000005 to application application_1426266260362_0028
2015-03-13 10:12:27,090 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0028	CONTAINERID=container_1426266260362_0028_01_000004
2015-03-13 10:12:27,090 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0028	CONTAINERID=container_1426266260362_0028_01_000002
2015-03-13 10:12:27,090 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0028_01_000006 to application application_1426266260362_0028
2015-03-13 10:12:27,091 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:12:27,091 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0028
2015-03-13 10:12:27,091 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0028
2015-03-13 10:12:27,091 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:12:27,091 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0028
2015-03-13 10:12:27,091 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0028_01_000003 to application application_1426266260362_0028
2015-03-13 10:12:27,092 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0028_01_000002 to application application_1426266260362_0028
2015-03-13 10:12:27,092 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:12:27,092 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0028 transitioned from NEW to INITING
2015-03-13 10:12:27,092 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0028_01_000004 to application application_1426266260362_0028
2015-03-13 10:12:27,092 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0028 transitioned from INITING to RUNNING
2015-03-13 10:12:27,092 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:12:27,093 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:12:27,093 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:12:27,093 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:12:27,093 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0028
2015-03-13 10:12:27,093 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0028
2015-03-13 10:12:27,093 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:12:27,093 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0028
2015-03-13 10:12:27,093 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:12:27,093 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:12:27,093 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0028
2015-03-13 10:12:27,094 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0028
2015-03-13 10:12:27,094 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:12:27,094 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0028
2015-03-13 10:12:27,094 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0028
2015-03-13 10:12:27,094 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0028
2015-03-13 10:12:27,094 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:12:27,094 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0028
2015-03-13 10:12:27,094 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0028
2015-03-13 10:12:27,094 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0028
2015-03-13 10:12:27,094 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:12:27,094 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0028
2015-03-13 10:12:27,094 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0028_01_000005
2015-03-13 10:12:27,095 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0028_01_000002
2015-03-13 10:12:27,098 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0028_01_000003
2015-03-13 10:12:27,100 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0028_01_000004
2015-03-13 10:12:27,117 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1426266260362_0028_01_000005.tokens. Credentials list: 
2015-03-13 10:12:27,120 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1426266260362_0028_01_000002.tokens. Credentials list: 
2015-03-13 10:12:27,122 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0028_01_000004.tokens. Credentials list: 
2015-03-13 10:12:27,122 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426266260362_0028_01_000003.tokens. Credentials list: 
2015-03-13 10:12:27,132 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:12:27,133 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:27,136 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:12:27,161 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:27,161 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:27,161 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:27,161 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:27,162 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0027 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:12:27,162 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0028_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:12:27,162 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0028_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:12:27,162 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0028_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:12:27,162 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0027
2015-03-13 10:12:27,162 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0027
2015-03-13 10:12:27,162 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0028_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:12:27,163 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0027
2015-03-13 10:12:27,163 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0027
2015-03-13 10:12:27,163 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0027
2015-03-13 10:12:27,162 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0027 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:12:27,163 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0027, with delay of 10800 seconds
2015-03-13 10:12:27,205 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000006/default_container_executor.sh]
2015-03-13 10:12:27,213 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1426266260362_0028_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000005.tokens
2015-03-13 10:12:27,213 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0028 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0028
2015-03-13 10:12:27,285 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.jar	dst=null	perm=null
2015-03-13 10:12:27,286 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.jar	dst=null	perm=null
2015-03-13 10:12:27,286 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.jar	dst=null	perm=null
2015-03-13 10:12:27,293 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63236, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_83666383_15058, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742158_1334, duration: 526000
2015-03-13 10:12:27,317 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:12:27,335 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.xml	dst=null	perm=null
2015-03-13 10:12:27,336 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.xml	dst=null	perm=null
2015-03-13 10:12:27,337 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.xml	dst=null	perm=null
2015-03-13 10:12:27,343 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63237, bytes: 97225, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_83666383_15058, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742161_1337, duration: 305000
2015-03-13 10:12:27,362 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:12:27,362 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:12:27,362 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:12:27,362 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:12:27,362 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:12:27,430 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:12:27,430 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:12:27,430 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:12:27,430 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:27,430 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:27,430 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:27,437 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:12:27,437 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:27,548 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000002/default_container_executor.sh]
2015-03-13 10:12:27,548 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000003/default_container_executor.sh]
2015-03-13 10:12:27,557 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000005/default_container_executor.sh]
2015-03-13 10:12:27,582 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000004/default_container_executor.sh]
2015-03-13 10:12:27,767 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:27,767 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:27,767 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0027 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:12:27,767 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0028_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:12:27,768 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0027
2015-03-13 10:12:27,768 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0027 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:12:27,768 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0027, with delay of 10800 seconds
2015-03-13 10:12:27,768 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0027
2015-03-13 10:12:27,768 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0027
2015-03-13 10:12:27,768 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0027
2015-03-13 10:12:27,769 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0027
2015-03-13 10:12:27,976 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:12:28,167 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:28,167 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:28,167 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:28,167 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:28,401 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:12:28,547 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0028_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000004.tokens
2015-03-13 10:12:28,547 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0028 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0028
2015-03-13 10:12:28,649 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:12:28,768 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:28,768 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:28,783 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426266260362_0028_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000003.tokens
2015-03-13 10:12:28,783 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0028 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0028
2015-03-13 10:12:28,884 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:12:29,011 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1426266260362_0028_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000002.tokens
2015-03-13 10:12:29,012 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0028 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0028
2015-03-13 10:12:29,172 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:29,172 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:29,172 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:29,172 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:29,770 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:29,771 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:30,014 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742162_1338
2015-03-13 10:12:30,178 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:30,178 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:30,178 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:30,178 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:30,776 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:30,776 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:31,183 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:31,183 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:31,183 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:31,184 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:31,781 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:31,781 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:32,184 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:32,184 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:32,184 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:32,185 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:32,786 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:32,786 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:33,186 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:33,187 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:33,187 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:33,187 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:33,788 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:33,789 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:34,193 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:34,193 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:34,193 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:34,193 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:34,790 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:34,791 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:34,907 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.split	dst=null	perm=null
2015-03-13 10:12:35,078 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63247, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0028_m_000004_0_-1857110520_1, offset: 1024, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742159_1335, duration: 153000
2015-03-13 10:12:35,195 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:35,196 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:35,196 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:35,196 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:35,239 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.split	dst=null	perm=null
2015-03-13 10:12:35,252 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.split	dst=null	perm=null
2015-03-13 10:12:35,263 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:12:35,284 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63250, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0028_m_000004_0_-1857110520_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 146000
2015-03-13 10:12:35,301 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.split	dst=null	perm=null
2015-03-13 10:12:35,355 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/_temporary/attempt_1426266260362_0028_m_000004_0/part-00004	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:35,422 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63252, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0028_m_000000_0_1207470100_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742159_1335, duration: 148000
2015-03-13 10:12:35,441 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.split	dst=null	perm=null
2015-03-13 10:12:35,448 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63253, bytes: 1282, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0028_m_000002_0_1251486514_1, offset: 512, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742159_1335, duration: 165000
2015-03-13 10:12:35,490 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63255, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0028_m_000001_0_-2295557_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742159_1335, duration: 185000
2015-03-13 10:12:35,571 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:12:35,583 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63256, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0028_m_000003_0_1592380672_1, offset: 1024, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742159_1335, duration: 149000
2015-03-13 10:12:35,598 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:12:35,602 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63257, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0028_m_000002_0_1251486514_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 147000
2015-03-13 10:12:35,612 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/_temporary/attempt_1426266260362_0028_m_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:35,619 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:12:35,625 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63258, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0028_m_000001_0_-2295557_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 155000
2015-03-13 10:12:35,649 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/_temporary/attempt_1426266260362_0028_m_000002_0/part-00002	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:35,668 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/_temporary/attempt_1426266260362_0028_m_000001_0/part-00001	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:35,703 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/_temporary/attempt_1426266260362_0028_m_000004_0/part-00004. BP-1005356445-10.1.1.144-1426266257849 blk_1073742163_1339{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:12:35,712 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:12:35,718 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63260, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0028_m_000003_0_1592380672_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 146000
2015-03-13 10:12:35,746 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742163_1339 src: /127.0.0.1:63259 dest: /127.0.0.1:60686
2015-03-13 10:12:35,748 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742163_1339 src: /127.0.0.1:63261 dest: /127.0.0.1:60693
2015-03-13 10:12:35,749 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742163_1339 src: /127.0.0.1:63262 dest: /127.0.0.1:60696
2015-03-13 10:12:35,764 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63262, dest: /127.0.0.1:60696, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0028_m_000004_0_-1857110520_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742163_1339, duration: 13901000
2015-03-13 10:12:35,765 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742163_1339, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:35,765 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742163_1339{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:35,765 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63261, dest: /127.0.0.1:60693, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0028_m_000004_0_-1857110520_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742163_1339, duration: 14517000
2015-03-13 10:12:35,766 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742163_1339, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:35,766 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742163_1339{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:35,766 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63259, dest: /127.0.0.1:60686, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0028_m_000004_0_-1857110520_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742163_1339, duration: 15494000
2015-03-13 10:12:35,766 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742163_1339, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:35,767 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742163_1339{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:35,771 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/_temporary/attempt_1426266260362_0028_m_000004_0/part-00004 is closed by DFSClient_attempt_1426266260362_0028_m_000004_0_-1857110520_1
2015-03-13 10:12:35,783 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/_temporary/attempt_1426266260362_0028_m_000004_0	dst=null	perm=null
2015-03-13 10:12:35,791 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/_temporary/attempt_1426266260362_0028_m_000004_0	dst=null	perm=null
2015-03-13 10:12:35,792 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:35,792 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:35,792 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/task_1426266260362_0028_m_000004	dst=null	perm=null
2015-03-13 10:12:35,796 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/_temporary/attempt_1426266260362_0028_m_000004_0	dst=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/task_1426266260362_0028_m_000004	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:12:35,818 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0028_01_000006
2015-03-13 10:12:35,818 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0028	CONTAINERID=container_1426266260362_0028_01_000006
2015-03-13 10:12:35,818 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:12:35,818 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0028_01_000006
2015-03-13 10:12:35,818 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:35,818 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:12:35,820 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/_temporary/attempt_1426266260362_0028_m_000003_0/part-00003	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:35,826 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742163_1339
2015-03-13 10:12:35,831 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0028_01_000006 is : 143
2015-03-13 10:12:35,831 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job_1426266260362_0028_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073742164_1340{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:12:35,833 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742164_1340 src: /127.0.0.1:63263 dest: /127.0.0.1:60689
2015-03-13 10:12:35,834 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742164_1340 src: /127.0.0.1:63264 dest: /127.0.0.1:60696
2015-03-13 10:12:35,836 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742164_1340 src: /127.0.0.1:63265 dest: /127.0.0.1:60686
2015-03-13 10:12:35,840 INFO  hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job_1426266260362_0028_1.jhist for DFSClient_NONMAPREDUCE_308547630_1
2015-03-13 10:12:35,843 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:12:35,844 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000006
2015-03-13 10:12:35,844 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000006
2015-03-13 10:12:35,844 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000006
2015-03-13 10:12:35,844 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000006
2015-03-13 10:12:35,844 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0028	CONTAINERID=container_1426266260362_0028_01_000006
2015-03-13 10:12:35,845 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:12:35,845 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0028_01_000006 from application application_1426266260362_0028
2015-03-13 10:12:35,845 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:35,846 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0028
2015-03-13 10:12:35,973 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742163_1339
2015-03-13 10:12:36,034 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63266, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0028_m_000000_0_1207470100_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 156000
2015-03-13 10:12:36,053 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/_temporary/attempt_1426266260362_0028_m_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073742165_1341{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:12:36,091 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/_temporary/attempt_1426266260362_0028_m_000002_0/part-00002. BP-1005356445-10.1.1.144-1426266257849 blk_1073742166_1342{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:12:36,093 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742165_1341 src: /127.0.0.1:63267 dest: /127.0.0.1:60696
2015-03-13 10:12:36,095 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742165_1341 src: /127.0.0.1:63268 dest: /127.0.0.1:60686
2015-03-13 10:12:36,096 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742165_1341 src: /127.0.0.1:63270 dest: /127.0.0.1:60693
2015-03-13 10:12:36,104 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63270, dest: /127.0.0.1:60693, bytes: 114, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0028_m_000000_0_1207470100_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742165_1341, duration: 6108000
2015-03-13 10:12:36,104 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742165_1341, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:36,104 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742165_1341{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:36,104 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63268, dest: /127.0.0.1:60686, bytes: 114, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0028_m_000000_0_1207470100_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742165_1341, duration: 6936000
2015-03-13 10:12:36,105 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742165_1341, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:36,105 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742165_1341{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:36,105 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63267, dest: /127.0.0.1:60696, bytes: 114, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0028_m_000000_0_1207470100_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742165_1341, duration: 7889000
2015-03-13 10:12:36,106 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742165_1341, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:36,106 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742165_1341{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:36,110 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/_temporary/attempt_1426266260362_0028_m_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0028_m_000000_0_1207470100_1
2015-03-13 10:12:36,121 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/_temporary/attempt_1426266260362_0028_m_000000_0	dst=null	perm=null
2015-03-13 10:12:36,130 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/_temporary/attempt_1426266260362_0028_m_000000_0	dst=null	perm=null
2015-03-13 10:12:36,131 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/task_1426266260362_0028_m_000000	dst=null	perm=null
2015-03-13 10:12:36,135 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/_temporary/attempt_1426266260362_0028_m_000000_0	dst=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/task_1426266260362_0028_m_000000	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:12:36,135 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742166_1342 src: /127.0.0.1:63269 dest: /127.0.0.1:60686
2015-03-13 10:12:36,137 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742166_1342 src: /127.0.0.1:63271 dest: /127.0.0.1:60696
2015-03-13 10:12:36,138 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742166_1342 src: /127.0.0.1:63272 dest: /127.0.0.1:60689
2015-03-13 10:12:36,146 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63272, dest: /127.0.0.1:60689, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0028_m_000002_0_1251486514_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742166_1342, duration: 5987000
2015-03-13 10:12:36,146 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742166_1342, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:36,147 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63271, dest: /127.0.0.1:60696, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0028_m_000002_0_1251486514_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742166_1342, duration: 6818000
2015-03-13 10:12:36,147 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742166_1342, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:36,147 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742166_1342{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:12:36,148 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63269, dest: /127.0.0.1:60686, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0028_m_000002_0_1251486514_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742166_1342, duration: 7904000
2015-03-13 10:12:36,148 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742166_1342, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:36,148 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742166_1342{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:12:36,148 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742166_1342{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:12:36,153 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0028_01_000002
2015-03-13 10:12:36,153 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0028	CONTAINERID=container_1426266260362_0028_01_000002
2015-03-13 10:12:36,153 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/_temporary/attempt_1426266260362_0028_m_000002_0/part-00002 is closed by DFSClient_attempt_1426266260362_0028_m_000002_0_1251486514_1
2015-03-13 10:12:36,153 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:12:36,153 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0028_01_000002
2015-03-13 10:12:36,153 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:12:36,154 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:36,154 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:36,154 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:36,156 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/_temporary/attempt_1426266260362_0028_m_000001_0/part-00001. BP-1005356445-10.1.1.144-1426266257849 blk_1073742167_1343{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:12:36,166 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0028_01_000002 is : 143
2015-03-13 10:12:36,174 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/_temporary/attempt_1426266260362_0028_m_000002_0	dst=null	perm=null
2015-03-13 10:12:36,178 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:12:36,178 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000002
2015-03-13 10:12:36,178 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000002
2015-03-13 10:12:36,178 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000002
2015-03-13 10:12:36,179 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0028	CONTAINERID=container_1426266260362_0028_01_000002
2015-03-13 10:12:36,179 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:12:36,179 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0028_01_000002 from application application_1426266260362_0028
2015-03-13 10:12:36,179 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:36,179 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0028
2015-03-13 10:12:36,179 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000002
2015-03-13 10:12:36,183 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/_temporary/attempt_1426266260362_0028_m_000002_0	dst=null	perm=null
2015-03-13 10:12:36,184 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/task_1426266260362_0028_m_000002	dst=null	perm=null
2015-03-13 10:12:36,188 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/_temporary/attempt_1426266260362_0028_m_000002_0	dst=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/task_1426266260362_0028_m_000002	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:12:36,200 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0028_01_000004
2015-03-13 10:12:36,200 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0028	CONTAINERID=container_1426266260362_0028_01_000004
2015-03-13 10:12:36,200 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:12:36,200 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0028_01_000004
2015-03-13 10:12:36,200 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:12:36,200 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0028_01_000002
2015-03-13 10:12:36,200 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:36,201 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:12:36,201 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:36,201 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0028_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:12:36,201 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0028_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:12:36,201 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0028	CONTAINERID=container_1426266260362_0028_01_000002
2015-03-13 10:12:36,202 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0028_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:12:36,202 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:12:36,202 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0028_01_000002, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:36,202 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:36,202 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:12:36,202 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0028_000001 released container container_1426266260362_0028_01_000002 on node: host: 10.1.1.144:60719 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:12:36,210 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742167_1343 src: /127.0.0.1:63273 dest: /127.0.0.1:60693
2015-03-13 10:12:36,211 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742167_1343 src: /127.0.0.1:63274 dest: /127.0.0.1:60696
2015-03-13 10:12:36,212 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742167_1343 src: /127.0.0.1:63275 dest: /127.0.0.1:60689
2015-03-13 10:12:36,213 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0028_01_000004 is : 143
2015-03-13 10:12:36,220 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63275, dest: /127.0.0.1:60689, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0028_m_000001_0_-2295557_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742167_1343, duration: 6258000
2015-03-13 10:12:36,220 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742167_1343, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:36,221 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742167_1343{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:12:36,221 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63274, dest: /127.0.0.1:60696, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0028_m_000001_0_-2295557_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742167_1343, duration: 7390000
2015-03-13 10:12:36,221 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742167_1343, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:36,222 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63273, dest: /127.0.0.1:60693, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0028_m_000001_0_-2295557_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742167_1343, duration: 8114000
2015-03-13 10:12:36,222 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742167_1343, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:36,222 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742167_1343{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:12:36,223 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742167_1343{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:12:36,224 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:12:36,225 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000004
2015-03-13 10:12:36,225 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000004
2015-03-13 10:12:36,225 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0028	CONTAINERID=container_1426266260362_0028_01_000004
2015-03-13 10:12:36,225 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:12:36,226 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0028_01_000004 from application application_1426266260362_0028
2015-03-13 10:12:36,225 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000004
2015-03-13 10:12:36,226 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:36,226 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0028
2015-03-13 10:12:36,226 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000004
2015-03-13 10:12:36,230 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/_temporary/attempt_1426266260362_0028_m_000001_0/part-00001 is closed by DFSClient_attempt_1426266260362_0028_m_000001_0_-2295557_1
2015-03-13 10:12:36,238 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/_temporary/attempt_1426266260362_0028_m_000001_0	dst=null	perm=null
2015-03-13 10:12:36,244 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/_temporary/attempt_1426266260362_0028_m_000001_0	dst=null	perm=null
2015-03-13 10:12:36,245 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/task_1426266260362_0028_m_000001	dst=null	perm=null
2015-03-13 10:12:36,247 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/_temporary/attempt_1426266260362_0028_m_000001_0	dst=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/task_1426266260362_0028_m_000001	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:12:36,255 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0028_01_000003
2015-03-13 10:12:36,255 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0028	CONTAINERID=container_1426266260362_0028_01_000003
2015-03-13 10:12:36,255 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:12:36,256 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0028_01_000003
2015-03-13 10:12:36,256 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:12:36,256 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:12:36,256 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0028_01_000004
2015-03-13 10:12:36,256 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:36,256 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0028_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:12:36,257 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0028_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:12:36,257 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0028	CONTAINERID=container_1426266260362_0028_01_000004
2015-03-13 10:12:36,257 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0028_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:12:36,257 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:12:36,257 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0028_01_000004, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:36,257 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:36,257 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:12:36,257 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0028_000001 released container container_1426266260362_0028_01_000004 on node: host: 10.1.1.144:60719 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:12:36,267 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/_temporary/attempt_1426266260362_0028_m_000003_0/part-00003. BP-1005356445-10.1.1.144-1426266257849 blk_1073742168_1344{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:12:36,268 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0028_01_000003 is : 143
2015-03-13 10:12:36,279 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:12:36,280 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000003
2015-03-13 10:12:36,280 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0028	CONTAINERID=container_1426266260362_0028_01_000003
2015-03-13 10:12:36,280 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:12:36,280 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0028_01_000003 from application application_1426266260362_0028
2015-03-13 10:12:36,280 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:36,280 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0028
2015-03-13 10:12:36,280 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000003
2015-03-13 10:12:36,281 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000003
2015-03-13 10:12:36,281 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000003
2015-03-13 10:12:36,305 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742168_1344 src: /127.0.0.1:63276 dest: /127.0.0.1:60696
2015-03-13 10:12:36,306 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742168_1344 src: /127.0.0.1:63277 dest: /127.0.0.1:60689
2015-03-13 10:12:36,307 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742168_1344 src: /127.0.0.1:63278 dest: /127.0.0.1:60693
2015-03-13 10:12:36,314 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63278, dest: /127.0.0.1:60693, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0028_m_000003_0_1592380672_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742168_1344, duration: 5835000
2015-03-13 10:12:36,314 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742168_1344, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:36,315 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742168_1344{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:36,315 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63277, dest: /127.0.0.1:60689, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0028_m_000003_0_1592380672_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742168_1344, duration: 6561000
2015-03-13 10:12:36,315 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742168_1344, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:36,316 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742168_1344{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:36,316 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63276, dest: /127.0.0.1:60696, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0028_m_000003_0_1592380672_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742168_1344, duration: 7417000
2015-03-13 10:12:36,316 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742168_1344, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:36,316 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742168_1344{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:36,320 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/_temporary/attempt_1426266260362_0028_m_000003_0/part-00003 is closed by DFSClient_attempt_1426266260362_0028_m_000003_0_1592380672_1
2015-03-13 10:12:36,332 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/_temporary/attempt_1426266260362_0028_m_000003_0	dst=null	perm=null
2015-03-13 10:12:36,343 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/_temporary/attempt_1426266260362_0028_m_000003_0	dst=null	perm=null
2015-03-13 10:12:36,344 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/task_1426266260362_0028_m_000003	dst=null	perm=null
2015-03-13 10:12:36,351 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/_temporary/attempt_1426266260362_0028_m_000003_0	dst=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/task_1426266260362_0028_m_000003	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:12:36,361 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0028_01_000005
2015-03-13 10:12:36,361 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0028	CONTAINERID=container_1426266260362_0028_01_000005
2015-03-13 10:12:36,361 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:12:36,361 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0028_01_000005
2015-03-13 10:12:36,361 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:12:36,361 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0028_01_000003
2015-03-13 10:12:36,361 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:12:36,362 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0028_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:12:36,362 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0028_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:12:36,362 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0028	CONTAINERID=container_1426266260362_0028_01_000003
2015-03-13 10:12:36,362 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0028_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:12:36,362 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:12:36,362 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0028_01_000003, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:36,362 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:36,362 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:12:36,362 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0028_000001 released container container_1426266260362_0028_01_000003 on node: host: 10.1.1.144:60719 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:12:36,366 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:36,368 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_308547630_1
2015-03-13 10:12:36,372 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1	dst=null	perm=null
2015-03-13 10:12:36,373 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0028_01_000005 is : 143
2015-03-13 10:12:36,379 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5	dst=null	perm=null
2015-03-13 10:12:36,380 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5	dst=null	perm=null
2015-03-13 10:12:36,381 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/task_1426266260362_0028_m_000000	dst=null	perm=null
2015-03-13 10:12:36,382 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/part-00000	dst=null	perm=null
2015-03-13 10:12:36,384 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:12:36,384 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000005
2015-03-13 10:12:36,385 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/task_1426266260362_0028_m_000000/part-00000	dst=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/part-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:36,385 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000005
2015-03-13 10:12:36,385 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000005
2015-03-13 10:12:36,386 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000005
2015-03-13 10:12:36,386 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0028	CONTAINERID=container_1426266260362_0028_01_000005
2015-03-13 10:12:36,386 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:12:36,387 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0028_01_000005 from application application_1426266260362_0028
2015-03-13 10:12:36,387 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:36,387 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0028
2015-03-13 10:12:36,388 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5	dst=null	perm=null
2015-03-13 10:12:36,389 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5	dst=null	perm=null
2015-03-13 10:12:36,389 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/task_1426266260362_0028_m_000001	dst=null	perm=null
2015-03-13 10:12:36,390 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/part-00001	dst=null	perm=null
2015-03-13 10:12:36,392 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/task_1426266260362_0028_m_000001/part-00001	dst=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/part-00001	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:36,392 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5	dst=null	perm=null
2015-03-13 10:12:36,393 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5	dst=null	perm=null
2015-03-13 10:12:36,393 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/task_1426266260362_0028_m_000002	dst=null	perm=null
2015-03-13 10:12:36,394 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/part-00002	dst=null	perm=null
2015-03-13 10:12:36,395 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/task_1426266260362_0028_m_000002/part-00002	dst=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/part-00002	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:36,396 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5	dst=null	perm=null
2015-03-13 10:12:36,397 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5	dst=null	perm=null
2015-03-13 10:12:36,397 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/task_1426266260362_0028_m_000003	dst=null	perm=null
2015-03-13 10:12:36,398 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/part-00003	dst=null	perm=null
2015-03-13 10:12:36,399 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/task_1426266260362_0028_m_000003/part-00003	dst=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/part-00003	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:36,400 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5	dst=null	perm=null
2015-03-13 10:12:36,401 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5	dst=null	perm=null
2015-03-13 10:12:36,401 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/task_1426266260362_0028_m_000004	dst=null	perm=null
2015-03-13 10:12:36,402 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/part-00004	dst=null	perm=null
2015-03-13 10:12:36,403 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/task_1426266260362_0028_m_000004/part-00004	dst=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/part-00004	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:36,406 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary	dst=null	perm=null
2015-03-13 10:12:36,410 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:36,412 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_SUCCESS is closed by DFSClient_NONMAPREDUCE_308547630_1
2015-03-13 10:12:36,414 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:36,415 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_308547630_1
2015-03-13 10:12:36,429 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63265, dest: /127.0.0.1:60686, bytes: 53312, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_308547630_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742164_1340, duration: 591891000
2015-03-13 10:12:36,429 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742164_1340, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:36,430 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742164_1340{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:12:36,430 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63264, dest: /127.0.0.1:60696, bytes: 53312, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_308547630_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742164_1340, duration: 593022000
2015-03-13 10:12:36,431 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742164_1340, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:36,432 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742164_1340{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:12:36,432 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63263, dest: /127.0.0.1:60689, bytes: 53312, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_308547630_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742164_1340, duration: 594584000
2015-03-13 10:12:36,432 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742164_1340, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:36,432 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742164_1340{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:12:36,434 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job_1426266260362_0028_1.jhist is closed by DFSClient_NONMAPREDUCE_308547630_1
2015-03-13 10:12:36,439 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0028.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:36,442 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0028.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742169_1345{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:12:36,443 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742169_1345 src: /127.0.0.1:63279 dest: /127.0.0.1:60693
2015-03-13 10:12:36,445 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742169_1345 src: /127.0.0.1:63280 dest: /127.0.0.1:60686
2015-03-13 10:12:36,446 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742169_1345 src: /127.0.0.1:63281 dest: /127.0.0.1:60696
2015-03-13 10:12:36,448 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63281, dest: /127.0.0.1:60696, bytes: 419, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_308547630_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742169_1345, duration: 1133000
2015-03-13 10:12:36,448 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742169_1345, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:36,449 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742169_1345{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:36,449 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63280, dest: /127.0.0.1:60686, bytes: 419, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_308547630_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742169_1345, duration: 1588000
2015-03-13 10:12:36,449 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742169_1345, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:36,449 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742169_1345{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:36,449 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63279, dest: /127.0.0.1:60693, bytes: 419, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_308547630_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742169_1345, duration: 2273000
2015-03-13 10:12:36,450 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742169_1345, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:36,450 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742169_1345{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:36,451 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0028.summary_tmp is closed by DFSClient_NONMAPREDUCE_308547630_1
2015-03-13 10:12:36,454 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0028.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:12:36,459 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job_1426266260362_0028_1.jhist	dst=null	perm=null
2015-03-13 10:12:36,461 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0028-1426266741548-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2F31E34ADFFB5F45C1-1426266756416-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:12:36,465 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job_1426266260362_0028_1.jhist	dst=null	perm=null
2015-03-13 10:12:36,466 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0028-1426266741548-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2F31E34ADFFB5F45C1-1426266756416-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:12:36,468 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job_1426266260362_0028_1.jhist	dst=null	perm=null
2015-03-13 10:12:36,471 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0028-1426266741548-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2F31E34ADFFB5F45C1-1426266756416-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:36,474 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63282, bytes: 53732, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_308547630_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742164_1340, duration: 188000
2015-03-13 10:12:36,476 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0028-1426266741548-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2F31E34ADFFB5F45C1-1426266756416-5-0-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742170_1346{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:12:36,478 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742170_1346 src: /127.0.0.1:63283 dest: /127.0.0.1:60696
2015-03-13 10:12:36,479 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742170_1346 src: /127.0.0.1:63284 dest: /127.0.0.1:60686
2015-03-13 10:12:36,480 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742170_1346 src: /127.0.0.1:63285 dest: /127.0.0.1:60689
2015-03-13 10:12:36,484 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63285, dest: /127.0.0.1:60689, bytes: 53312, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_308547630_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742170_1346, duration: 1890000
2015-03-13 10:12:36,484 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742170_1346, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:36,484 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742170_1346{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:12:36,484 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63284, dest: /127.0.0.1:60686, bytes: 53312, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_308547630_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742170_1346, duration: 2505000
2015-03-13 10:12:36,485 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742170_1346, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:36,485 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742170_1346{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:12:36,485 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63283, dest: /127.0.0.1:60696, bytes: 53312, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_308547630_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742170_1346, duration: 3277000
2015-03-13 10:12:36,485 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742170_1346, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:36,486 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742170_1346{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:12:36,487 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0028-1426266741548-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2F31E34ADFFB5F45C1-1426266756416-5-0-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_308547630_1
2015-03-13 10:12:36,488 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0028-1426266741548-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2F31E34ADFFB5F45C1-1426266756416-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:12:36,489 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job_1426266260362_0028_1_conf.xml	dst=null	perm=null
2015-03-13 10:12:36,490 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0028_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:12:36,491 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job_1426266260362_0028_1_conf.xml	dst=null	perm=null
2015-03-13 10:12:36,491 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0028_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:12:36,492 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job_1426266260362_0028_1_conf.xml	dst=null	perm=null
2015-03-13 10:12:36,496 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0028_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:36,498 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63282, bytes: 90073, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_308547630_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742162_1338, duration: 268000
2015-03-13 10:12:36,499 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0028_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742171_1347{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:12:36,501 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742171_1347 src: /127.0.0.1:63286 dest: /127.0.0.1:60689
2015-03-13 10:12:36,502 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742171_1347 src: /127.0.0.1:63287 dest: /127.0.0.1:60693
2015-03-13 10:12:36,504 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742171_1347 src: /127.0.0.1:63288 dest: /127.0.0.1:60696
2015-03-13 10:12:36,506 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63288, dest: /127.0.0.1:60696, bytes: 89373, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_308547630_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742171_1347, duration: 1498000
2015-03-13 10:12:36,507 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742171_1347, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:36,507 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742171_1347{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:36,507 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63287, dest: /127.0.0.1:60693, bytes: 89373, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_308547630_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742171_1347, duration: 2213000
2015-03-13 10:12:36,507 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742171_1347, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:36,508 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742171_1347{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:36,508 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63286, dest: /127.0.0.1:60689, bytes: 89373, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_308547630_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742171_1347, duration: 2897000
2015-03-13 10:12:36,508 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742171_1347, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:36,509 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742171_1347{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:36,510 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0028_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_308547630_1
2015-03-13 10:12:36,511 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0028_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:12:36,513 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0028.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0028.summary	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:12:36,515 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0028_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0028_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:12:36,517 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0028-1426266741548-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2F31E34ADFFB5F45C1-1426266756416-5-0-SUCCEEDED-default.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0028-1426266741548-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2F31E34ADFFB5F45C1-1426266756416-5-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:12:36,524 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0028_000001 State change from RUNNING to FINISHING
2015-03-13 10:12:36,524 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0028
2015-03-13 10:12:36,524 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0028 State change from RUNNING to REMOVING
2015-03-13 10:12:36,524 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0028
2015-03-13 10:12:36,525 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0028 State change from REMOVING to FINISHING
2015-03-13 10:12:36,567 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742163_1339
2015-03-13 10:12:36,568 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742169_1345
2015-03-13 10:12:36,568 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742167_1343
2015-03-13 10:12:36,568 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742164_1340
2015-03-13 10:12:36,569 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742171_1347
2015-03-13 10:12:36,569 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742166_1342
2015-03-13 10:12:36,570 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742170_1346
2015-03-13 10:12:36,570 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742165_1341
2015-03-13 10:12:36,570 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742168_1344
2015-03-13 10:12:36,819 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:36,820 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:12:36,820 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0028_01_000006
2015-03-13 10:12:36,820 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0028_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:12:36,820 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0028_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:12:36,821 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0028	CONTAINERID=container_1426266260362_0028_01_000006
2015-03-13 10:12:36,821 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0028_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:12:36,821 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:12:36,821 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0028_01_000006, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:36,821 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:36,821 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:12:36,822 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0028_000001 released container container_1426266260362_0028_01_000006 on node: host: 10.1.1.144:60723 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:12:37,362 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:12:37,362 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0028_01_000005
2015-03-13 10:12:37,362 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0028_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:12:37,362 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0028_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:12:37,363 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0028	CONTAINERID=container_1426266260362_0028_01_000005
2015-03-13 10:12:37,363 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0028_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:12:37,363 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:12:37,363 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0028_01_000005, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:37,363 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:37,363 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:12:37,363 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0028_000001 released container container_1426266260362_0028_01_000005 on node: host: 10.1.1.144:60719 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:12:37,536 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742158_1334 127.0.0.1:60689 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60686 
2015-03-13 10:12:37,536 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742159_1335 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60693 127.0.0.1:60686 
2015-03-13 10:12:37,537 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742160_1336 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60686 
2015-03-13 10:12:37,537 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742161_1337 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60686 
2015-03-13 10:12:37,537 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742164_1340 127.0.0.1:60689 127.0.0.1:60696 127.0.0.1:60686 
2015-03-13 10:12:37,537 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742162_1338 127.0.0.1:60689 127.0.0.1:60693 127.0.0.1:60696 
2015-03-13 10:12:37,537 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028	dst=null	perm=null
2015-03-13 10:12:37,562 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper1*upper2] starting step: (2/3)
2015-03-13 10:12:37,571 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:12:37,578 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:12:37,580 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5	dst=null	perm=null
2015-03-13 10:12:37,581 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:12:37,582 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:12:37,584 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 29
2015-03-13 10:12:37,584 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029	dst=null	perm=null
2015-03-13 10:12:37,585 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029	dst=null	perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:12:37,586 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029	dst=null	perm=soberoi:supergroup:rwx------
2015-03-13 10:12:37,587 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.jar	dst=null	perm=null
2015-03-13 10:12:37,588 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:37,589 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073742172_1348{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:12:37,590 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742172_1348 src: /127.0.0.1:63292 dest: /127.0.0.1:60696
2015-03-13 10:12:37,591 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742172_1348 src: /127.0.0.1:63293 dest: /127.0.0.1:60693
2015-03-13 10:12:37,592 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742172_1348 src: /127.0.0.1:63294 dest: /127.0.0.1:60686
2015-03-13 10:12:37,596 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63294, dest: /127.0.0.1:60686, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742172_1348, duration: 2524000
2015-03-13 10:12:37,596 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742172_1348, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:37,596 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742172_1348{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:12:37,597 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63293, dest: /127.0.0.1:60693, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742172_1348, duration: 2680000
2015-03-13 10:12:37,597 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742172_1348, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:37,597 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742172_1348{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:12:37,597 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63292, dest: /127.0.0.1:60696, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742172_1348, duration: 3421000
2015-03-13 10:12:37,597 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742172_1348, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:37,598 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742172_1348{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:12:37,599 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:12:37,600 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.jar
2015-03-13 10:12:37,600 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.jar	dst=null	perm=null
2015-03-13 10:12:37,601 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:37,602 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:12:37,602 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:12:37,603 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:12:37,603 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:12:37,604 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:12:37,604 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:12:37,605 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:12:37,605 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:12:37,606 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:12:37,607 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5	dst=null	perm=null
2015-03-13 10:12:37,608 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5	dst=null	perm=null
2015-03-13 10:12:37,608 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5	dst=null	perm=null
2015-03-13 10:12:37,610 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:12:37,611 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:37,613 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:37,614 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.split
2015-03-13 10:12:37,614 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.split	dst=null	perm=null
2015-03-13 10:12:37,615 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073742173_1349{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:12:37,617 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742173_1349 src: /127.0.0.1:63295 dest: /127.0.0.1:60693
2015-03-13 10:12:37,618 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742173_1349 src: /127.0.0.1:63296 dest: /127.0.0.1:60686
2015-03-13 10:12:37,619 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742173_1349 src: /127.0.0.1:63297 dest: /127.0.0.1:60689
2015-03-13 10:12:37,621 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742173_1349 src: /127.0.0.1:63298 dest: /127.0.0.1:60696
2015-03-13 10:12:37,624 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63298, dest: /127.0.0.1:60696, bytes: 1737, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742173_1349, duration: 1527000
2015-03-13 10:12:37,624 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742173_1349, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:37,624 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742173_1349{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:37,624 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63297, dest: /127.0.0.1:60689, bytes: 1737, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742173_1349, duration: 1973000
2015-03-13 10:12:37,624 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742173_1349, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:37,625 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742173_1349{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:37,625 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63296, dest: /127.0.0.1:60686, bytes: 1737, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742173_1349, duration: 2865000
2015-03-13 10:12:37,625 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742173_1349, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:37,626 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742173_1349{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:37,626 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63295, dest: /127.0.0.1:60693, bytes: 1737, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742173_1349, duration: 3609000
2015-03-13 10:12:37,626 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742173_1349, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:37,627 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742173_1349{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:37,628 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:12:37,629 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:37,630 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:37,631 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073742174_1350{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:12:37,633 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742174_1350 src: /127.0.0.1:63299 dest: /127.0.0.1:60689
2015-03-13 10:12:37,634 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742174_1350 src: /127.0.0.1:63300 dest: /127.0.0.1:60686
2015-03-13 10:12:37,635 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742174_1350 src: /127.0.0.1:63301 dest: /127.0.0.1:60693
2015-03-13 10:12:37,637 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63301, dest: /127.0.0.1:60693, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742174_1350, duration: 1182000
2015-03-13 10:12:37,637 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742174_1350, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:37,638 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742174_1350{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:37,638 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63300, dest: /127.0.0.1:60686, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742174_1350, duration: 1649000
2015-03-13 10:12:37,638 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742174_1350, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:37,638 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742174_1350{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:37,639 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63299, dest: /127.0.0.1:60689, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742174_1350, duration: 2331000
2015-03-13 10:12:37,639 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742174_1350, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:37,639 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742174_1350{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:37,640 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:12:37,640 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:12:37,641 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:37,643 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:37,644 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:12:37,644 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:12:37,644 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:12:37,647 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742175_1351{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:12:37,648 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742175_1351 src: /127.0.0.1:63302 dest: /127.0.0.1:60696
2015-03-13 10:12:37,650 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742175_1351 src: /127.0.0.1:63303 dest: /127.0.0.1:60693
2015-03-13 10:12:37,651 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742175_1351 src: /127.0.0.1:63304 dest: /127.0.0.1:60686
2015-03-13 10:12:37,653 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63304, dest: /127.0.0.1:60686, bytes: 97792, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742175_1351, duration: 1453000
2015-03-13 10:12:37,653 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742175_1351, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:37,654 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742175_1351{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:12:37,654 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63303, dest: /127.0.0.1:60693, bytes: 97792, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742175_1351, duration: 1721000
2015-03-13 10:12:37,654 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742175_1351, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:37,654 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742175_1351{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:12:37,655 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63302, dest: /127.0.0.1:60696, bytes: 97792, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742175_1351, duration: 2393000
2015-03-13 10:12:37,655 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742175_1351, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:37,655 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742175_1351{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:12:37,656 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:12:37,656 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0029
2015-03-13 10:12:37,657 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029	dst=null	perm=null
2015-03-13 10:12:37,658 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.xml	dst=null	perm=null
2015-03-13 10:12:37,658 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.xml	dst=null	perm=null
2015-03-13 10:12:37,659 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.jar	dst=null	perm=null
2015-03-13 10:12:37,659 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.jar	dst=null	perm=null
2015-03-13 10:12:37,660 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.split	dst=null	perm=null
2015-03-13 10:12:37,660 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.split	dst=null	perm=null
2015-03-13 10:12:37,661 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:12:37,661 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:12:37,663 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:12:37,664 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:12:37,664 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:12:37,665 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:12:37,665 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:12:37,666 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:12:37,667 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 29 submitted by user soberoi
2015-03-13 10:12:37,667 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0029
2015-03-13 10:12:37,667 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0029 State change from NEW to NEW_SAVING
2015-03-13 10:12:37,667 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0029
2015-03-13 10:12:37,667 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	IP=10.1.1.144	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1426266260362_0029
2015-03-13 10:12:37,668 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0029 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:12:37,668 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0029_000001
2015-03-13 10:12:37,668 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0029_000001 State change from NEW to SUBMITTED
2015-03-13 10:12:37,668 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0029 from user: soberoi activated in queue: default
2015-03-13 10:12:37,668 INFO  capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0029 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:12:37,668 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0029 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:12:37,668 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0029 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:12:37,669 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0029_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:12:37,669 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0029_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:12:37,670 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0029 State change from SUBMITTED to ACCEPTED
2015-03-13 10:12:37,671 INFO  mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0029/
2015-03-13 10:12:37,672 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper1*upper2] submitted hadoop job: job_1426266260362_0029
2015-03-13 10:12:37,672 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper1*upper2] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0029/
2015-03-13 10:12:37,789 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0029_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:12:37,789 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0029	CONTAINERID=container_1426266260362_0029_01_000001
2015-03-13 10:12:37,789 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0029_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:12:37,790 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0029 container=Container: [ContainerId: container_1426266260362_0029_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0029_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:37,790 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:12:37,790 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0029_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:12:37,790 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:37,791 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0029 AttemptId: appattempt_1426266260362_0029_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0029_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ]
2015-03-13 10:12:37,791 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0029_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:12:37,791 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0029_000001
2015-03-13 10:12:37,791 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0029_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:12:37,791 INFO  amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0029_000001
2015-03-13 10:12:37,792 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0029_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] for AM appattempt_1426266260362_0029_000001
2015-03-13 10:12:37,792 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0029_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-03-13 10:12:37,794 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0029_000001 (auth:SIMPLE)
2015-03-13 10:12:37,795 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0029_01_000001 by user soberoi
2015-03-13 10:12:37,795 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0029
2015-03-13 10:12:37,795 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0029	CONTAINERID=container_1426266260362_0029_01_000001
2015-03-13 10:12:37,795 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0029 transitioned from NEW to INITING
2015-03-13 10:12:37,796 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0029_01_000001 to application application_1426266260362_0029
2015-03-13 10:12:37,796 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0029 transitioned from INITING to RUNNING
2015-03-13 10:12:37,796 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0029_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] for AM appattempt_1426266260362_0029_000001
2015-03-13 10:12:37,796 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0029_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:12:37,796 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:12:37,796 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0029
2015-03-13 10:12:37,796 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:12:37,796 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:12:37,796 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:12:37,797 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:12:37,797 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0029_01_000001
2015-03-13 10:12:37,813 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0029_01_000001.tokens. Credentials list: 
2015-03-13 10:12:37,820 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:37,829 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:12:37,899 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0029_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000001.tokens
2015-03-13 10:12:37,899 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0029 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0029
2015-03-13 10:12:37,960 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.jar	dst=null	perm=null
2015-03-13 10:12:37,961 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.jar	dst=null	perm=null
2015-03-13 10:12:37,962 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.jar	dst=null	perm=null
2015-03-13 10:12:37,968 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63308, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1180023147_15416, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742172_1348, duration: 492000
2015-03-13 10:12:37,987 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:12:38,003 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:12:38,004 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:12:38,004 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:12:38,011 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63309, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1180023147_15416, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742174_1350, duration: 159000
2015-03-13 10:12:38,023 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:12:38,039 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.split	dst=null	perm=null
2015-03-13 10:12:38,040 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.split	dst=null	perm=null
2015-03-13 10:12:38,041 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.split	dst=null	perm=null
2015-03-13 10:12:38,046 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63308, bytes: 1753, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1180023147_15416, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742173_1349, duration: 149000
2015-03-13 10:12:38,059 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:12:38,078 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.xml	dst=null	perm=null
2015-03-13 10:12:38,079 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.xml	dst=null	perm=null
2015-03-13 10:12:38,079 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.xml	dst=null	perm=null
2015-03-13 10:12:38,086 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63310, bytes: 98556, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1180023147_15416, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742175_1351, duration: 269000
2015-03-13 10:12:38,100 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:12:38,100 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:12:38,128 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:12:38,128 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:38,197 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000001/default_container_executor.sh]
2015-03-13 10:12:38,790 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:38,791 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0029_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:12:38,821 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:39,745 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:12:39,766 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/COMMIT_STARTED	dst=null	perm=null
2015-03-13 10:12:39,767 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/COMMIT_SUCCESS	dst=null	perm=null
2015-03-13 10:12:39,768 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/COMMIT_FAIL	dst=null	perm=null
2015-03-13 10:12:39,792 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:39,821 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:39,822 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029	dst=null	perm=null
2015-03-13 10:12:39,823 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:12:39,824 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:12:40,020 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742170_1346
2015-03-13 10:12:40,021 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742166_1342
2015-03-13 10:12:40,021 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742168_1344
2015-03-13 10:12:40,021 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742171_1347
2015-03-13 10:12:40,022 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742174_1350
2015-03-13 10:12:40,022 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742167_1343
2015-03-13 10:12:40,022 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742173_1349
2015-03-13 10:12:40,023 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742164_1340
2015-03-13 10:12:40,084 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60693 to replicate blk_1073742172_1348 to datanode(s) 127.0.0.1:60689
2015-03-13 10:12:40,084 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073742160_1336, blk_1073742162_1338, blk_1073742164_1340, blk_1073742158_1334, blk_1073742159_1335]
2015-03-13 10:12:40,085 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073742160_1336, blk_1073742161_1337, blk_1073742164_1340, blk_1073742158_1334, blk_1073742159_1335]
2015-03-13 10:12:40,112 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:12:40,119 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:12:40,175 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63312, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_2012353289_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742174_1350, duration: 185000
2015-03-13 10:12:40,643 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742160_1336 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742160 for deletion
2015-03-13 10:12:40,643 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742160_1336 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742160 for deletion
2015-03-13 10:12:40,643 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742162_1338 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742162 for deletion
2015-03-13 10:12:40,643 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742164_1340 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742164 for deletion
2015-03-13 10:12:40,643 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742160_1336 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742160
2015-03-13 10:12:40,643 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742161_1337 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742161 for deletion
2015-03-13 10:12:40,644 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742164_1340 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742164 for deletion
2015-03-13 10:12:40,644 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742158_1334 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742158 for deletion
2015-03-13 10:12:40,644 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742159_1335 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742159 for deletion
2015-03-13 10:12:40,644 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742160_1336 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742160
2015-03-13 10:12:40,644 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742162_1338 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742162
2015-03-13 10:12:40,643 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742158_1334 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742158 for deletion
2015-03-13 10:12:40,644 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742164_1340 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742164
2015-03-13 10:12:40,644 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742158_1334 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742158
2015-03-13 10:12:40,644 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742161_1337 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742161
2015-03-13 10:12:40,644 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742159_1335 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742159 for deletion
2015-03-13 10:12:40,645 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742159_1335 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742159
2015-03-13 10:12:40,645 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742159_1335 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742159
2015-03-13 10:12:40,644 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742164_1340 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742164
2015-03-13 10:12:40,645 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742158_1334 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742158
2015-03-13 10:12:40,792 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:40,826 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:40,830 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742173_1349
2015-03-13 10:12:40,830 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742174_1350
2015-03-13 10:12:40,831 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742167_1343
2015-03-13 10:12:40,831 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742169_1345
2015-03-13 10:12:40,831 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742165_1341
2015-03-13 10:12:40,832 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742171_1347
2015-03-13 10:12:40,863 INFO  datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-1589780806-10.1.1.144-60693-1426266259390, infoPort=60694, ipcPort=60695, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073742172_1348 to 127.0.0.1:60689 
2015-03-13 10:12:40,865 INFO  datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073742172_1348 (numBytes=254067) to /127.0.0.1:60689
2015-03-13 10:12:40,866 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742172_1348 src: /127.0.0.1:63315 dest: /127.0.0.1:60689
2015-03-13 10:12:40,867 INFO  datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073742172_1348 src: /127.0.0.1:63315 dest: /127.0.0.1:60689 of size 254067
2015-03-13 10:12:40,868 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742172_1348 size 254067
2015-03-13 10:12:40,926 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0029_000001 (auth:SIMPLE)
2015-03-13 10:12:40,928 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0029_000001
2015-03-13 10:12:40,928 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi	IP=10.1.1.144	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1426266260362_0029	APPATTEMPTID=appattempt_1426266260362_0029_000001
2015-03-13 10:12:40,928 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0029_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:12:40,928 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0029 State change from ACCEPTED to RUNNING
2015-03-13 10:12:40,948 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job_1426266260362_0029_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:40,950 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:12:40,976 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742169_1345
2015-03-13 10:12:40,976 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742173_1349
2015-03-13 10:12:40,977 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742165_1341
2015-03-13 10:12:40,977 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742175_1351
2015-03-13 10:12:40,979 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742172_1348
2015-03-13 10:12:40,979 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742174_1350
2015-03-13 10:12:40,979 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742166_1342
2015-03-13 10:12:41,025 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job_1426266260362_0029_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:41,037 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742172_1348
2015-03-13 10:12:41,134 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job_1426266260362_0029_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742176_1352{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:12:41,170 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742176_1352 src: /127.0.0.1:63319 dest: /127.0.0.1:60686
2015-03-13 10:12:41,171 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742176_1352 src: /127.0.0.1:63320 dest: /127.0.0.1:60693
2015-03-13 10:12:41,173 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742176_1352 src: /127.0.0.1:63321 dest: /127.0.0.1:60689
2015-03-13 10:12:41,180 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742170_1346
2015-03-13 10:12:41,181 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63321, dest: /127.0.0.1:60689, bytes: 90741, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2012353289_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742176_1352, duration: 6395000
2015-03-13 10:12:41,181 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742176_1352, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:41,183 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63320, dest: /127.0.0.1:60693, bytes: 90741, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2012353289_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742176_1352, duration: 8537000
2015-03-13 10:12:41,183 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742176_1352, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:41,183 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742176_1352{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:12:41,185 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63319, dest: /127.0.0.1:60686, bytes: 90741, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2012353289_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742176_1352, duration: 9940000
2015-03-13 10:12:41,185 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742176_1352{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:12:41,185 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742176_1352, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:41,185 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742176_1352{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:12:41,189 INFO  namenode.FSEditLog (FSEditLog.java:printStatistics(663)) - Number of transactions: 2954 Total time for transactions(ms): 131 Number of transactions batched in Syncs: 5 Number of syncs: 1683 SyncTimes(ms): 475 382 
2015-03-13 10:12:41,189 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job_1426266260362_0029_1_conf.xml is closed by DFSClient_NONMAPREDUCE_2012353289_1
2015-03-13 10:12:41,234 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742175_1351
2015-03-13 10:12:41,235 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742176_1352
2015-03-13 10:12:41,235 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742168_1344
2015-03-13 10:12:41,577 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742175_1351
2015-03-13 10:12:41,577 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742173_1349
2015-03-13 10:12:41,781 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742172_1348
2015-03-13 10:12:41,793 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:41,832 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:42,375 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0029_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:12:42,376 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0029	CONTAINERID=container_1426266260362_0029_01_000002
2015-03-13 10:12:42,376 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0029_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:12:42,376 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0029 container=Container: [ContainerId: container_1426266260362_0029_01_000002, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0029_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:42,376 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:12:42,376 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:42,377 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0029_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:12:42,377 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0029	CONTAINERID=container_1426266260362_0029_01_000003
2015-03-13 10:12:42,377 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0029_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:12:42,378 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0029 container=Container: [ContainerId: container_1426266260362_0029_01_000003, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0029_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:42,378 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:12:42,378 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:42,379 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0029_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:12:42,379 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0029	CONTAINERID=container_1426266260362_0029_01_000004
2015-03-13 10:12:42,379 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0029_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:12:42,379 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0029 container=Container: [ContainerId: container_1426266260362_0029_01_000004, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0029_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:42,379 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:12:42,379 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:42,380 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0029_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:12:42,380 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0029	CONTAINERID=container_1426266260362_0029_01_000005
2015-03-13 10:12:42,380 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0029_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:12:42,380 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0029 container=Container: [ContainerId: container_1426266260362_0029_01_000005, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0029_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:42,380 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:12:42,380 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:42,673 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0028_01_000001 succeeded 
2015-03-13 10:12:42,673 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:12:42,674 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0028_01_000001
2015-03-13 10:12:42,680 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000001
2015-03-13 10:12:42,680 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000001
2015-03-13 10:12:42,680 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000001
2015-03-13 10:12:42,680 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0028	CONTAINERID=container_1426266260362_0028_01_000001
2015-03-13 10:12:42,680 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:12:42,680 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0028_01_000001 from application application_1426266260362_0028
2015-03-13 10:12:42,681 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:42,681 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0028
2015-03-13 10:12:42,680 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000001
2015-03-13 10:12:42,794 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:42,795 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0029_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:12:42,795 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0029	CONTAINERID=container_1426266260362_0029_01_000006
2015-03-13 10:12:42,795 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0029_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:12:42,795 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0029 container=Container: [ContainerId: container_1426266260362_0029_01_000006, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0029_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:42,795 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7
2015-03-13 10:12:42,796 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:42,834 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:12:42,835 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0028_01_000001
2015-03-13 10:12:42,835 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0028_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:12:42,835 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0028_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:12:42,835 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0028_000001
2015-03-13 10:12:42,835 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0028	CONTAINERID=container_1426266260362_0028_01_000001
2015-03-13 10:12:42,836 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0028_000001 State change from FINISHING to FINISHED
2015-03-13 10:12:42,836 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0028_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60723, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:12:42,836 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0028 State change from FINISHING to FINISHED
2015-03-13 10:12:42,836 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:7168, vCores:6> numContainers=6 user=soberoi user-resources=<memory:7168, vCores:6>
2015-03-13 10:12:42,836 INFO  amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0028_000001
2015-03-13 10:12:42,836 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1426266260362_0028
2015-03-13 10:12:42,836 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0028_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:42,837 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0028,name=[B61955F7F1A34D09B0265BE65DDD3B28/31E34ADFFB5F45C187BD485C865354E1] lower*upper1*upper2/(3/3),user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0028/jobhistory/job/job_1426266260362_0028,appMasterHost=Edinburgh.local,startTime=1426266741548,finishTime=1426266756525,finalStatus=SUCCEEDED
2015-03-13 10:12:42,837 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:42,837 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6
2015-03-13 10:12:42,837 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0028_000001 released container container_1426266260362_0028_01_000001 on node: host: 10.1.1.144:60723 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:12:42,837 INFO  capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0028_000001 is done. finalState=FINISHED
2015-03-13 10:12:42,837 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0028 requests cleared
2015-03-13 10:12:42,837 INFO  capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0028 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:12:42,838 INFO  capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0028 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:12:42,839 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0028_000001 (auth:SIMPLE)
2015-03-13 10:12:42,840 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0028_01_000001
2015-03-13 10:12:42,964 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0029_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:12:42,964 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0029_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:12:42,964 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0029_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:12:42,964 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0029_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:12:42,964 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0029_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:12:42,990 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.jar	dst=null	perm=null
2015-03-13 10:12:42,991 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.jar	dst=null	perm=null
2015-03-13 10:12:43,000 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.xml	dst=null	perm=null
2015-03-13 10:12:43,001 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.xml	dst=null	perm=null
2015-03-13 10:12:43,003 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:12:43,004 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:12:43,009 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:12:43,011 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:12:43,012 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:12:43,013 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:12:43,085 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073742161_1337, blk_1073742162_1338, blk_1073742158_1334, blk_1073742159_1335]
2015-03-13 10:12:43,086 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073742160_1336, blk_1073742161_1337, blk_1073742162_1338, blk_1073742164_1340, blk_1073742158_1334, blk_1073742159_1335]
2015-03-13 10:12:43,086 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0029_000001 (auth:SIMPLE)
2015-03-13 10:12:43,086 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0029_000001 (auth:SIMPLE)
2015-03-13 10:12:43,089 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0029_01_000005 by user soberoi
2015-03-13 10:12:43,089 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0029
2015-03-13 10:12:43,089 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0029_01_000006 by user soberoi
2015-03-13 10:12:43,089 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0029	CONTAINERID=container_1426266260362_0029_01_000005
2015-03-13 10:12:43,089 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0029	CONTAINERID=container_1426266260362_0029_01_000006
2015-03-13 10:12:43,089 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0029_01_000004 by user soberoi
2015-03-13 10:12:43,090 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0029_01_000003 by user soberoi
2015-03-13 10:12:43,090 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0029	CONTAINERID=container_1426266260362_0029_01_000004
2015-03-13 10:12:43,090 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0029	CONTAINERID=container_1426266260362_0029_01_000003
2015-03-13 10:12:43,089 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0029_01_000002 by user soberoi
2015-03-13 10:12:43,090 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0029_01_000006 to application application_1426266260362_0029
2015-03-13 10:12:43,090 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0029	CONTAINERID=container_1426266260362_0029_01_000002
2015-03-13 10:12:43,090 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:12:43,090 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0029
2015-03-13 10:12:43,090 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0029
2015-03-13 10:12:43,090 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:12:43,090 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0029
2015-03-13 10:12:43,091 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:12:43,090 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0029 transitioned from NEW to INITING
2015-03-13 10:12:43,091 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0029_01_000005 to application application_1426266260362_0029
2015-03-13 10:12:43,091 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0029_01_000004 to application application_1426266260362_0029
2015-03-13 10:12:43,091 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0029_01_000003 to application application_1426266260362_0029
2015-03-13 10:12:43,091 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0029_01_000002 to application application_1426266260362_0029
2015-03-13 10:12:43,091 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0029 transitioned from INITING to RUNNING
2015-03-13 10:12:43,092 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:12:43,092 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:12:43,092 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:12:43,092 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:12:43,092 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0029
2015-03-13 10:12:43,092 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0029
2015-03-13 10:12:43,092 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:12:43,092 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0029
2015-03-13 10:12:43,092 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:12:43,093 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:12:43,093 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0029
2015-03-13 10:12:43,093 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0029
2015-03-13 10:12:43,093 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:12:43,093 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0029
2015-03-13 10:12:43,093 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0029
2015-03-13 10:12:43,093 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0029
2015-03-13 10:12:43,093 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:12:43,093 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0029
2015-03-13 10:12:43,094 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0029
2015-03-13 10:12:43,094 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0029
2015-03-13 10:12:43,094 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:12:43,094 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0029
2015-03-13 10:12:43,094 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0029_01_000002
2015-03-13 10:12:43,094 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0029_01_000003
2015-03-13 10:12:43,096 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0029_01_000004
2015-03-13 10:12:43,097 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0029_01_000005
2015-03-13 10:12:43,118 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1426266260362_0029_01_000002.tokens. Credentials list: 
2015-03-13 10:12:43,119 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426266260362_0029_01_000003.tokens. Credentials list: 
2015-03-13 10:12:43,119 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0029_01_000004.tokens. Credentials list: 
2015-03-13 10:12:43,119 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1426266260362_0029_01_000005.tokens. Credentials list: 
2015-03-13 10:12:43,133 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:12:43,133 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:43,136 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:12:43,201 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000006/default_container_executor.sh]
2015-03-13 10:12:43,210 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1426266260362_0029_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000002.tokens
2015-03-13 10:12:43,210 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0029 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0029
2015-03-13 10:12:43,281 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.jar	dst=null	perm=null
2015-03-13 10:12:43,282 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.jar	dst=null	perm=null
2015-03-13 10:12:43,283 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.jar	dst=null	perm=null
2015-03-13 10:12:43,290 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63327, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-901806963_15552, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742172_1348, duration: 451000
2015-03-13 10:12:43,309 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:12:43,327 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.xml	dst=null	perm=null
2015-03-13 10:12:43,327 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.xml	dst=null	perm=null
2015-03-13 10:12:43,328 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.xml	dst=null	perm=null
2015-03-13 10:12:43,335 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63328, bytes: 98556, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-901806963_15552, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742175_1351, duration: 274000
2015-03-13 10:12:43,352 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:12:43,352 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:12:43,352 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:12:43,352 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:12:43,352 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:12:43,377 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:43,378 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:43,378 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:43,378 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:43,379 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0028 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:12:43,379 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0028
2015-03-13 10:12:43,380 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0028 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:12:43,380 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0028, with delay of 10800 seconds
2015-03-13 10:12:43,380 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0029_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:12:43,380 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0029_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:12:43,380 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0029_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:12:43,380 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0029_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:12:43,380 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0028
2015-03-13 10:12:43,381 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0028
2015-03-13 10:12:43,381 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0028
2015-03-13 10:12:43,382 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0028
2015-03-13 10:12:43,415 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:12:43,415 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:12:43,415 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:43,415 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:43,422 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:12:43,422 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:43,430 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:12:43,430 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:43,548 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000002/default_container_executor.sh]
2015-03-13 10:12:43,553 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000004/default_container_executor.sh]
2015-03-13 10:12:43,557 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000005/default_container_executor.sh]
2015-03-13 10:12:43,574 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000003/default_container_executor.sh]
2015-03-13 10:12:43,799 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:43,800 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:43,800 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0029_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:12:43,839 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0028 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:12:43,839 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0028
2015-03-13 10:12:43,839 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0028
2015-03-13 10:12:43,839 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0028
2015-03-13 10:12:43,839 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0028
2015-03-13 10:12:43,839 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0028 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:12:43,839 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0028, with delay of 10800 seconds
2015-03-13 10:12:43,839 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0028
2015-03-13 10:12:43,867 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742161_1337 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742161 for deletion
2015-03-13 10:12:43,867 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742162_1338 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742162 for deletion
2015-03-13 10:12:43,867 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742158_1334 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742158 for deletion
2015-03-13 10:12:43,867 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742161_1337 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742161
2015-03-13 10:12:43,867 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742159_1335 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742159 for deletion
2015-03-13 10:12:43,867 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742162_1338 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742162
2015-03-13 10:12:43,867 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742158_1334 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742158
2015-03-13 10:12:43,867 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742159_1335 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742159
2015-03-13 10:12:43,979 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:12:44,051 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742160_1336 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742160 for deletion
2015-03-13 10:12:44,052 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742161_1337 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742161 for deletion
2015-03-13 10:12:44,052 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742162_1338 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742162 for deletion
2015-03-13 10:12:44,052 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742164_1340 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742164 for deletion
2015-03-13 10:12:44,052 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742161_1337 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742161
2015-03-13 10:12:44,052 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742158_1334 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742158 for deletion
2015-03-13 10:12:44,052 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742160_1336 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742160
2015-03-13 10:12:44,052 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742159_1335 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742159 for deletion
2015-03-13 10:12:44,052 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742162_1338 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742162
2015-03-13 10:12:44,052 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742159_1335 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742159
2015-03-13 10:12:44,052 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742164_1340 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742164
2015-03-13 10:12:44,053 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742158_1334 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742158
2015-03-13 10:12:44,381 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:44,381 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:44,381 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:44,381 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:44,384 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:12:44,499 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1426266260362_0029_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000005.tokens
2015-03-13 10:12:44,499 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0029 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0029
2015-03-13 10:12:44,598 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:12:44,731 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0029_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000004.tokens
2015-03-13 10:12:44,731 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0029 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0029
2015-03-13 10:12:44,800 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:44,800 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:44,827 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:12:44,959 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426266260362_0029_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000003.tokens
2015-03-13 10:12:44,959 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0029 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0029
2015-03-13 10:12:45,026 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742176_1352
2015-03-13 10:12:45,231 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742172_1348
2015-03-13 10:12:45,384 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:45,385 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:45,385 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:45,385 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:45,806 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:45,806 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:46,186 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742176_1352
2015-03-13 10:12:46,389 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:46,389 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:46,390 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:46,390 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:46,811 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:46,811 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:47,390 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:47,391 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:47,391 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:47,391 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:47,816 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:47,816 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:48,391 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:48,391 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:48,392 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:48,392 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:48,817 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:48,818 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:49,392 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:49,393 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:49,393 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:49,393 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:49,818 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:49,818 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:50,394 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:50,394 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:50,394 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:50,395 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:50,819 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:50,819 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:51,264 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.split	dst=null	perm=null
2015-03-13 10:12:51,397 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:51,397 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:51,397 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:51,397 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:51,418 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63338, bytes: 721, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0029_m_000004_0_-756137194_1, offset: 1024, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742173_1349, duration: 181000
2015-03-13 10:12:51,566 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.split	dst=null	perm=null
2015-03-13 10:12:51,613 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.split	dst=null	perm=null
2015-03-13 10:12:51,640 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/part-00004	dst=null	perm=null
2015-03-13 10:12:51,649 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.split	dst=null	perm=null
2015-03-13 10:12:51,649 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/part-00004	dst=null	perm=null
2015-03-13 10:12:51,656 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63342, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0029_m_000004_0_-756137194_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742163_1339, duration: 133000
2015-03-13 10:12:51,731 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/_temporary/attempt_1426266260362_0029_m_000004_0/part-00004	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:51,734 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63343, bytes: 1753, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0029_m_000000_0_-148738810_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742173_1349, duration: 151000
2015-03-13 10:12:51,740 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.split	dst=null	perm=null
2015-03-13 10:12:51,799 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63345, bytes: 1237, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0029_m_000002_0_1493284587_1, offset: 512, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742173_1349, duration: 179000
2015-03-13 10:12:51,823 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:51,823 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:51,842 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63346, bytes: 1753, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0029_m_000001_0_1501290920_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742173_1349, duration: 144000
2015-03-13 10:12:51,882 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/part-00000	dst=null	perm=null
2015-03-13 10:12:51,890 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/part-00000	dst=null	perm=null
2015-03-13 10:12:51,892 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63348, bytes: 118, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0029_m_000000_0_-148738810_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742165_1341, duration: 150000
2015-03-13 10:12:51,898 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63347, bytes: 721, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0029_m_000003_0_-963552514_1, offset: 1024, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742173_1349, duration: 141000
2015-03-13 10:12:51,940 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/part-00002	dst=null	perm=null
2015-03-13 10:12:51,949 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/part-00002	dst=null	perm=null
2015-03-13 10:12:51,955 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/_temporary/attempt_1426266260362_0029_m_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:51,955 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63349, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0029_m_000002_0_1493284587_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742166_1342, duration: 145000
2015-03-13 10:12:51,961 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/part-00001	dst=null	perm=null
2015-03-13 10:12:51,969 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/part-00001	dst=null	perm=null
2015-03-13 10:12:51,972 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63350, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0029_m_000001_0_1501290920_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742167_1343, duration: 154000
2015-03-13 10:12:52,010 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/_temporary/attempt_1426266260362_0029_m_000002_0/part-00002	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:52,016 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/_temporary/attempt_1426266260362_0029_m_000001_0/part-00001	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:52,024 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/part-00003	dst=null	perm=null
2015-03-13 10:12:52,032 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/part-00003	dst=null	perm=null
2015-03-13 10:12:52,035 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63351, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0029_m_000003_0_-963552514_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742168_1344, duration: 157000
2015-03-13 10:12:52,100 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/_temporary/attempt_1426266260362_0029_m_000003_0/part-00003	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:52,125 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:12:52,138 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:12:52,143 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:12:52,148 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63338, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0029_m_000004_0_-756137194_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 137000
2015-03-13 10:12:52,181 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/_temporary/attempt_1426266260362_0029_m_000004_0/part-00004. BP-1005356445-10.1.1.144-1426266257849 blk_1073742177_1353{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:12:52,224 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742177_1353 src: /127.0.0.1:63352 dest: /127.0.0.1:60696
2015-03-13 10:12:52,225 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742177_1353 src: /127.0.0.1:63353 dest: /127.0.0.1:60689
2015-03-13 10:12:52,227 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742177_1353 src: /127.0.0.1:63354 dest: /127.0.0.1:60693
2015-03-13 10:12:52,237 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63354, dest: /127.0.0.1:60693, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0029_m_000004_0_-756137194_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742177_1353, duration: 8590000
2015-03-13 10:12:52,237 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742177_1353, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:52,237 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742177_1353{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:52,237 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63353, dest: /127.0.0.1:60689, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0029_m_000004_0_-756137194_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742177_1353, duration: 9247000
2015-03-13 10:12:52,238 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742177_1353, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:52,238 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742177_1353{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:52,238 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63352, dest: /127.0.0.1:60696, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0029_m_000004_0_-756137194_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742177_1353, duration: 10062000
2015-03-13 10:12:52,238 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742177_1353, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:52,239 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742177_1353{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:52,245 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/_temporary/attempt_1426266260362_0029_m_000004_0/part-00004 is closed by DFSClient_attempt_1426266260362_0029_m_000004_0_-756137194_1
2015-03-13 10:12:52,254 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/_temporary/attempt_1426266260362_0029_m_000004_0	dst=null	perm=null
2015-03-13 10:12:52,260 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/_temporary/attempt_1426266260362_0029_m_000004_0	dst=null	perm=null
2015-03-13 10:12:52,261 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/task_1426266260362_0029_m_000004	dst=null	perm=null
2015-03-13 10:12:52,265 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/_temporary/attempt_1426266260362_0029_m_000004_0	dst=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/task_1426266260362_0029_m_000004	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:12:52,284 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0029_01_000006
2015-03-13 10:12:52,284 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0029	CONTAINERID=container_1426266260362_0029_01_000006
2015-03-13 10:12:52,284 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:12:52,285 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0029_01_000006
2015-03-13 10:12:52,285 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:52,285 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:12:52,297 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0029_01_000006 is : 143
2015-03-13 10:12:52,298 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job_1426266260362_0029_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073742178_1354{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:12:52,300 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742178_1354 src: /127.0.0.1:63355 dest: /127.0.0.1:60696
2015-03-13 10:12:52,301 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742178_1354 src: /127.0.0.1:63356 dest: /127.0.0.1:60693
2015-03-13 10:12:52,302 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742178_1354 src: /127.0.0.1:63357 dest: /127.0.0.1:60686
2015-03-13 10:12:52,306 INFO  hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job_1426266260362_0029_1.jhist for DFSClient_NONMAPREDUCE_2012353289_1
2015-03-13 10:12:52,309 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:12:52,310 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000006
2015-03-13 10:12:52,310 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000006
2015-03-13 10:12:52,310 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0029	CONTAINERID=container_1426266260362_0029_01_000006
2015-03-13 10:12:52,310 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:12:52,310 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0029_01_000006 from application application_1426266260362_0029
2015-03-13 10:12:52,310 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:52,310 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0029
2015-03-13 10:12:52,310 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000006
2015-03-13 10:12:52,310 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000006
2015-03-13 10:12:52,401 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:52,401 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:52,401 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:52,402 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:52,474 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:12:52,487 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:12:52,492 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:12:52,497 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63358, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0029_m_000000_0_-148738810_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 178000
2015-03-13 10:12:52,517 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:12:52,536 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:12:52,538 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/_temporary/attempt_1426266260362_0029_m_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073742179_1355{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:12:52,540 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:12:52,545 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:12:52,552 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63360, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0029_m_000002_0_1493284587_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 155000
2015-03-13 10:12:52,565 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:12:52,569 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:12:52,574 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63361, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0029_m_000001_0_1501290920_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 148000
2015-03-13 10:12:52,580 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742179_1355 src: /127.0.0.1:63359 dest: /127.0.0.1:60696
2015-03-13 10:12:52,581 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742179_1355 src: /127.0.0.1:63362 dest: /127.0.0.1:60689
2015-03-13 10:12:52,583 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742179_1355 src: /127.0.0.1:63363 dest: /127.0.0.1:60686
2015-03-13 10:12:52,590 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63363, dest: /127.0.0.1:60686, bytes: 138, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0029_m_000000_0_-148738810_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742179_1355, duration: 6077000
2015-03-13 10:12:52,590 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742179_1355, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:52,591 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63362, dest: /127.0.0.1:60689, bytes: 138, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0029_m_000000_0_-148738810_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742179_1355, duration: 6759000
2015-03-13 10:12:52,591 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742179_1355{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:12:52,591 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742179_1355, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:52,592 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63359, dest: /127.0.0.1:60696, bytes: 138, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0029_m_000000_0_-148738810_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742179_1355, duration: 7839000
2015-03-13 10:12:52,592 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742179_1355, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:52,592 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742179_1355{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:12:52,593 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742179_1355{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:12:52,597 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/_temporary/attempt_1426266260362_0029_m_000002_0/part-00002. BP-1005356445-10.1.1.144-1426266257849 blk_1073742180_1356{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:12:52,601 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/_temporary/attempt_1426266260362_0029_m_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0029_m_000000_0_-148738810_1
2015-03-13 10:12:52,606 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/_temporary/attempt_1426266260362_0029_m_000001_0/part-00001. BP-1005356445-10.1.1.144-1426266257849 blk_1073742181_1357{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:12:52,611 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/_temporary/attempt_1426266260362_0029_m_000000_0	dst=null	perm=null
2015-03-13 10:12:52,627 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/_temporary/attempt_1426266260362_0029_m_000000_0	dst=null	perm=null
2015-03-13 10:12:52,628 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/task_1426266260362_0029_m_000000	dst=null	perm=null
2015-03-13 10:12:52,631 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/_temporary/attempt_1426266260362_0029_m_000000_0	dst=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/task_1426266260362_0029_m_000000	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:12:52,646 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0029_01_000002
2015-03-13 10:12:52,646 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0029	CONTAINERID=container_1426266260362_0029_01_000002
2015-03-13 10:12:52,646 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:12:52,646 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0029_01_000002
2015-03-13 10:12:52,646 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:12:52,646 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:52,647 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:52,647 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:52,659 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0029_01_000002 is : 143
2015-03-13 10:12:52,669 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742180_1356 src: /127.0.0.1:63364 dest: /127.0.0.1:60686
2015-03-13 10:12:52,670 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742180_1356 src: /127.0.0.1:63366 dest: /127.0.0.1:60696
2015-03-13 10:12:52,670 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:12:52,671 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000002
2015-03-13 10:12:52,671 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000002
2015-03-13 10:12:52,671 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000002
2015-03-13 10:12:52,671 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742180_1356 src: /127.0.0.1:63367 dest: /127.0.0.1:60693
2015-03-13 10:12:52,672 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000002
2015-03-13 10:12:52,673 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0029	CONTAINERID=container_1426266260362_0029_01_000002
2015-03-13 10:12:52,673 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:12:52,673 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0029_01_000002 from application application_1426266260362_0029
2015-03-13 10:12:52,673 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:52,673 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0029
2015-03-13 10:12:52,677 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742181_1357 src: /127.0.0.1:63365 dest: /127.0.0.1:60696
2015-03-13 10:12:52,678 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742181_1357 src: /127.0.0.1:63368 dest: /127.0.0.1:60686
2015-03-13 10:12:52,680 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742181_1357 src: /127.0.0.1:63369 dest: /127.0.0.1:60689
2015-03-13 10:12:52,682 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63367, dest: /127.0.0.1:60693, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0029_m_000002_0_1493284587_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742180_1356, duration: 9089000
2015-03-13 10:12:52,682 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742180_1356, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:52,683 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742180_1356{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:52,683 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63366, dest: /127.0.0.1:60696, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0029_m_000002_0_1493284587_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742180_1356, duration: 9714000
2015-03-13 10:12:52,683 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742180_1356, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:52,683 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742180_1356{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:52,684 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63364, dest: /127.0.0.1:60686, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0029_m_000002_0_1493284587_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742180_1356, duration: 10527000
2015-03-13 10:12:52,684 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742180_1356, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:52,684 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742180_1356{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:52,688 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/_temporary/attempt_1426266260362_0029_m_000002_0/part-00002 is closed by DFSClient_attempt_1426266260362_0029_m_000002_0_1493284587_1
2015-03-13 10:12:52,693 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63369, dest: /127.0.0.1:60689, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0029_m_000001_0_1501290920_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742181_1357, duration: 12479000
2015-03-13 10:12:52,694 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742181_1357, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:52,694 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742181_1357{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:12:52,694 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63368, dest: /127.0.0.1:60686, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0029_m_000001_0_1501290920_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742181_1357, duration: 13086000
2015-03-13 10:12:52,694 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742181_1357, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:52,695 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742181_1357{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:12:52,695 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63365, dest: /127.0.0.1:60696, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0029_m_000001_0_1501290920_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742181_1357, duration: 13749000
2015-03-13 10:12:52,695 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742181_1357, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:52,695 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742181_1357{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:12:52,701 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/_temporary/attempt_1426266260362_0029_m_000001_0/part-00001 is closed by DFSClient_attempt_1426266260362_0029_m_000001_0_1501290920_1
2015-03-13 10:12:52,704 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/_temporary/attempt_1426266260362_0029_m_000002_0	dst=null	perm=null
2015-03-13 10:12:52,712 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/_temporary/attempt_1426266260362_0029_m_000002_0	dst=null	perm=null
2015-03-13 10:12:52,713 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/task_1426266260362_0029_m_000002	dst=null	perm=null
2015-03-13 10:12:52,717 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/_temporary/attempt_1426266260362_0029_m_000002_0	dst=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/task_1426266260362_0029_m_000002	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:12:52,730 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0029_01_000004
2015-03-13 10:12:52,730 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0029	CONTAINERID=container_1426266260362_0029_01_000004
2015-03-13 10:12:52,730 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:12:52,730 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:12:52,730 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0029_01_000004
2015-03-13 10:12:52,731 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0029_01_000002
2015-03-13 10:12:52,731 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:52,731 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:12:52,731 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:52,732 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0029_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:12:52,732 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0029_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:12:52,732 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0029	CONTAINERID=container_1426266260362_0029_01_000002
2015-03-13 10:12:52,732 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0029_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:12:52,732 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:12:52,732 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0029_01_000002, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:52,732 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:52,732 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:12:52,732 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0029_000001 released container container_1426266260362_0029_01_000002 on node: host: 10.1.1.144:60719 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:12:52,742 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:12:52,744 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0029_01_000004 is : 143
2015-03-13 10:12:52,752 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:12:52,755 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:12:52,756 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000004
2015-03-13 10:12:52,756 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000004
2015-03-13 10:12:52,756 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000004
2015-03-13 10:12:52,756 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000004
2015-03-13 10:12:52,757 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0029	CONTAINERID=container_1426266260362_0029_01_000004
2015-03-13 10:12:52,757 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:12:52,757 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0029_01_000004 from application application_1426266260362_0029
2015-03-13 10:12:52,757 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:52,758 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0029
2015-03-13 10:12:52,759 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:12:52,762 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/_temporary/attempt_1426266260362_0029_m_000001_0	dst=null	perm=null
2015-03-13 10:12:52,769 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63370, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0029_m_000003_0_-963552514_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 143000
2015-03-13 10:12:52,770 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/_temporary/attempt_1426266260362_0029_m_000001_0	dst=null	perm=null
2015-03-13 10:12:52,771 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/task_1426266260362_0029_m_000001	dst=null	perm=null
2015-03-13 10:12:52,774 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/_temporary/attempt_1426266260362_0029_m_000001_0	dst=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/task_1426266260362_0029_m_000001	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:12:52,784 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0029_01_000003
2015-03-13 10:12:52,784 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0029	CONTAINERID=container_1426266260362_0029_01_000003
2015-03-13 10:12:52,784 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:12:52,784 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0029_01_000003
2015-03-13 10:12:52,784 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:12:52,785 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:12:52,785 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0029_01_000004
2015-03-13 10:12:52,785 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:52,785 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0029_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:12:52,785 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0029_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:12:52,785 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0029	CONTAINERID=container_1426266260362_0029_01_000004
2015-03-13 10:12:52,785 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0029_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:12:52,786 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:12:52,786 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0029_01_000004, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:52,786 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:52,786 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:12:52,786 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0029_000001 released container container_1426266260362_0029_01_000004 on node: host: 10.1.1.144:60719 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:12:52,797 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0029_01_000003 is : 143
2015-03-13 10:12:52,809 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:12:52,809 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000003
2015-03-13 10:12:52,810 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000003
2015-03-13 10:12:52,810 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000003
2015-03-13 10:12:52,810 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000003
2015-03-13 10:12:52,811 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0029	CONTAINERID=container_1426266260362_0029_01_000003
2015-03-13 10:12:52,811 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:12:52,811 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0029_01_000003 from application application_1426266260362_0029
2015-03-13 10:12:52,811 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:52,811 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0029
2015-03-13 10:12:52,820 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/_temporary/attempt_1426266260362_0029_m_000003_0/part-00003. BP-1005356445-10.1.1.144-1426266257849 blk_1073742182_1358{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:12:52,862 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742182_1358 src: /127.0.0.1:63371 dest: /127.0.0.1:60696
2015-03-13 10:12:52,864 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742182_1358 src: /127.0.0.1:63372 dest: /127.0.0.1:60686
2015-03-13 10:12:52,865 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742182_1358 src: /127.0.0.1:63373 dest: /127.0.0.1:60693
2015-03-13 10:12:52,873 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63373, dest: /127.0.0.1:60693, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0029_m_000003_0_-963552514_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742182_1358, duration: 6515000
2015-03-13 10:12:52,874 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742182_1358, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:52,874 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63372, dest: /127.0.0.1:60686, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0029_m_000003_0_-963552514_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742182_1358, duration: 7508000
2015-03-13 10:12:52,875 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742182_1358, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:52,875 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63371, dest: /127.0.0.1:60696, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0029_m_000003_0_-963552514_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742182_1358, duration: 8440000
2015-03-13 10:12:52,875 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742182_1358{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:52,875 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742182_1358, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:52,876 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742182_1358{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:52,876 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742182_1358{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:52,881 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/_temporary/attempt_1426266260362_0029_m_000003_0/part-00003 is closed by DFSClient_attempt_1426266260362_0029_m_000003_0_-963552514_1
2015-03-13 10:12:52,889 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/_temporary/attempt_1426266260362_0029_m_000003_0	dst=null	perm=null
2015-03-13 10:12:52,894 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/_temporary/attempt_1426266260362_0029_m_000003_0	dst=null	perm=null
2015-03-13 10:12:52,895 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/task_1426266260362_0029_m_000003	dst=null	perm=null
2015-03-13 10:12:52,897 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/_temporary/attempt_1426266260362_0029_m_000003_0	dst=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/task_1426266260362_0029_m_000003	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:12:52,905 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0029_01_000005
2015-03-13 10:12:52,905 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0029	CONTAINERID=container_1426266260362_0029_01_000005
2015-03-13 10:12:52,905 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:12:52,905 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:12:52,905 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0029_01_000005
2015-03-13 10:12:52,905 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0029_01_000003
2015-03-13 10:12:52,906 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:12:52,906 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0029_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:12:52,906 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0029_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:12:52,906 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0029	CONTAINERID=container_1426266260362_0029_01_000003
2015-03-13 10:12:52,906 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0029_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:12:52,906 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:12:52,906 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0029_01_000003, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:52,906 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:52,906 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:12:52,907 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0029_000001 released container container_1426266260362_0029_01_000003 on node: host: 10.1.1.144:60719 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:12:52,909 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:52,912 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_2012353289_1
2015-03-13 10:12:52,916 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1	dst=null	perm=null
2015-03-13 10:12:52,919 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0029_01_000005 is : 143
2015-03-13 10:12:52,923 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5	dst=null	perm=null
2015-03-13 10:12:52,924 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5	dst=null	perm=null
2015-03-13 10:12:52,925 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/task_1426266260362_0029_m_000000	dst=null	perm=null
2015-03-13 10:12:52,927 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00000	dst=null	perm=null
2015-03-13 10:12:52,929 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/task_1426266260362_0029_m_000000/part-00000	dst=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:52,931 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:12:52,932 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000005
2015-03-13 10:12:52,932 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000005
2015-03-13 10:12:52,932 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000005
2015-03-13 10:12:52,932 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000005
2015-03-13 10:12:52,932 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0029	CONTAINERID=container_1426266260362_0029_01_000005
2015-03-13 10:12:52,933 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5	dst=null	perm=null
2015-03-13 10:12:52,933 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:12:52,933 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0029_01_000005 from application application_1426266260362_0029
2015-03-13 10:12:52,934 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5	dst=null	perm=null
2015-03-13 10:12:52,934 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:52,934 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0029
2015-03-13 10:12:52,934 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/task_1426266260362_0029_m_000001	dst=null	perm=null
2015-03-13 10:12:52,936 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00001	dst=null	perm=null
2015-03-13 10:12:52,937 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/task_1426266260362_0029_m_000001/part-00001	dst=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00001	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:52,937 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5	dst=null	perm=null
2015-03-13 10:12:52,938 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5	dst=null	perm=null
2015-03-13 10:12:52,939 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/task_1426266260362_0029_m_000002	dst=null	perm=null
2015-03-13 10:12:52,943 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00002	dst=null	perm=null
2015-03-13 10:12:52,945 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/task_1426266260362_0029_m_000002/part-00002	dst=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00002	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:52,945 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5	dst=null	perm=null
2015-03-13 10:12:52,946 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5	dst=null	perm=null
2015-03-13 10:12:52,947 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/task_1426266260362_0029_m_000003	dst=null	perm=null
2015-03-13 10:12:52,948 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00003	dst=null	perm=null
2015-03-13 10:12:52,949 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/task_1426266260362_0029_m_000003/part-00003	dst=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00003	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:52,950 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5	dst=null	perm=null
2015-03-13 10:12:52,950 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5	dst=null	perm=null
2015-03-13 10:12:52,951 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/task_1426266260362_0029_m_000004	dst=null	perm=null
2015-03-13 10:12:52,952 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00004	dst=null	perm=null
2015-03-13 10:12:52,953 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/task_1426266260362_0029_m_000004/part-00004	dst=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00004	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:52,955 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary	dst=null	perm=null
2015-03-13 10:12:52,959 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:52,961 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_SUCCESS is closed by DFSClient_NONMAPREDUCE_2012353289_1
2015-03-13 10:12:52,964 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:52,966 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_2012353289_1
2015-03-13 10:12:52,979 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63357, dest: /127.0.0.1:60686, bytes: 53240, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2012353289_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742178_1354, duration: 675400000
2015-03-13 10:12:52,979 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742178_1354, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:52,980 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742178_1354{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:12:52,980 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63356, dest: /127.0.0.1:60693, bytes: 53240, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2012353289_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742178_1354, duration: 676635000
2015-03-13 10:12:52,981 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742178_1354, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:52,982 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742178_1354{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:12:52,982 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63355, dest: /127.0.0.1:60696, bytes: 53240, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2012353289_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742178_1354, duration: 678116000
2015-03-13 10:12:52,982 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742178_1354, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:52,982 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742178_1354{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:12:52,984 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job_1426266260362_0029_1.jhist is closed by DFSClient_NONMAPREDUCE_2012353289_1
2015-03-13 10:12:52,985 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0029.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:52,988 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0029.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742183_1359{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:12:52,989 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742183_1359 src: /127.0.0.1:63374 dest: /127.0.0.1:60686
2015-03-13 10:12:52,990 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742183_1359 src: /127.0.0.1:63375 dest: /127.0.0.1:60693
2015-03-13 10:12:52,992 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742183_1359 src: /127.0.0.1:63376 dest: /127.0.0.1:60696
2015-03-13 10:12:52,994 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63376, dest: /127.0.0.1:60696, bytes: 419, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2012353289_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742183_1359, duration: 1165000
2015-03-13 10:12:52,994 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742183_1359, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:52,994 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742183_1359{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:52,995 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63375, dest: /127.0.0.1:60693, bytes: 419, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2012353289_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742183_1359, duration: 1666000
2015-03-13 10:12:52,995 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742183_1359, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:52,995 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742183_1359{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:52,995 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63374, dest: /127.0.0.1:60686, bytes: 419, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2012353289_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742183_1359, duration: 2426000
2015-03-13 10:12:52,996 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742183_1359, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:52,996 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742183_1359{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:52,997 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0029.summary_tmp is closed by DFSClient_NONMAPREDUCE_2012353289_1
2015-03-13 10:12:53,001 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0029.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:12:53,005 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job_1426266260362_0029_1.jhist	dst=null	perm=null
2015-03-13 10:12:53,006 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0029-1426266757667-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2F8EF7DC42A1E14629-1426266772967-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:12:53,009 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job_1426266260362_0029_1.jhist	dst=null	perm=null
2015-03-13 10:12:53,011 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0029-1426266757667-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2F8EF7DC42A1E14629-1426266772967-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:12:53,011 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job_1426266260362_0029_1.jhist	dst=null	perm=null
2015-03-13 10:12:53,014 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0029-1426266757667-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2F8EF7DC42A1E14629-1426266772967-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:53,016 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63377, bytes: 53656, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_2012353289_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742178_1354, duration: 176000
2015-03-13 10:12:53,018 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0029-1426266757667-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2F8EF7DC42A1E14629-1426266772967-5-0-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742184_1360{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:12:53,020 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742184_1360 src: /127.0.0.1:63378 dest: /127.0.0.1:60686
2015-03-13 10:12:53,021 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742184_1360 src: /127.0.0.1:63379 dest: /127.0.0.1:60689
2015-03-13 10:12:53,023 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742184_1360 src: /127.0.0.1:63380 dest: /127.0.0.1:60696
2015-03-13 10:12:53,026 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63380, dest: /127.0.0.1:60696, bytes: 53240, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2012353289_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742184_1360, duration: 1799000
2015-03-13 10:12:53,026 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742184_1360, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:53,026 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742184_1360{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:53,027 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63379, dest: /127.0.0.1:60689, bytes: 53240, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2012353289_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742184_1360, duration: 2426000
2015-03-13 10:12:53,027 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742184_1360, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:53,027 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742184_1360{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:53,027 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63378, dest: /127.0.0.1:60686, bytes: 53240, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2012353289_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742184_1360, duration: 3141000
2015-03-13 10:12:53,027 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742184_1360, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:53,028 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742184_1360{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:53,029 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0029-1426266757667-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2F8EF7DC42A1E14629-1426266772967-5-0-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_2012353289_1
2015-03-13 10:12:53,031 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0029-1426266757667-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2F8EF7DC42A1E14629-1426266772967-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:12:53,032 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job_1426266260362_0029_1_conf.xml	dst=null	perm=null
2015-03-13 10:12:53,033 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0029_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:12:53,034 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job_1426266260362_0029_1_conf.xml	dst=null	perm=null
2015-03-13 10:12:53,035 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0029_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:12:53,035 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job_1426266260362_0029_1_conf.xml	dst=null	perm=null
2015-03-13 10:12:53,037 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0029_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:53,039 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63377, bytes: 91453, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_2012353289_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742176_1352, duration: 215000
2015-03-13 10:12:53,040 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0029_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742185_1361{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:12:53,042 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742185_1361 src: /127.0.0.1:63381 dest: /127.0.0.1:60693
2015-03-13 10:12:53,043 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742185_1361 src: /127.0.0.1:63382 dest: /127.0.0.1:60696
2015-03-13 10:12:53,044 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742185_1361 src: /127.0.0.1:63383 dest: /127.0.0.1:60689
2015-03-13 10:12:53,047 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63383, dest: /127.0.0.1:60689, bytes: 90741, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2012353289_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742185_1361, duration: 1506000
2015-03-13 10:12:53,047 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742185_1361, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:53,047 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742185_1361{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:12:53,047 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63382, dest: /127.0.0.1:60696, bytes: 90741, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2012353289_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742185_1361, duration: 1988000
2015-03-13 10:12:53,047 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742185_1361, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:53,048 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742185_1361{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:12:53,048 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63381, dest: /127.0.0.1:60693, bytes: 90741, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2012353289_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742185_1361, duration: 2660000
2015-03-13 10:12:53,048 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742185_1361, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:53,049 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742185_1361{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:12:53,050 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0029_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_2012353289_1
2015-03-13 10:12:53,052 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0029_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:12:53,054 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0029.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0029.summary	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:12:53,056 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0029_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0029_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:12:53,057 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0029-1426266757667-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2F8EF7DC42A1E14629-1426266772967-5-0-SUCCEEDED-default.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0029-1426266757667-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2F8EF7DC42A1E14629-1426266772967-5-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:12:53,064 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0029_000001 State change from RUNNING to FINISHING
2015-03-13 10:12:53,064 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0029
2015-03-13 10:12:53,064 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0029 State change from RUNNING to REMOVING
2015-03-13 10:12:53,064 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0029
2015-03-13 10:12:53,064 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0029 State change from REMOVING to FINISHING
2015-03-13 10:12:53,288 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:53,288 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:12:53,288 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0029_01_000006
2015-03-13 10:12:53,288 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0029_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:12:53,288 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0029_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:12:53,288 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0029	CONTAINERID=container_1426266260362_0029_01_000006
2015-03-13 10:12:53,288 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0029_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:12:53,289 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:12:53,289 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0029_01_000006, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:53,289 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:53,289 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:12:53,289 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0029_000001 released container container_1426266260362_0029_01_000006 on node: host: 10.1.1.144:60715 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:12:53,911 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:12:53,911 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0029_01_000005
2015-03-13 10:12:53,912 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0029_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:12:53,912 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0029_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:12:53,912 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0029	CONTAINERID=container_1426266260362_0029_01_000005
2015-03-13 10:12:53,912 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0029_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:12:53,913 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:12:53,913 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0029_01_000005, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:53,913 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:53,913 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:12:53,913 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0029_000001 released container container_1426266260362_0029_01_000005 on node: host: 10.1.1.144:60719 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:12:54,069 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742172_1348 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60689 
2015-03-13 10:12:54,070 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742173_1349 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60696 
2015-03-13 10:12:54,070 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742174_1350 127.0.0.1:60689 127.0.0.1:60686 127.0.0.1:60693 
2015-03-13 10:12:54,070 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742175_1351 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60686 
2015-03-13 10:12:54,070 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742178_1354 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60686 
2015-03-13 10:12:54,070 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742176_1352 127.0.0.1:60686 127.0.0.1:60693 127.0.0.1:60689 
2015-03-13 10:12:54,070 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029	dst=null	perm=null
2015-03-13 10:12:54,105 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper1*upper2] starting step: (1/3) ...rm/joinsamesourceintojoin
2015-03-13 10:12:54,112 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:12:54,120 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:12:54,122 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin	dst=null	perm=null
2015-03-13 10:12:54,123 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:12:54,123 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:12:54,125 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 30
2015-03-13 10:12:54,126 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030	dst=null	perm=null
2015-03-13 10:12:54,127 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030	dst=null	perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:12:54,128 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030	dst=null	perm=soberoi:supergroup:rwx------
2015-03-13 10:12:54,128 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.jar	dst=null	perm=null
2015-03-13 10:12:54,129 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:54,131 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073742186_1362{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:12:54,132 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742186_1362 src: /127.0.0.1:63386 dest: /127.0.0.1:60696
2015-03-13 10:12:54,133 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742186_1362 src: /127.0.0.1:63387 dest: /127.0.0.1:60686
2015-03-13 10:12:54,134 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742186_1362 src: /127.0.0.1:63388 dest: /127.0.0.1:60693
2015-03-13 10:12:54,138 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63388, dest: /127.0.0.1:60693, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742186_1362, duration: 1796000
2015-03-13 10:12:54,138 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742186_1362, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:54,138 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742186_1362{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:54,138 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63387, dest: /127.0.0.1:60686, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742186_1362, duration: 2146000
2015-03-13 10:12:54,139 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742186_1362, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:54,139 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742186_1362{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:54,139 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63386, dest: /127.0.0.1:60696, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742186_1362, duration: 3167000
2015-03-13 10:12:54,139 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742186_1362, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:54,143 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742186_1362{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:54,143 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:12:54,144 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.jar
2015-03-13 10:12:54,144 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.jar	dst=null	perm=null
2015-03-13 10:12:54,145 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:54,146 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:12:54,146 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:12:54,147 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:12:54,147 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:12:54,148 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:12:54,148 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:12:54,149 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:12:54,149 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:12:54,150 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:12:54,151 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:12:54,151 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:12:54,151 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:12:54,153 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:54,154 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:54,155 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.split
2015-03-13 10:12:54,155 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.split	dst=null	perm=null
2015-03-13 10:12:54,156 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073742187_1363{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:12:54,157 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742187_1363 src: /127.0.0.1:63389 dest: /127.0.0.1:60686
2015-03-13 10:12:54,158 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742187_1363 src: /127.0.0.1:63390 dest: /127.0.0.1:60689
2015-03-13 10:12:54,159 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742187_1363 src: /127.0.0.1:63391 dest: /127.0.0.1:60693
2015-03-13 10:12:54,160 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742187_1363 src: /127.0.0.1:63392 dest: /127.0.0.1:60696
2015-03-13 10:12:54,163 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63392, dest: /127.0.0.1:60696, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742187_1363, duration: 1570000
2015-03-13 10:12:54,163 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742187_1363, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:54,164 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63391, dest: /127.0.0.1:60693, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742187_1363, duration: 1799000
2015-03-13 10:12:54,164 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742187_1363, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:54,164 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742187_1363{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:54,164 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742187_1363{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:54,164 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63390, dest: /127.0.0.1:60689, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742187_1363, duration: 2611000
2015-03-13 10:12:54,165 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742187_1363, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:54,165 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742187_1363{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:54,165 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63389, dest: /127.0.0.1:60686, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742187_1363, duration: 3518000
2015-03-13 10:12:54,166 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742187_1363, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:54,166 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742187_1363{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:54,167 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:12:54,168 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:54,170 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:54,171 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073742188_1364{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:12:54,172 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742188_1364 src: /127.0.0.1:63393 dest: /127.0.0.1:60686
2015-03-13 10:12:54,173 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742188_1364 src: /127.0.0.1:63394 dest: /127.0.0.1:60689
2015-03-13 10:12:54,175 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742188_1364 src: /127.0.0.1:63395 dest: /127.0.0.1:60693
2015-03-13 10:12:54,177 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63395, dest: /127.0.0.1:60693, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742188_1364, duration: 1143000
2015-03-13 10:12:54,177 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742188_1364, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:54,178 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742188_1364{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:54,178 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63394, dest: /127.0.0.1:60689, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742188_1364, duration: 1541000
2015-03-13 10:12:54,178 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742188_1364, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:54,178 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742188_1364{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:54,179 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63393, dest: /127.0.0.1:60686, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742188_1364, duration: 2306000
2015-03-13 10:12:54,179 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742188_1364, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:54,179 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742188_1364{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:54,181 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:12:54,181 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:12:54,182 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:54,184 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:54,185 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:12:54,185 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:12:54,185 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:12:54,195 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742189_1365{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:12:54,196 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742189_1365 src: /127.0.0.1:63396 dest: /127.0.0.1:60686
2015-03-13 10:12:54,197 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742189_1365 src: /127.0.0.1:63397 dest: /127.0.0.1:60689
2015-03-13 10:12:54,198 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742189_1365 src: /127.0.0.1:63398 dest: /127.0.0.1:60693
2015-03-13 10:12:54,201 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63398, dest: /127.0.0.1:60693, bytes: 98220, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742189_1365, duration: 1536000
2015-03-13 10:12:54,201 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742189_1365, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:54,201 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742189_1365{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:54,202 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63397, dest: /127.0.0.1:60689, bytes: 98220, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742189_1365, duration: 1941000
2015-03-13 10:12:54,202 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742189_1365, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:54,202 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742189_1365{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:54,202 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63396, dest: /127.0.0.1:60686, bytes: 98220, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742189_1365, duration: 2592000
2015-03-13 10:12:54,202 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742189_1365, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:54,203 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742189_1365{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:54,204 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:12:54,204 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0030
2015-03-13 10:12:54,204 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030	dst=null	perm=null
2015-03-13 10:12:54,205 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.xml	dst=null	perm=null
2015-03-13 10:12:54,205 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.xml	dst=null	perm=null
2015-03-13 10:12:54,206 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.jar	dst=null	perm=null
2015-03-13 10:12:54,206 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.jar	dst=null	perm=null
2015-03-13 10:12:54,207 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.split	dst=null	perm=null
2015-03-13 10:12:54,207 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.split	dst=null	perm=null
2015-03-13 10:12:54,207 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:12:54,208 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:12:54,209 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:12:54,210 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:12:54,210 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:12:54,211 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:12:54,211 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:12:54,212 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:12:54,213 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 30 submitted by user soberoi
2015-03-13 10:12:54,213 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0030
2015-03-13 10:12:54,213 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0030 State change from NEW to NEW_SAVING
2015-03-13 10:12:54,214 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0030
2015-03-13 10:12:54,213 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	IP=10.1.1.144	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1426266260362_0030
2015-03-13 10:12:54,214 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0030 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:12:54,214 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0030_000001
2015-03-13 10:12:54,214 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0030_000001 State change from NEW to SUBMITTED
2015-03-13 10:12:54,214 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0030 from user: soberoi activated in queue: default
2015-03-13 10:12:54,214 INFO  capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0030 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:12:54,214 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0030 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:12:54,214 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0030 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:12:54,215 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0030_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:12:54,215 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0030_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:12:54,216 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0030 State change from SUBMITTED to ACCEPTED
2015-03-13 10:12:54,217 INFO  mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0030/
2015-03-13 10:12:54,217 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper1*upper2] submitted hadoop job: job_1426266260362_0030
2015-03-13 10:12:54,217 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper1*upper2] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0030/
2015-03-13 10:12:54,290 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:54,291 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0030_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:12:54,291 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0030	CONTAINERID=container_1426266260362_0030_01_000001
2015-03-13 10:12:54,291 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0030_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:4096, vCores:2> used and <memory:0, vCores:6> available
2015-03-13 10:12:54,291 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0030 container=Container: [ContainerId: container_1426266260362_0030_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0030_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:54,292 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:12:54,292 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0030_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:12:54,292 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:54,293 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0030 AttemptId: appattempt_1426266260362_0030_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0030_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ]
2015-03-13 10:12:54,293 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0030_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:12:54,293 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0030_000001
2015-03-13 10:12:54,293 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0030_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:12:54,293 INFO  amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0030_000001
2015-03-13 10:12:54,293 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0030_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] for AM appattempt_1426266260362_0030_000001
2015-03-13 10:12:54,294 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0030_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-03-13 10:12:54,296 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0030_000001 (auth:SIMPLE)
2015-03-13 10:12:54,297 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0030_01_000001 by user soberoi
2015-03-13 10:12:54,297 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0030
2015-03-13 10:12:54,297 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0030	CONTAINERID=container_1426266260362_0030_01_000001
2015-03-13 10:12:54,297 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0030 transitioned from NEW to INITING
2015-03-13 10:12:54,297 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0030_01_000001 to application application_1426266260362_0030
2015-03-13 10:12:54,297 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0030 transitioned from INITING to RUNNING
2015-03-13 10:12:54,297 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0030_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] for AM appattempt_1426266260362_0030_000001
2015-03-13 10:12:54,298 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0030_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:12:54,298 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:12:54,298 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0030
2015-03-13 10:12:54,298 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:12:54,298 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:12:54,298 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:12:54,298 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:12:54,298 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0030_01_000001
2015-03-13 10:12:54,310 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426266260362_0030_01_000001.tokens. Credentials list: 
2015-03-13 10:12:54,325 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:12:54,400 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426266260362_0030_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000001.tokens
2015-03-13 10:12:54,400 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0030 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0030
2015-03-13 10:12:54,469 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.jar	dst=null	perm=null
2015-03-13 10:12:54,470 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.jar	dst=null	perm=null
2015-03-13 10:12:54,471 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.jar	dst=null	perm=null
2015-03-13 10:12:54,478 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63402, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-147625035_15914, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742186_1362, duration: 362000
2015-03-13 10:12:54,499 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:12:54,515 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:12:54,516 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:12:54,517 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:12:54,523 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63403, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-147625035_15914, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742188_1364, duration: 167000
2015-03-13 10:12:54,536 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:12:54,551 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.split	dst=null	perm=null
2015-03-13 10:12:54,552 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.split	dst=null	perm=null
2015-03-13 10:12:54,552 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.split	dst=null	perm=null
2015-03-13 10:12:54,559 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63403, bytes: 1798, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-147625035_15914, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742187_1363, duration: 180000
2015-03-13 10:12:54,572 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:12:54,589 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.xml	dst=null	perm=null
2015-03-13 10:12:54,589 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.xml	dst=null	perm=null
2015-03-13 10:12:54,590 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.xml	dst=null	perm=null
2015-03-13 10:12:54,596 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63403, bytes: 98988, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-147625035_15914, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742189_1365, duration: 368000
2015-03-13 10:12:54,608 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:12:54,608 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:12:54,634 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:12:54,634 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:54,705 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000001/default_container_executor.sh]
2015-03-13 10:12:55,098 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60693 to replicate blk_1073742186_1362 to datanode(s) 127.0.0.1:60689
2015-03-13 10:12:55,098 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073742176_1352, blk_1073742172_1348, blk_1073742173_1349, blk_1073742174_1350]
2015-03-13 10:12:55,098 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073742176_1352, blk_1073742178_1354, blk_1073742172_1348, blk_1073742173_1349, blk_1073742174_1350, blk_1073742175_1351]
2015-03-13 10:12:55,239 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742188_1364
2015-03-13 10:12:55,240 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742185_1361
2015-03-13 10:12:55,241 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742181_1357
2015-03-13 10:12:55,241 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742187_1363
2015-03-13 10:12:55,241 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742189_1365
2015-03-13 10:12:55,242 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742184_1360
2015-03-13 10:12:55,242 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742179_1355
2015-03-13 10:12:55,242 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742177_1353
2015-03-13 10:12:55,293 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:55,293 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:55,294 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0030_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:12:55,658 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742176_1352 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742176 for deletion
2015-03-13 10:12:55,658 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742172_1348 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742172 for deletion
2015-03-13 10:12:55,659 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742173_1349 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742173 for deletion
2015-03-13 10:12:55,659 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742174_1350 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742174 for deletion
2015-03-13 10:12:55,659 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742176_1352 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742176
2015-03-13 10:12:55,659 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742174_1350 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742174
2015-03-13 10:12:55,659 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742172_1348 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742172
2015-03-13 10:12:55,659 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742173_1349 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742173
2015-03-13 10:12:55,878 INFO  datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-1589780806-10.1.1.144-60693-1426266259390, infoPort=60694, ipcPort=60695, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073742186_1362 to 127.0.0.1:60689 
2015-03-13 10:12:55,878 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742176_1352 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742176 for deletion
2015-03-13 10:12:55,879 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742178_1354 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742178 for deletion
2015-03-13 10:12:55,879 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742172_1348 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742172 for deletion
2015-03-13 10:12:55,879 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742173_1349 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742173 for deletion
2015-03-13 10:12:55,879 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742174_1350 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742174 for deletion
2015-03-13 10:12:55,879 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742175_1351 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742175 for deletion
2015-03-13 10:12:55,880 INFO  datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073742186_1362 (numBytes=254067) to /127.0.0.1:60689
2015-03-13 10:12:55,881 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742176_1352 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742176
2015-03-13 10:12:55,881 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742178_1354 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742178
2015-03-13 10:12:55,882 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742172_1348 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742172
2015-03-13 10:12:55,882 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742174_1350 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742174
2015-03-13 10:12:55,882 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742173_1349 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742173
2015-03-13 10:12:55,882 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742175_1351 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742175
2015-03-13 10:12:55,883 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742186_1362 src: /127.0.0.1:63404 dest: /127.0.0.1:60689
2015-03-13 10:12:55,885 INFO  datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073742186_1362 src: /127.0.0.1:63404 dest: /127.0.0.1:60689 of size 254067
2015-03-13 10:12:55,886 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742186_1362 size 254067
2015-03-13 10:12:56,195 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742178_1354
2015-03-13 10:12:56,195 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742183_1359
2015-03-13 10:12:56,195 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742188_1364
2015-03-13 10:12:56,196 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742180_1356
2015-03-13 10:12:56,196 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742184_1360
2015-03-13 10:12:56,196 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742182_1358
2015-03-13 10:12:56,197 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742181_1357
2015-03-13 10:12:56,250 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742187_1363
2015-03-13 10:12:56,250 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742180_1356
2015-03-13 10:12:56,250 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742182_1358
2015-03-13 10:12:56,252 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742186_1362
2015-03-13 10:12:56,298 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:56,298 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:56,354 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:12:56,375 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/COMMIT_STARTED	dst=null	perm=null
2015-03-13 10:12:56,376 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/COMMIT_SUCCESS	dst=null	perm=null
2015-03-13 10:12:56,377 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/COMMIT_FAIL	dst=null	perm=null
2015-03-13 10:12:56,397 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742186_1362
2015-03-13 10:12:56,398 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742187_1363
2015-03-13 10:12:56,399 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742189_1365
2015-03-13 10:12:56,399 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742179_1355
2015-03-13 10:12:56,435 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030	dst=null	perm=null
2015-03-13 10:12:56,437 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:12:56,438 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:12:56,453 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742185_1361
2015-03-13 10:12:56,454 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742183_1359
2015-03-13 10:12:56,454 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742177_1353
2015-03-13 10:12:56,455 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742189_1365
2015-03-13 10:12:56,455 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742188_1364
2015-03-13 10:12:56,727 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:12:56,734 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:12:56,795 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63406, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_674940707_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742188_1364, duration: 123000
2015-03-13 10:12:56,796 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742177_1353
2015-03-13 10:12:56,797 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742179_1355
2015-03-13 10:12:56,797 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742181_1357
2015-03-13 10:12:56,797 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742183_1359
2015-03-13 10:12:56,797 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742182_1358
2015-03-13 10:12:56,798 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742178_1354
2015-03-13 10:12:57,000 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742186_1362
2015-03-13 10:12:57,000 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742187_1363
2015-03-13 10:12:57,001 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742180_1356
2015-03-13 10:12:57,001 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742184_1360
2015-03-13 10:12:57,002 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742185_1361
2015-03-13 10:12:57,300 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:57,300 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:57,590 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0030_000001 (auth:SIMPLE)
2015-03-13 10:12:57,592 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0030_000001
2015-03-13 10:12:57,592 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi	IP=10.1.1.144	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1426266260362_0030	APPATTEMPTID=appattempt_1426266260362_0030_000001
2015-03-13 10:12:57,592 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0030_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:12:57,592 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0030 State change from ACCEPTED to RUNNING
2015-03-13 10:12:57,614 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job_1426266260362_0030_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:57,615 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:12:57,700 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job_1426266260362_0030_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:57,817 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job_1426266260362_0030_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742190_1366{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:12:57,857 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742190_1366 src: /127.0.0.1:63412 dest: /127.0.0.1:60689
2015-03-13 10:12:57,858 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742190_1366 src: /127.0.0.1:63413 dest: /127.0.0.1:60686
2015-03-13 10:12:57,860 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742190_1366 src: /127.0.0.1:63414 dest: /127.0.0.1:60696
2015-03-13 10:12:57,871 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63414, dest: /127.0.0.1:60696, bytes: 91010, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_674940707_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742190_1366, duration: 5870000
2015-03-13 10:12:57,871 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742190_1366, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:57,871 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742190_1366{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:57,871 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63413, dest: /127.0.0.1:60686, bytes: 91010, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_674940707_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742190_1366, duration: 10147000
2015-03-13 10:12:57,872 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742190_1366, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:57,872 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742190_1366{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:57,872 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63412, dest: /127.0.0.1:60689, bytes: 91010, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_674940707_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742190_1366, duration: 11052000
2015-03-13 10:12:57,872 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742190_1366, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:57,873 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742190_1366{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:57,877 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job_1426266260362_0030_1_conf.xml is closed by DFSClient_NONMAPREDUCE_674940707_1
2015-03-13 10:12:58,103 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073742178_1354, blk_1073742172_1348, blk_1073742173_1349, blk_1073742175_1351]
2015-03-13 10:12:58,103 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073742176_1352, blk_1073742178_1354, blk_1073742172_1348, blk_1073742173_1349, blk_1073742174_1350, blk_1073742175_1351]
2015-03-13 10:12:58,304 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:58,304 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:58,659 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742176_1352 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742176 for deletion
2015-03-13 10:12:58,659 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742178_1354 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742178 for deletion
2015-03-13 10:12:58,659 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742172_1348 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742172 for deletion
2015-03-13 10:12:58,659 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742176_1352 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742176
2015-03-13 10:12:58,659 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742173_1349 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742173 for deletion
2015-03-13 10:12:58,659 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742178_1354 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742178
2015-03-13 10:12:58,659 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742174_1350 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742174 for deletion
2015-03-13 10:12:58,660 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742175_1351 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742175 for deletion
2015-03-13 10:12:58,660 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742172_1348 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742172
2015-03-13 10:12:58,660 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742173_1349 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742173
2015-03-13 10:12:58,660 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742174_1350 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742174
2015-03-13 10:12:58,660 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742175_1351 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742175
2015-03-13 10:12:58,873 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0030_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:12:58,873 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0030	CONTAINERID=container_1426266260362_0030_01_000002
2015-03-13 10:12:58,873 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0030_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:12:58,873 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0030 container=Container: [ContainerId: container_1426266260362_0030_01_000002, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0030_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:58,874 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:12:58,874 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:58,874 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0030_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:12:58,874 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0030	CONTAINERID=container_1426266260362_0030_01_000003
2015-03-13 10:12:58,875 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0030_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:12:58,875 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0030 container=Container: [ContainerId: container_1426266260362_0030_01_000003, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0030_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:58,875 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:12:58,875 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:58,876 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0030_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:12:58,876 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0030	CONTAINERID=container_1426266260362_0030_01_000004
2015-03-13 10:12:58,876 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0030_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:12:58,876 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0030 container=Container: [ContainerId: container_1426266260362_0030_01_000004, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0030_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:58,876 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:12:58,877 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:58,877 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0030_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:12:58,877 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0030	CONTAINERID=container_1426266260362_0030_01_000005
2015-03-13 10:12:58,877 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0030_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:12:58,877 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0030 container=Container: [ContainerId: container_1426266260362_0030_01_000005, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0030_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:58,877 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:12:58,877 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:58,878 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0030_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:12:58,878 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0030	CONTAINERID=container_1426266260362_0030_01_000006
2015-03-13 10:12:58,878 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0030_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:12:58,878 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0030 container=Container: [ContainerId: container_1426266260362_0030_01_000006, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0030_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:58,878 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7
2015-03-13 10:12:58,878 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:59,065 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742178_1354 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742178 for deletion
2015-03-13 10:12:59,065 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742172_1348 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742172 for deletion
2015-03-13 10:12:59,065 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742173_1349 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742173 for deletion
2015-03-13 10:12:59,065 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742178_1354 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742178
2015-03-13 10:12:59,065 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742175_1351 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742175 for deletion
2015-03-13 10:12:59,066 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742173_1349 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742173
2015-03-13 10:12:59,066 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742172_1348 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742172
2015-03-13 10:12:59,066 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742175_1351 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742175
2015-03-13 10:12:59,098 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0029_01_000001 succeeded 
2015-03-13 10:12:59,098 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:12:59,098 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0029_01_000001
2015-03-13 10:12:59,105 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000001
2015-03-13 10:12:59,105 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000001
2015-03-13 10:12:59,106 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000001
2015-03-13 10:12:59,105 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000001
2015-03-13 10:12:59,106 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0029	CONTAINERID=container_1426266260362_0029_01_000001
2015-03-13 10:12:59,106 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:12:59,106 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0029_01_000001 from application application_1426266260362_0029
2015-03-13 10:12:59,106 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:59,106 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0029
2015-03-13 10:12:59,308 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:12:59,308 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0029_01_000001
2015-03-13 10:12:59,308 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:59,309 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0029_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:12:59,309 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0029_000001
2015-03-13 10:12:59,309 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0029_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:12:59,309 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0029	CONTAINERID=container_1426266260362_0029_01_000001
2015-03-13 10:12:59,309 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0029_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:12:59,309 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0029_000001 State change from FINISHING to FINISHED
2015-03-13 10:12:59,309 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:7168, vCores:6> numContainers=6 user=soberoi user-resources=<memory:7168, vCores:6>
2015-03-13 10:12:59,310 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0029 State change from FINISHING to FINISHED
2015-03-13 10:12:59,310 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0029_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:59,310 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1426266260362_0029
2015-03-13 10:12:59,310 INFO  amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0029_000001
2015-03-13 10:12:59,310 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:59,310 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0029,name=[B61955F7F1A34D09B0265BE65DDD3B28/8EF7DC42A1E14629BD263FCEE1EED9A7] lower*upper1*upper2/(2/3),user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0029/jobhistory/job/job_1426266260362_0029,appMasterHost=Edinburgh.local,startTime=1426266757667,finishTime=1426266773064,finalStatus=SUCCEEDED
2015-03-13 10:12:59,310 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6
2015-03-13 10:12:59,311 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0029_000001 released container container_1426266260362_0029_01_000001 on node: host: 10.1.1.144:60715 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:12:59,311 INFO  capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0029_000001 is done. finalState=FINISHED
2015-03-13 10:12:59,311 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0029 requests cleared
2015-03-13 10:12:59,311 INFO  capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0029 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:12:59,311 INFO  capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0029 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:12:59,313 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0029_000001 (auth:SIMPLE)
2015-03-13 10:12:59,314 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0029_01_000001
2015-03-13 10:12:59,626 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0030_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:12:59,626 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0030_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:12:59,626 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0030_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:12:59,626 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0030_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:12:59,626 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0030_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:12:59,652 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.jar	dst=null	perm=null
2015-03-13 10:12:59,653 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.jar	dst=null	perm=null
2015-03-13 10:12:59,662 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.xml	dst=null	perm=null
2015-03-13 10:12:59,663 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.xml	dst=null	perm=null
2015-03-13 10:12:59,665 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:12:59,667 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:12:59,672 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:12:59,673 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:12:59,674 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:12:59,676 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:12:59,730 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0030_000001 (auth:SIMPLE)
2015-03-13 10:12:59,730 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0030_000001 (auth:SIMPLE)
2015-03-13 10:12:59,733 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0030_01_000005 by user soberoi
2015-03-13 10:12:59,733 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0030
2015-03-13 10:12:59,733 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0030_01_000006 by user soberoi
2015-03-13 10:12:59,733 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0030	CONTAINERID=container_1426266260362_0030_01_000005
2015-03-13 10:12:59,733 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0030_01_000003 by user soberoi
2015-03-13 10:12:59,734 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0030	CONTAINERID=container_1426266260362_0030_01_000003
2015-03-13 10:12:59,734 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0030 transitioned from NEW to INITING
2015-03-13 10:12:59,734 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0030_01_000005 to application application_1426266260362_0030
2015-03-13 10:12:59,734 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0030_01_000003 to application application_1426266260362_0030
2015-03-13 10:12:59,734 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0030 transitioned from INITING to RUNNING
2015-03-13 10:12:59,734 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0030_01_000004 by user soberoi
2015-03-13 10:12:59,734 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:12:59,734 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0030	CONTAINERID=container_1426266260362_0030_01_000004
2015-03-13 10:12:59,734 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:12:59,735 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0030
2015-03-13 10:12:59,735 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0030_01_000002 by user soberoi
2015-03-13 10:12:59,733 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0030
2015-03-13 10:12:59,735 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0030	CONTAINERID=container_1426266260362_0030_01_000002
2015-03-13 10:12:59,735 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0030	CONTAINERID=container_1426266260362_0030_01_000006
2015-03-13 10:12:59,735 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0030
2015-03-13 10:12:59,735 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:12:59,735 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0030
2015-03-13 10:12:59,735 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:12:59,735 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:12:59,736 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0030_01_000004 to application application_1426266260362_0030
2015-03-13 10:12:59,736 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0030
2015-03-13 10:12:59,736 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0030
2015-03-13 10:12:59,736 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:12:59,736 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0030
2015-03-13 10:12:59,736 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0030_01_000002 to application application_1426266260362_0030
2015-03-13 10:12:59,736 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0030_01_000005
2015-03-13 10:12:59,736 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0030 transitioned from NEW to INITING
2015-03-13 10:12:59,736 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0030_01_000006 to application application_1426266260362_0030
2015-03-13 10:12:59,736 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0030 transitioned from INITING to RUNNING
2015-03-13 10:12:59,737 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:12:59,737 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0030
2015-03-13 10:12:59,737 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0030
2015-03-13 10:12:59,737 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:12:59,737 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0030
2015-03-13 10:12:59,737 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:12:59,737 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:12:59,737 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0030_01_000006
2015-03-13 10:12:59,737 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:12:59,738 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0030_01_000003
2015-03-13 10:12:59,739 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:12:59,739 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0030
2015-03-13 10:12:59,740 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0030
2015-03-13 10:12:59,740 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:12:59,740 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0030
2015-03-13 10:12:59,740 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0030
2015-03-13 10:12:59,740 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0030
2015-03-13 10:12:59,740 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:12:59,740 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0030
2015-03-13 10:12:59,740 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0030_01_000004
2015-03-13 10:12:59,741 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0030_01_000002
2015-03-13 10:12:59,760 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426266260362_0030_01_000006.tokens. Credentials list: 
2015-03-13 10:12:59,761 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0030_01_000003.tokens. Credentials list: 
2015-03-13 10:12:59,762 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0030_01_000004.tokens. Credentials list: 
2015-03-13 10:12:59,762 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0030_01_000005.tokens. Credentials list: 
2015-03-13 10:12:59,763 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1426266260362_0030_01_000002.tokens. Credentials list: 
2015-03-13 10:12:59,786 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:12:59,786 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:12:59,861 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0030_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000003.tokens
2015-03-13 10:12:59,861 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426266260362_0030_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000006.tokens
2015-03-13 10:12:59,861 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0030 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0030
2015-03-13 10:12:59,861 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0030 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0030
2015-03-13 10:12:59,873 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:59,873 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:59,873 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:59,874 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:59,874 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0030_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:12:59,874 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0030_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:12:59,874 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0030_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:12:59,874 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0030_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:12:59,876 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:59,876 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0030_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:12:59,928 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.jar	dst=null	perm=null
2015-03-13 10:12:59,928 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.jar	dst=null	perm=null
2015-03-13 10:12:59,928 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0029 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:12:59,928 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0029
2015-03-13 10:12:59,928 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0029
2015-03-13 10:12:59,928 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0029 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:12:59,929 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0029, with delay of 10800 seconds
2015-03-13 10:12:59,929 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0029
2015-03-13 10:12:59,929 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0029
2015-03-13 10:12:59,929 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0029
2015-03-13 10:12:59,930 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.jar	dst=null	perm=null
2015-03-13 10:12:59,930 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.jar	dst=null	perm=null
2015-03-13 10:12:59,931 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.jar	dst=null	perm=null
2015-03-13 10:12:59,931 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.jar	dst=null	perm=null
2015-03-13 10:12:59,938 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63423, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-2122296876_16061, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742186_1362, duration: 509000
2015-03-13 10:12:59,938 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63422, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1515957640_16062, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742186_1362, duration: 563000
2015-03-13 10:12:59,959 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:12:59,959 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:12:59,978 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.xml	dst=null	perm=null
2015-03-13 10:12:59,978 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.xml	dst=null	perm=null
2015-03-13 10:12:59,978 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.xml	dst=null	perm=null
2015-03-13 10:12:59,979 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.xml	dst=null	perm=null
2015-03-13 10:12:59,979 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.xml	dst=null	perm=null
2015-03-13 10:12:59,980 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.xml	dst=null	perm=null
2015-03-13 10:12:59,986 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63422, bytes: 98988, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-2122296876_16061, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742189_1365, duration: 277000
2015-03-13 10:12:59,987 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63424, bytes: 98988, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1515957640_16062, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742189_1365, duration: 249000
2015-03-13 10:13:00,004 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:13:00,004 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:13:00,005 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:13:00,005 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:13:00,005 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:13:00,005 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:13:00,005 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:13:00,061 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:13:00,061 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:13:00,061 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:00,061 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:00,071 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:13:00,071 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:00,071 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:13:00,071 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:00,071 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:13:00,071 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:00,204 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000002/default_container_executor.sh]
2015-03-13 10:13:00,213 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000005/default_container_executor.sh]
2015-03-13 10:13:00,224 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000004/default_container_executor.sh]
2015-03-13 10:13:00,225 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000003/default_container_executor.sh]
2015-03-13 10:13:00,233 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000006/default_container_executor.sh]
2015-03-13 10:13:00,248 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742190_1366
2015-03-13 10:13:00,311 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:00,312 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0029 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:13:00,312 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0029
2015-03-13 10:13:00,312 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0029
2015-03-13 10:13:00,312 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0029
2015-03-13 10:13:00,312 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0029 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:13:00,312 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0029, with delay of 10800 seconds
2015-03-13 10:13:00,312 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0029
2015-03-13 10:13:00,313 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0029
2015-03-13 10:13:00,452 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742186_1362
2015-03-13 10:13:00,643 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:13:00,879 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:00,879 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:00,879 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:00,879 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:00,879 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:01,036 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:13:01,151 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1426266260362_0030_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000002.tokens
2015-03-13 10:13:01,151 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0030 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0030
2015-03-13 10:13:01,255 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:13:01,313 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:01,371 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0030_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000005.tokens
2015-03-13 10:13:01,371 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0030 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0030
2015-03-13 10:13:01,403 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742190_1366
2015-03-13 10:13:01,463 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:13:01,589 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0030_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000004.tokens
2015-03-13 10:13:01,589 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0030 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0030
2015-03-13 10:13:01,881 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:01,881 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:01,881 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:01,881 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:01,881 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:02,010 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742190_1366
2015-03-13 10:13:02,315 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:02,886 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:02,886 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:02,886 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:02,886 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:02,886 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:03,315 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:03,889 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:03,890 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:03,890 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:03,890 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:03,890 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:04,317 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:04,890 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:04,891 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:04,891 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:04,891 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:04,891 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:05,320 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:05,894 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:05,894 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:05,894 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:05,894 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:05,895 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:06,321 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:06,896 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:06,896 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:06,896 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:06,896 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:06,896 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:07,324 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:07,897 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:07,901 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:07,902 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:07,902 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:07,902 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:07,949 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.split	dst=null	perm=null
2015-03-13 10:13:08,172 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.split	dst=null	perm=null
2015-03-13 10:13:08,188 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.split	dst=null	perm=null
2015-03-13 10:13:08,195 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.split	dst=null	perm=null
2015-03-13 10:13:08,246 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.split	dst=null	perm=null
2015-03-13 10:13:08,254 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63437, bytes: 1282, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000002_0_-1467547046_1, offset: 512, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742187_1363, duration: 160000
2015-03-13 10:13:08,325 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:08,360 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63439, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000004_0_-686168108_1, offset: 1024, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742187_1363, duration: 157000
2015-03-13 10:13:08,373 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63441, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000000_0_-709999944_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742187_1363, duration: 148000
2015-03-13 10:13:08,378 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63440, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000003_0_-1108770989_1, offset: 1024, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742187_1363, duration: 145000
2015-03-13 10:13:08,406 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:13:08,410 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63443, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000002_0_-1467547046_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 177000
2015-03-13 10:13:08,415 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63442, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000001_0_173823530_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742187_1363, duration: 150000
2015-03-13 10:13:08,441 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/_temporary/attempt_1426266260362_0030_m_000002_0/part-00002	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:08,493 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:13:08,495 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:13:08,499 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63444, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000004_0_-686168108_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 154000
2015-03-13 10:13:08,515 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/_temporary/attempt_1426266260362_0030_m_000004_0/part-00004	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:08,515 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:13:08,521 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63445, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000003_0_-1108770989_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 146000
2015-03-13 10:13:08,529 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/_temporary/attempt_1426266260362_0030_m_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:08,538 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:13:08,542 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63446, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000001_0_173823530_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 133000
2015-03-13 10:13:08,559 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/_temporary/attempt_1426266260362_0030_m_000003_0/part-00003	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:08,585 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/_temporary/attempt_1426266260362_0030_m_000001_0/part-00001	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:08,839 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5	dst=null	perm=null
2015-03-13 10:13:08,845 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5	dst=null	perm=null
2015-03-13 10:13:08,847 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5	dst=null	perm=null
2015-03-13 10:13:08,895 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00000	dst=null	perm=null
2015-03-13 10:13:08,896 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00000	dst=null	perm=null
2015-03-13 10:13:08,899 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63447, bytes: 142, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000002_0_-1467547046_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742179_1355, duration: 153000
2015-03-13 10:13:08,899 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:08,907 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:08,908 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:08,908 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:08,908 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:08,914 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00001	dst=null	perm=null
2015-03-13 10:13:08,915 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00001	dst=null	perm=null
2015-03-13 10:13:08,917 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63447, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000002_0_-1467547046_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742181_1357, duration: 156000
2015-03-13 10:13:08,919 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00002	dst=null	perm=null
2015-03-13 10:13:08,920 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00002	dst=null	perm=null
2015-03-13 10:13:08,923 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63448, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000002_0_-1467547046_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742180_1356, duration: 160000
2015-03-13 10:13:08,925 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00003	dst=null	perm=null
2015-03-13 10:13:08,926 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00003	dst=null	perm=null
2015-03-13 10:13:08,928 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63448, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000002_0_-1467547046_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742182_1358, duration: 144000
2015-03-13 10:13:08,930 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00004	dst=null	perm=null
2015-03-13 10:13:08,932 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00004	dst=null	perm=null
2015-03-13 10:13:08,934 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63448, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000002_0_-1467547046_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742177_1353, duration: 159000
2015-03-13 10:13:08,935 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5	dst=null	perm=null
2015-03-13 10:13:08,941 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5	dst=null	perm=null
2015-03-13 10:13:08,943 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5	dst=null	perm=null
2015-03-13 10:13:08,954 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5	dst=null	perm=null
2015-03-13 10:13:08,962 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/_temporary/attempt_1426266260362_0030_m_000002_0/part-00002. BP-1005356445-10.1.1.144-1426266257849 blk_1073742191_1367{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:13:08,979 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5	dst=null	perm=null
2015-03-13 10:13:08,984 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5	dst=null	perm=null
2015-03-13 10:13:08,986 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5	dst=null	perm=null
2015-03-13 10:13:08,988 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5	dst=null	perm=null
2015-03-13 10:13:08,989 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5	dst=null	perm=null
2015-03-13 10:13:09,003 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742191_1367 src: /127.0.0.1:63449 dest: /127.0.0.1:60693
2015-03-13 10:13:09,004 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742191_1367 src: /127.0.0.1:63450 dest: /127.0.0.1:60689
2015-03-13 10:13:09,005 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00000	dst=null	perm=null
2015-03-13 10:13:09,006 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742191_1367 src: /127.0.0.1:63451 dest: /127.0.0.1:60686
2015-03-13 10:13:09,010 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00000	dst=null	perm=null
2015-03-13 10:13:09,013 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63439, bytes: 142, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000004_0_-686168108_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742179_1355, duration: 150000
2015-03-13 10:13:09,014 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63451, dest: /127.0.0.1:60686, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0030_m_000002_0_-1467547046_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742191_1367, duration: 7031000
2015-03-13 10:13:09,015 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742191_1367, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:09,015 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742191_1367{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:09,015 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63450, dest: /127.0.0.1:60689, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0030_m_000002_0_-1467547046_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742191_1367, duration: 7613000
2015-03-13 10:13:09,015 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742191_1367, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:09,016 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742191_1367{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:09,016 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63449, dest: /127.0.0.1:60693, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0030_m_000002_0_-1467547046_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742191_1367, duration: 8393000
2015-03-13 10:13:09,016 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742191_1367, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:09,016 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742191_1367{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:09,020 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/_temporary/attempt_1426266260362_0030_m_000002_0/part-00002 is closed by DFSClient_attempt_1426266260362_0030_m_000002_0_-1467547046_1
2015-03-13 10:13:09,028 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/_temporary/attempt_1426266260362_0030_m_000002_0	dst=null	perm=null
2015-03-13 10:13:09,034 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/_temporary/attempt_1426266260362_0030_m_000002_0	dst=null	perm=null
2015-03-13 10:13:09,035 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/task_1426266260362_0030_m_000002	dst=null	perm=null
2015-03-13 10:13:09,037 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00001	dst=null	perm=null
2015-03-13 10:13:09,038 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00001	dst=null	perm=null
2015-03-13 10:13:09,038 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/_temporary/attempt_1426266260362_0030_m_000002_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/task_1426266260362_0030_m_000002	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:13:09,040 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00000	dst=null	perm=null
2015-03-13 10:13:09,041 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63452, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000004_0_-686168108_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742181_1357, duration: 153000
2015-03-13 10:13:09,041 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00000	dst=null	perm=null
2015-03-13 10:13:09,043 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00002	dst=null	perm=null
2015-03-13 10:13:09,043 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63453, bytes: 142, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000003_0_-1108770989_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742179_1355, duration: 148000
2015-03-13 10:13:09,045 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00002	dst=null	perm=null
2015-03-13 10:13:09,047 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63454, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000004_0_-686168108_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742180_1356, duration: 157000
2015-03-13 10:13:09,049 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00003	dst=null	perm=null
2015-03-13 10:13:09,051 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00003	dst=null	perm=null
2015-03-13 10:13:09,054 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63455, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000004_0_-686168108_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742182_1358, duration: 159000
2015-03-13 10:13:09,056 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00004	dst=null	perm=null
2015-03-13 10:13:09,058 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00004	dst=null	perm=null
2015-03-13 10:13:09,060 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0030_01_000004
2015-03-13 10:13:09,060 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0030	CONTAINERID=container_1426266260362_0030_01_000004
2015-03-13 10:13:09,060 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:13:09,060 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0030_01_000004
2015-03-13 10:13:09,060 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63452, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000004_0_-686168108_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742177_1353, duration: 147000
2015-03-13 10:13:09,060 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:09,060 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00001	dst=null	perm=null
2015-03-13 10:13:09,061 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:09,061 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:13:09,061 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:09,063 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00001	dst=null	perm=null
2015-03-13 10:13:09,065 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63453, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000003_0_-1108770989_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742181_1357, duration: 167000
2015-03-13 10:13:09,072 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0030_01_000004 is : 143
2015-03-13 10:13:09,075 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job_1426266260362_0030_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073742192_1368{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:13:09,077 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742192_1368 src: /127.0.0.1:63456 dest: /127.0.0.1:60693
2015-03-13 10:13:09,078 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742192_1368 src: /127.0.0.1:63457 dest: /127.0.0.1:60696
2015-03-13 10:13:09,080 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742192_1368 src: /127.0.0.1:63458 dest: /127.0.0.1:60689
2015-03-13 10:13:09,084 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00002	dst=null	perm=null
2015-03-13 10:13:09,084 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:13:09,085 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000004
2015-03-13 10:13:09,085 INFO  hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job_1426266260362_0030_1.jhist for DFSClient_NONMAPREDUCE_674940707_1
2015-03-13 10:13:09,085 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000004
2015-03-13 10:13:09,085 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0030	CONTAINERID=container_1426266260362_0030_01_000004
2015-03-13 10:13:09,085 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:13:09,085 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0030_01_000004 from application application_1426266260362_0030
2015-03-13 10:13:09,085 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:09,085 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0030
2015-03-13 10:13:09,086 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000004
2015-03-13 10:13:09,086 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000004
2015-03-13 10:13:09,094 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5	dst=null	perm=null
2015-03-13 10:13:09,096 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/_temporary/attempt_1426266260362_0030_m_000004_0/part-00004 is closed by DFSClient_attempt_1426266260362_0030_m_000004_0_-686168108_1
2015-03-13 10:13:09,096 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00002	dst=null	perm=null
2015-03-13 10:13:09,100 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63459, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000003_0_-1108770989_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742180_1356, duration: 190000
2015-03-13 10:13:09,101 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5	dst=null	perm=null
2015-03-13 10:13:09,104 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00003	dst=null	perm=null
2015-03-13 10:13:09,105 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00003	dst=null	perm=null
2015-03-13 10:13:09,107 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63459, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000003_0_-1108770989_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742182_1358, duration: 151000
2015-03-13 10:13:09,111 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00004	dst=null	perm=null
2015-03-13 10:13:09,113 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/_temporary/attempt_1426266260362_0030_m_000004_0	dst=null	perm=null
2015-03-13 10:13:09,114 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00004	dst=null	perm=null
2015-03-13 10:13:09,116 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63453, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000003_0_-1108770989_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742177_1353, duration: 152000
2015-03-13 10:13:09,118 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5	dst=null	perm=null
2015-03-13 10:13:09,119 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/_temporary/attempt_1426266260362_0030_m_000004_0	dst=null	perm=null
2015-03-13 10:13:09,120 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/task_1426266260362_0030_m_000004	dst=null	perm=null
2015-03-13 10:13:09,124 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/_temporary/attempt_1426266260362_0030_m_000004_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/task_1426266260362_0030_m_000004	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:13:09,129 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00000	dst=null	perm=null
2015-03-13 10:13:09,130 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00000	dst=null	perm=null
2015-03-13 10:13:09,133 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63460, bytes: 142, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000000_0_-709999944_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742179_1355, duration: 155000
2015-03-13 10:13:09,134 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0030_01_000006
2015-03-13 10:13:09,135 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0030	CONTAINERID=container_1426266260362_0030_01_000006
2015-03-13 10:13:09,135 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:13:09,135 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0030_01_000006
2015-03-13 10:13:09,135 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:13:09,147 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0030_01_000006 is : 143
2015-03-13 10:13:09,153 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00001	dst=null	perm=null
2015-03-13 10:13:09,155 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00001	dst=null	perm=null
2015-03-13 10:13:09,158 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63461, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000000_0_-709999944_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742181_1357, duration: 145000
2015-03-13 10:13:09,159 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:13:09,159 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000006
2015-03-13 10:13:09,160 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000006
2015-03-13 10:13:09,160 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000006
2015-03-13 10:13:09,161 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000006
2015-03-13 10:13:09,161 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0030	CONTAINERID=container_1426266260362_0030_01_000006
2015-03-13 10:13:09,161 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:13:09,161 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0030_01_000006 from application application_1426266260362_0030
2015-03-13 10:13:09,161 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:09,162 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0030
2015-03-13 10:13:09,168 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/_temporary/attempt_1426266260362_0030_m_000003_0/part-00003. BP-1005356445-10.1.1.144-1426266257849 blk_1073742193_1369{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:13:09,171 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00002	dst=null	perm=null
2015-03-13 10:13:09,173 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00002	dst=null	perm=null
2015-03-13 10:13:09,175 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63460, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000000_0_-709999944_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742180_1356, duration: 150000
2015-03-13 10:13:09,175 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00000	dst=null	perm=null
2015-03-13 10:13:09,177 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00000	dst=null	perm=null
2015-03-13 10:13:09,179 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63442, bytes: 142, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000001_0_173823530_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742179_1355, duration: 148000
2015-03-13 10:13:09,183 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00003	dst=null	perm=null
2015-03-13 10:13:09,188 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00003	dst=null	perm=null
2015-03-13 10:13:09,191 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63460, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000000_0_-709999944_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742182_1358, duration: 155000
2015-03-13 10:13:09,192 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00004	dst=null	perm=null
2015-03-13 10:13:09,194 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00004	dst=null	perm=null
2015-03-13 10:13:09,195 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63441, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000000_0_-709999944_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742177_1353, duration: 152000
2015-03-13 10:13:09,199 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63441, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000000_0_-709999944_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 144000
2015-03-13 10:13:09,204 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00001	dst=null	perm=null
2015-03-13 10:13:09,205 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00001	dst=null	perm=null
2015-03-13 10:13:09,207 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63442, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000001_0_173823530_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742181_1357, duration: 149000
2015-03-13 10:13:09,211 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00002	dst=null	perm=null
2015-03-13 10:13:09,213 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00002	dst=null	perm=null
2015-03-13 10:13:09,215 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742193_1369 src: /127.0.0.1:63462 dest: /127.0.0.1:60689
2015-03-13 10:13:09,215 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63442, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000001_0_173823530_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742180_1356, duration: 164000
2015-03-13 10:13:09,216 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742193_1369 src: /127.0.0.1:63463 dest: /127.0.0.1:60686
2015-03-13 10:13:09,218 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742193_1369 src: /127.0.0.1:63464 dest: /127.0.0.1:60693
2015-03-13 10:13:09,228 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/_temporary/attempt_1426266260362_0030_m_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073742194_1370{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:13:09,228 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00003	dst=null	perm=null
2015-03-13 10:13:09,229 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63464, dest: /127.0.0.1:60693, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0030_m_000003_0_-1108770989_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742193_1369, duration: 9680000
2015-03-13 10:13:09,229 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742193_1369, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:09,230 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742193_1369{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:09,240 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63463, dest: /127.0.0.1:60686, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0030_m_000003_0_-1108770989_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742193_1369, duration: 9806000
2015-03-13 10:13:09,240 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742193_1369, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:09,241 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63462, dest: /127.0.0.1:60689, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0030_m_000003_0_-1108770989_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742193_1369, duration: 20873000
2015-03-13 10:13:09,241 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742193_1369, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:09,241 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00003	dst=null	perm=null
2015-03-13 10:13:09,243 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742193_1369{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:09,243 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742193_1369{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:09,250 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/_temporary/attempt_1426266260362_0030_m_000003_0/part-00003 is closed by DFSClient_attempt_1426266260362_0030_m_000003_0_-1108770989_1
2015-03-13 10:13:09,253 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63442, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000001_0_173823530_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742182_1358, duration: 145000
2015-03-13 10:13:09,256 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00004	dst=null	perm=null
2015-03-13 10:13:09,257 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00004	dst=null	perm=null
2015-03-13 10:13:09,260 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63442, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000001_0_173823530_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742177_1353, duration: 178000
2015-03-13 10:13:09,262 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/_temporary/attempt_1426266260362_0030_m_000003_0	dst=null	perm=null
2015-03-13 10:13:09,269 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/_temporary/attempt_1426266260362_0030_m_000003_0	dst=null	perm=null
2015-03-13 10:13:09,270 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/task_1426266260362_0030_m_000003	dst=null	perm=null
2015-03-13 10:13:09,273 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/_temporary/attempt_1426266260362_0030_m_000003_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/task_1426266260362_0030_m_000003	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:13:09,273 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742194_1370 src: /127.0.0.1:63465 dest: /127.0.0.1:60696
2015-03-13 10:13:09,275 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742194_1370 src: /127.0.0.1:63466 dest: /127.0.0.1:60693
2015-03-13 10:13:09,276 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742194_1370 src: /127.0.0.1:63467 dest: /127.0.0.1:60686
2015-03-13 10:13:09,284 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63467, dest: /127.0.0.1:60686, bytes: 24, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0030_m_000000_0_-709999944_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742194_1370, duration: 6539000
2015-03-13 10:13:09,284 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742194_1370, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:09,285 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742194_1370{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:09,285 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63466, dest: /127.0.0.1:60693, bytes: 24, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0030_m_000000_0_-709999944_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742194_1370, duration: 7757000
2015-03-13 10:13:09,285 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742194_1370, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:09,286 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63465, dest: /127.0.0.1:60696, bytes: 24, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0030_m_000000_0_-709999944_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742194_1370, duration: 8780000
2015-03-13 10:13:09,286 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742194_1370, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:09,287 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742194_1370{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:09,287 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742194_1370{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:09,291 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0030_01_000005
2015-03-13 10:13:09,291 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0030	CONTAINERID=container_1426266260362_0030_01_000005
2015-03-13 10:13:09,291 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:13:09,291 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0030_01_000005
2015-03-13 10:13:09,292 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:09,292 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:09,292 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:13:09,292 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0030_01_000004
2015-03-13 10:13:09,292 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:13:09,292 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0030_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:13:09,292 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0030_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:13:09,293 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0030	CONTAINERID=container_1426266260362_0030_01_000004
2015-03-13 10:13:09,293 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0030_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:13:09,293 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:13:09,293 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0030_01_000004, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:09,293 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:09,293 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:13:09,293 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0030_000001 released container container_1426266260362_0030_01_000004 on node: host: 10.1.1.144:60711 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:13:09,304 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0030_01_000005 is : 143
2015-03-13 10:13:09,310 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/_temporary/attempt_1426266260362_0030_m_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0030_m_000000_0_-709999944_1
2015-03-13 10:13:09,316 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:13:09,317 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000005
2015-03-13 10:13:09,317 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0030	CONTAINERID=container_1426266260362_0030_01_000005
2015-03-13 10:13:09,317 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:13:09,317 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0030_01_000005 from application application_1426266260362_0030
2015-03-13 10:13:09,317 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:09,317 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0030
2015-03-13 10:13:09,317 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000005
2015-03-13 10:13:09,318 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000005
2015-03-13 10:13:09,318 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000005
2015-03-13 10:13:09,319 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/_temporary/attempt_1426266260362_0030_m_000001_0/part-00001. BP-1005356445-10.1.1.144-1426266257849 blk_1073742195_1371{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:13:09,322 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/_temporary/attempt_1426266260362_0030_m_000000_0	dst=null	perm=null
2015-03-13 10:13:09,326 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:09,331 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/_temporary/attempt_1426266260362_0030_m_000000_0	dst=null	perm=null
2015-03-13 10:13:09,332 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/task_1426266260362_0030_m_000000	dst=null	perm=null
2015-03-13 10:13:09,336 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/_temporary/attempt_1426266260362_0030_m_000000_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/task_1426266260362_0030_m_000000	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:13:09,348 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0030_01_000002
2015-03-13 10:13:09,349 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0030	CONTAINERID=container_1426266260362_0030_01_000002
2015-03-13 10:13:09,349 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:09,349 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:13:09,349 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:09,349 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0030_01_000002
2015-03-13 10:13:09,349 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:13:09,349 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0030_01_000005
2015-03-13 10:13:09,350 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0030_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:13:09,350 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0030_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:13:09,350 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0030	CONTAINERID=container_1426266260362_0030_01_000005
2015-03-13 10:13:09,350 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0030_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:13:09,350 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:13:09,350 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0030_01_000005, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:09,351 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:09,351 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:13:09,351 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0030_000001 released container container_1426266260362_0030_01_000005 on node: host: 10.1.1.144:60711 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:13:09,365 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0030_01_000002 is : 143
2015-03-13 10:13:09,377 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:13:09,377 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000002
2015-03-13 10:13:09,378 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000002
2015-03-13 10:13:09,378 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000002
2015-03-13 10:13:09,379 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000002
2015-03-13 10:13:09,380 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0030	CONTAINERID=container_1426266260362_0030_01_000002
2015-03-13 10:13:09,380 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:13:09,380 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0030_01_000002 from application application_1426266260362_0030
2015-03-13 10:13:09,380 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:09,380 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0030
2015-03-13 10:13:09,383 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742195_1371 src: /127.0.0.1:63468 dest: /127.0.0.1:60686
2015-03-13 10:13:09,384 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742195_1371 src: /127.0.0.1:63469 dest: /127.0.0.1:60689
2015-03-13 10:13:09,385 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742195_1371 src: /127.0.0.1:63470 dest: /127.0.0.1:60693
2015-03-13 10:13:09,393 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63470, dest: /127.0.0.1:60693, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0030_m_000001_0_173823530_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742195_1371, duration: 6152000
2015-03-13 10:13:09,393 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742195_1371, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:09,393 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742195_1371{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:09,394 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63469, dest: /127.0.0.1:60689, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0030_m_000001_0_173823530_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742195_1371, duration: 6656000
2015-03-13 10:13:09,394 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742195_1371, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:09,394 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742195_1371{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:09,394 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63468, dest: /127.0.0.1:60686, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0030_m_000001_0_173823530_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742195_1371, duration: 7407000
2015-03-13 10:13:09,394 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742195_1371, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:09,395 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742195_1371{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:09,401 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/_temporary/attempt_1426266260362_0030_m_000001_0/part-00001 is closed by DFSClient_attempt_1426266260362_0030_m_000001_0_173823530_1
2015-03-13 10:13:09,410 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/_temporary/attempt_1426266260362_0030_m_000001_0	dst=null	perm=null
2015-03-13 10:13:09,416 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/_temporary/attempt_1426266260362_0030_m_000001_0	dst=null	perm=null
2015-03-13 10:13:09,417 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/task_1426266260362_0030_m_000001	dst=null	perm=null
2015-03-13 10:13:09,420 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/_temporary/attempt_1426266260362_0030_m_000001_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/task_1426266260362_0030_m_000001	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:13:09,430 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0030_01_000003
2015-03-13 10:13:09,431 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0030	CONTAINERID=container_1426266260362_0030_01_000003
2015-03-13 10:13:09,431 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:13:09,431 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0030_01_000002
2015-03-13 10:13:09,431 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:13:09,431 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:13:09,432 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0030_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:13:09,432 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0030_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:13:09,432 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0030	CONTAINERID=container_1426266260362_0030_01_000002
2015-03-13 10:13:09,432 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0030_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:13:09,432 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:13:09,432 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0030_01_000002, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:09,432 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:09,432 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:13:09,432 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0030_000001 released container container_1426266260362_0030_01_000002 on node: host: 10.1.1.144:60711 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:13:09,433 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0030_01_000003
2015-03-13 10:13:09,435 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:09,437 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_674940707_1
2015-03-13 10:13:09,441 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1	dst=null	perm=null
2015-03-13 10:13:09,446 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0030_01_000003 is : 143
2015-03-13 10:13:09,448 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin	dst=null	perm=null
2015-03-13 10:13:09,449 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin	dst=null	perm=null
2015-03-13 10:13:09,450 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/task_1426266260362_0030_m_000000	dst=null	perm=null
2015-03-13 10:13:09,451 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/part-00000	dst=null	perm=null
2015-03-13 10:13:09,453 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/task_1426266260362_0030_m_000000/part-00000	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/part-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:09,456 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin	dst=null	perm=null
2015-03-13 10:13:09,457 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin	dst=null	perm=null
2015-03-13 10:13:09,458 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/task_1426266260362_0030_m_000001	dst=null	perm=null
2015-03-13 10:13:09,459 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:13:09,459 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000003
2015-03-13 10:13:09,459 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/part-00001	dst=null	perm=null
2015-03-13 10:13:09,459 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000003
2015-03-13 10:13:09,460 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000003
2015-03-13 10:13:09,461 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000003
2015-03-13 10:13:09,461 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/task_1426266260362_0030_m_000001/part-00001	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/part-00001	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:09,463 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin	dst=null	perm=null
2015-03-13 10:13:09,463 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0030	CONTAINERID=container_1426266260362_0030_01_000003
2015-03-13 10:13:09,463 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:13:09,464 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0030_01_000003 from application application_1426266260362_0030
2015-03-13 10:13:09,464 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin	dst=null	perm=null
2015-03-13 10:13:09,464 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:09,464 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0030
2015-03-13 10:13:09,465 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/task_1426266260362_0030_m_000002	dst=null	perm=null
2015-03-13 10:13:09,466 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/part-00002	dst=null	perm=null
2015-03-13 10:13:09,469 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/task_1426266260362_0030_m_000002/part-00002	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/part-00002	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:09,470 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin	dst=null	perm=null
2015-03-13 10:13:09,471 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin	dst=null	perm=null
2015-03-13 10:13:09,472 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/task_1426266260362_0030_m_000003	dst=null	perm=null
2015-03-13 10:13:09,473 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/part-00003	dst=null	perm=null
2015-03-13 10:13:09,474 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/task_1426266260362_0030_m_000003/part-00003	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/part-00003	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:09,475 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin	dst=null	perm=null
2015-03-13 10:13:09,476 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin	dst=null	perm=null
2015-03-13 10:13:09,477 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/task_1426266260362_0030_m_000004	dst=null	perm=null
2015-03-13 10:13:09,479 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/part-00004	dst=null	perm=null
2015-03-13 10:13:09,480 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/task_1426266260362_0030_m_000004/part-00004	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/part-00004	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:09,484 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary	dst=null	perm=null
2015-03-13 10:13:09,487 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:09,489 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_SUCCESS is closed by DFSClient_NONMAPREDUCE_674940707_1
2015-03-13 10:13:09,490 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:09,492 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_674940707_1
2015-03-13 10:13:09,503 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63458, dest: /127.0.0.1:60689, bytes: 53338, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_674940707_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742192_1368, duration: 421514000
2015-03-13 10:13:09,503 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742192_1368, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:09,504 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742192_1368{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:13:09,504 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63457, dest: /127.0.0.1:60696, bytes: 53338, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_674940707_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742192_1368, duration: 421757000
2015-03-13 10:13:09,504 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742192_1368, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:09,505 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742192_1368{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:13:09,506 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63456, dest: /127.0.0.1:60693, bytes: 53338, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_674940707_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742192_1368, duration: 423532000
2015-03-13 10:13:09,506 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742192_1368, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:09,506 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742192_1368{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:13:09,507 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job_1426266260362_0030_1.jhist is closed by DFSClient_NONMAPREDUCE_674940707_1
2015-03-13 10:13:09,509 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0030.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:09,511 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0030.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742196_1372{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:13:09,513 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742196_1372 src: /127.0.0.1:63471 dest: /127.0.0.1:60696
2015-03-13 10:13:09,514 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742196_1372 src: /127.0.0.1:63472 dest: /127.0.0.1:60689
2015-03-13 10:13:09,515 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742196_1372 src: /127.0.0.1:63473 dest: /127.0.0.1:60686
2015-03-13 10:13:09,518 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63473, dest: /127.0.0.1:60686, bytes: 448, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_674940707_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742196_1372, duration: 1260000
2015-03-13 10:13:09,519 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742196_1372, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:09,519 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742196_1372{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:09,519 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63472, dest: /127.0.0.1:60689, bytes: 448, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_674940707_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742196_1372, duration: 1916000
2015-03-13 10:13:09,519 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742196_1372, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:09,520 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742196_1372{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:09,520 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63471, dest: /127.0.0.1:60696, bytes: 448, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_674940707_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742196_1372, duration: 2719000
2015-03-13 10:13:09,520 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742196_1372, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:09,520 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742196_1372{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:09,522 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0030.summary_tmp is closed by DFSClient_NONMAPREDUCE_674940707_1
2015-03-13 10:13:09,526 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0030.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:09,531 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job_1426266260362_0030_1.jhist	dst=null	perm=null
2015-03-13 10:13:09,532 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0030-1426266774213-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2FC57B5DBC9F57493F-1426266789493-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:13:09,536 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job_1426266260362_0030_1.jhist	dst=null	perm=null
2015-03-13 10:13:09,536 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0030-1426266774213-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2FC57B5DBC9F57493F-1426266789493-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:13:09,537 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job_1426266260362_0030_1.jhist	dst=null	perm=null
2015-03-13 10:13:09,539 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0030-1426266774213-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2FC57B5DBC9F57493F-1426266789493-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:09,541 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63474, bytes: 53758, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_674940707_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742192_1368, duration: 169000
2015-03-13 10:13:09,543 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0030-1426266774213-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2FC57B5DBC9F57493F-1426266789493-5-0-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742197_1373{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:13:09,545 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742197_1373 src: /127.0.0.1:63475 dest: /127.0.0.1:60689
2015-03-13 10:13:09,546 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742197_1373 src: /127.0.0.1:63476 dest: /127.0.0.1:60693
2015-03-13 10:13:09,547 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742197_1373 src: /127.0.0.1:63477 dest: /127.0.0.1:60686
2015-03-13 10:13:09,550 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63477, dest: /127.0.0.1:60686, bytes: 53338, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_674940707_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742197_1373, duration: 1126000
2015-03-13 10:13:09,550 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742197_1373, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:09,550 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742197_1373{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:09,550 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63476, dest: /127.0.0.1:60693, bytes: 53338, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_674940707_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742197_1373, duration: 1743000
2015-03-13 10:13:09,550 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742197_1373, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:09,551 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742197_1373{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:09,551 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63475, dest: /127.0.0.1:60689, bytes: 53338, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_674940707_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742197_1373, duration: 2434000
2015-03-13 10:13:09,551 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742197_1373, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:09,551 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742197_1373{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:09,553 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0030-1426266774213-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2FC57B5DBC9F57493F-1426266789493-5-0-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_674940707_1
2015-03-13 10:13:09,554 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0030-1426266774213-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2FC57B5DBC9F57493F-1426266789493-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:09,555 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job_1426266260362_0030_1_conf.xml	dst=null	perm=null
2015-03-13 10:13:09,557 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0030_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:13:09,557 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job_1426266260362_0030_1_conf.xml	dst=null	perm=null
2015-03-13 10:13:09,558 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0030_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:13:09,560 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job_1426266260362_0030_1_conf.xml	dst=null	perm=null
2015-03-13 10:13:09,562 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0030_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:09,564 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63478, bytes: 91722, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_674940707_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742190_1366, duration: 267000
2015-03-13 10:13:09,566 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0030_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742198_1374{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:13:09,568 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742198_1374 src: /127.0.0.1:63479 dest: /127.0.0.1:60693
2015-03-13 10:13:09,569 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742198_1374 src: /127.0.0.1:63480 dest: /127.0.0.1:60696
2015-03-13 10:13:09,570 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742198_1374 src: /127.0.0.1:63481 dest: /127.0.0.1:60686
2015-03-13 10:13:09,574 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63481, dest: /127.0.0.1:60686, bytes: 91010, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_674940707_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742198_1374, duration: 1953000
2015-03-13 10:13:09,574 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742198_1374, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:09,574 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742198_1374{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:09,575 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63480, dest: /127.0.0.1:60696, bytes: 91010, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_674940707_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742198_1374, duration: 2596000
2015-03-13 10:13:09,575 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742198_1374, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:09,576 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63479, dest: /127.0.0.1:60693, bytes: 91010, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_674940707_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742198_1374, duration: 3389000
2015-03-13 10:13:09,576 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742198_1374{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:09,576 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742198_1374{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:09,576 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742198_1374, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:09,578 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0030_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_674940707_1
2015-03-13 10:13:09,580 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0030_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:09,582 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0030.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0030.summary	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:09,584 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0030_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0030_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:09,586 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0030-1426266774213-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2FC57B5DBC9F57493F-1426266789493-5-0-SUCCEEDED-default.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0030-1426266774213-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2FC57B5DBC9F57493F-1426266789493-5-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:09,592 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0030_000001 State change from RUNNING to FINISHING
2015-03-13 10:13:09,592 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0030
2015-03-13 10:13:09,592 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0030 State change from RUNNING to REMOVING
2015-03-13 10:13:09,592 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0030
2015-03-13 10:13:09,592 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0030 State change from REMOVING to FINISHING
2015-03-13 10:13:10,140 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:13:10,140 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0030_01_000006
2015-03-13 10:13:10,141 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0030_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:13:10,141 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0030_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:13:10,141 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0030	CONTAINERID=container_1426266260362_0030_01_000006
2015-03-13 10:13:10,141 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0030_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:13:10,141 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:13:10,141 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0030_01_000006, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:10,142 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:10,142 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:13:10,142 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0030_000001 released container container_1426266260362_0030_01_000006 on node: host: 10.1.1.144:60723 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:13:10,329 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:10,436 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:13:10,436 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0030_01_000003
2015-03-13 10:13:10,436 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0030_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:13:10,436 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0030_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:13:10,436 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0030	CONTAINERID=container_1426266260362_0030_01_000003
2015-03-13 10:13:10,436 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0030_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:13:10,437 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:13:10,437 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0030_01_000003, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:10,437 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:10,437 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:13:10,437 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0030_000001 released container container_1426266260362_0030_01_000003 on node: host: 10.1.1.144:60711 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:13:10,465 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742191_1367
2015-03-13 10:13:10,466 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742197_1373
2015-03-13 10:13:10,466 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742196_1372
2015-03-13 10:13:10,467 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742192_1368
2015-03-13 10:13:10,467 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742195_1371
2015-03-13 10:13:10,467 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742193_1369
2015-03-13 10:13:10,598 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742186_1362 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60693 127.0.0.1:60689 
2015-03-13 10:13:10,598 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742187_1363 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60693 127.0.0.1:60696 
2015-03-13 10:13:10,598 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742188_1364 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60693 
2015-03-13 10:13:10,598 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742189_1365 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60693 
2015-03-13 10:13:10,599 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742192_1368 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60689 
2015-03-13 10:13:10,599 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742190_1366 127.0.0.1:60689 127.0.0.1:60686 127.0.0.1:60696 
2015-03-13 10:13:10,599 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030	dst=null	perm=null
2015-03-13 10:13:10,632 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742165_1341 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60693 
2015-03-13 10:13:10,632 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742167_1343 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60689 
2015-03-13 10:13:10,632 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742166_1342 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60689 
2015-03-13 10:13:10,633 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742168_1344 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60693 
2015-03-13 10:13:10,633 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742163_1339 127.0.0.1:60686 127.0.0.1:60693 127.0.0.1:60696 
2015-03-13 10:13:10,633 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5	dst=null	perm=null
2015-03-13 10:13:10,634 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742179_1355 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60686 
2015-03-13 10:13:10,634 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742181_1357 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60689 
2015-03-13 10:13:10,634 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742180_1356 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60693 
2015-03-13 10:13:10,634 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742182_1358 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60686 
2015-03-13 10:13:10,634 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742177_1353 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60693 
2015-03-13 10:13:10,635 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5	dst=null	perm=null
2015-03-13 10:13:10,635 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin	dst=null	perm=null
2015-03-13 10:13:10,635 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary
2015-03-13 10:13:10,636 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary	dst=null	perm=null
2015-03-13 10:13:10,642 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:13:10,643 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:13:10,643 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:13:10,644 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin	dst=null	perm=null
2015-03-13 10:13:10,644 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin	dst=null	perm=null
2015-03-13 10:13:10,645 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin	dst=null	perm=null
2015-03-13 10:13:10,646 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:13:10,647 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/part-00000	dst=null	perm=null
2015-03-13 10:13:10,648 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63483, bytes: 28, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742194_1370, duration: 179000
2015-03-13 10:13:10,649 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/part-00001	dst=null	perm=null
2015-03-13 10:13:10,651 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63484, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742195_1371, duration: 160000
2015-03-13 10:13:10,651 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/part-00002	dst=null	perm=null
2015-03-13 10:13:10,652 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63484, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742191_1367, duration: 115000
2015-03-13 10:13:10,653 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/part-00003	dst=null	perm=null
2015-03-13 10:13:10,654 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63485, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742193_1369, duration: 144000
2015-03-13 10:13:10,655 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/part-00004	dst=null	perm=null
2015-03-13 10:13:10,662 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:13:10,662 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:13:10,663 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:13:10,664 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin	dst=null	perm=null
2015-03-13 10:13:10,664 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin	dst=null	perm=null
2015-03-13 10:13:10,665 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin	dst=null	perm=null
2015-03-13 10:13:10,666 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:13:10,667 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/part-00000	dst=null	perm=null
2015-03-13 10:13:10,668 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63483, bytes: 28, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742194_1370, duration: 169000
2015-03-13 10:13:10,668 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/part-00001	dst=null	perm=null
2015-03-13 10:13:10,670 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63486, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742195_1371, duration: 178000
2015-03-13 10:13:10,670 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/part-00002	dst=null	perm=null
2015-03-13 10:13:10,671 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63485, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742191_1367, duration: 110000
2015-03-13 10:13:10,672 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/part-00003	dst=null	perm=null
2015-03-13 10:13:10,673 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63484, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742193_1369, duration: 152000
2015-03-13 10:13:10,674 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/part-00004	dst=null	perm=null
2015-03-13 10:13:10,674 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin
2015-03-13 10:13:10,674 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin	dst=null	perm=null
2015-03-13 10:13:10,675 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin	dst=null	perm=null
2015-03-13 10:13:10,675 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin	dst=null	perm=null
2015-03-13 10:13:10,676 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin	dst=null	perm=null
2015-03-13 10:13:10,676 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/part-00000	dst=null	perm=null
2015-03-13 10:13:10,677 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/part-00000	dst=null	perm=null
2015-03-13 10:13:10,678 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63486, bytes: 28, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742194_1370, duration: 155000
2015-03-13 10:13:10,679 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/part-00001	dst=null	perm=null
2015-03-13 10:13:10,679 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/part-00001	dst=null	perm=null
2015-03-13 10:13:10,680 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63484, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742195_1371, duration: 176000
2015-03-13 10:13:10,681 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/part-00002	dst=null	perm=null
2015-03-13 10:13:10,681 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/part-00002	dst=null	perm=null
2015-03-13 10:13:10,682 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63486, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742191_1367, duration: 169000
2015-03-13 10:13:10,683 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/part-00003	dst=null	perm=null
2015-03-13 10:13:10,683 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/part-00003	dst=null	perm=null
2015-03-13 10:13:10,684 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63486, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742193_1369, duration: 168000
2015-03-13 10:13:10,685 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/part-00004	dst=null	perm=null
2015-03-13 10:13:10,686 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/part-00004	dst=null	perm=null
2015-03-13 10:13:10,687 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:13:10,687 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:13:10,688 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt	dst=null	perm=null
2015-03-13 10:13:10,688 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt	dst=null	perm=null
2015-03-13 10:13:10,698 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:13:10,699 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:13:10,699 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:13:10,715 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup	dst=null	perm=null
2015-03-13 10:13:10,719 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping] starting
2015-03-13 10:13:10,720 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt"]
2015-03-13 10:13:10,720 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-03-13 10:13:10,720 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt"]
2015-03-13 10:13:10,720 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-03-13 10:13:10,720 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping]  sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup"]
2015-03-13 10:13:10,720 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping]  parallel execution is enabled: true
2015-03-13 10:13:10,720 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping]  starting jobs: 1
2015-03-13 10:13:10,720 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping]  allocating threads: 1
2015-03-13 10:13:10,722 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [cogrouping] starting step: (1/1) ...platform/joinsintocogroup
2015-03-13 10:13:10,733 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:13:10,740 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:13:10,742 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup	dst=null	perm=null
2015-03-13 10:13:10,742 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:13:10,743 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:13:10,744 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 31
2015-03-13 10:13:10,745 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031	dst=null	perm=null
2015-03-13 10:13:10,746 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031	dst=null	perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:13:10,747 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031	dst=null	perm=soberoi:supergroup:rwx------
2015-03-13 10:13:10,747 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.jar	dst=null	perm=null
2015-03-13 10:13:10,748 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:13:10,750 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073742199_1375{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:13:10,751 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742199_1375 src: /127.0.0.1:63488 dest: /127.0.0.1:60693
2015-03-13 10:13:10,752 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742199_1375 src: /127.0.0.1:63489 dest: /127.0.0.1:60686
2015-03-13 10:13:10,753 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742199_1375 src: /127.0.0.1:63490 dest: /127.0.0.1:60696
2015-03-13 10:13:10,757 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63490, dest: /127.0.0.1:60696, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742199_1375, duration: 2652000
2015-03-13 10:13:10,758 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742199_1375, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:10,758 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742199_1375{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:13:10,758 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63489, dest: /127.0.0.1:60686, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742199_1375, duration: 2438000
2015-03-13 10:13:10,758 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742199_1375, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:10,759 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742199_1375{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:13:10,759 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63488, dest: /127.0.0.1:60693, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742199_1375, duration: 4001000
2015-03-13 10:13:10,759 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742199_1375, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:10,759 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742199_1375{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:13:10,760 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:13:10,761 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.jar
2015-03-13 10:13:10,761 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.jar	dst=null	perm=null
2015-03-13 10:13:10,762 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:13:10,763 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:13:10,763 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:13:10,764 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:13:10,764 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:13:10,765 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:13:10,766 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:13:10,766 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:13:10,767 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:13:10,767 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:13:10,769 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:13:10,769 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:13:10,770 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:13:10,771 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt	dst=null	perm=null
2015-03-13 10:13:10,771 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:13:10,772 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt	dst=null	perm=null
2015-03-13 10:13:10,773 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:13:10,773 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:13:10,773 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:13:10,774 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt	dst=null	perm=null
2015-03-13 10:13:10,774 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:13:10,775 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt	dst=null	perm=null
2015-03-13 10:13:10,776 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:13:10,777 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:13:10,778 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.split
2015-03-13 10:13:10,778 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.split	dst=null	perm=null
2015-03-13 10:13:10,779 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073742200_1376{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:13:10,780 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742200_1376 src: /127.0.0.1:63491 dest: /127.0.0.1:60693
2015-03-13 10:13:10,782 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742200_1376 src: /127.0.0.1:63492 dest: /127.0.0.1:60689
2015-03-13 10:13:10,783 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742200_1376 src: /127.0.0.1:63493 dest: /127.0.0.1:60686
2015-03-13 10:13:10,784 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742200_1376 src: /127.0.0.1:63494 dest: /127.0.0.1:60696
2015-03-13 10:13:10,787 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63494, dest: /127.0.0.1:60696, bytes: 2133, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742200_1376, duration: 1535000
2015-03-13 10:13:10,787 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742200_1376, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:10,787 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742200_1376{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:13:10,787 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63493, dest: /127.0.0.1:60686, bytes: 2133, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742200_1376, duration: 1917000
2015-03-13 10:13:10,787 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742200_1376, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:10,788 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742200_1376{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:13:10,788 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63492, dest: /127.0.0.1:60689, bytes: 2133, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742200_1376, duration: 2752000
2015-03-13 10:13:10,788 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742200_1376, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:10,788 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742200_1376{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:13:10,789 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63491, dest: /127.0.0.1:60693, bytes: 2133, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742200_1376, duration: 3540000
2015-03-13 10:13:10,789 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742200_1376, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:10,789 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742200_1376{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:13:10,790 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:13:10,791 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:13:10,792 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:13:10,793 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073742201_1377{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:13:10,794 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742201_1377 src: /127.0.0.1:63495 dest: /127.0.0.1:60689
2015-03-13 10:13:10,795 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742201_1377 src: /127.0.0.1:63496 dest: /127.0.0.1:60693
2015-03-13 10:13:10,796 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742201_1377 src: /127.0.0.1:63497 dest: /127.0.0.1:60686
2015-03-13 10:13:10,799 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63497, dest: /127.0.0.1:60686, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742201_1377, duration: 1254000
2015-03-13 10:13:10,799 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742201_1377, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:10,799 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742201_1377{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:10,800 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63496, dest: /127.0.0.1:60693, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742201_1377, duration: 1589000
2015-03-13 10:13:10,800 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742201_1377, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:10,800 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742201_1377{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:10,804 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63495, dest: /127.0.0.1:60689, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742201_1377, duration: 2358000
2015-03-13 10:13:10,804 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742201_1377, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:10,805 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742201_1377{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:10,806 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:13:10,806 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:6
2015-03-13 10:13:10,807 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:13:10,808 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:13:10,816 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:13:10,816 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:13:10,817 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:13:10,821 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742202_1378{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:13:10,822 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742202_1378 src: /127.0.0.1:63498 dest: /127.0.0.1:60689
2015-03-13 10:13:10,823 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742202_1378 src: /127.0.0.1:63499 dest: /127.0.0.1:60696
2015-03-13 10:13:10,825 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742202_1378 src: /127.0.0.1:63500 dest: /127.0.0.1:60686
2015-03-13 10:13:10,828 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63500, dest: /127.0.0.1:60686, bytes: 100870, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742202_1378, duration: 1425000
2015-03-13 10:13:10,828 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742202_1378, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:10,828 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742202_1378{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:10,828 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63499, dest: /127.0.0.1:60696, bytes: 100870, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742202_1378, duration: 1875000
2015-03-13 10:13:10,828 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742202_1378, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:10,829 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742202_1378{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:10,829 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63498, dest: /127.0.0.1:60689, bytes: 100870, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742202_1378, duration: 2556000
2015-03-13 10:13:10,829 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742202_1378, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:10,830 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742202_1378{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:10,830 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:13:10,831 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0031
2015-03-13 10:13:10,832 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031	dst=null	perm=null
2015-03-13 10:13:10,832 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.xml	dst=null	perm=null
2015-03-13 10:13:10,833 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.xml	dst=null	perm=null
2015-03-13 10:13:10,834 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.jar	dst=null	perm=null
2015-03-13 10:13:10,834 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.jar	dst=null	perm=null
2015-03-13 10:13:10,835 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.split	dst=null	perm=null
2015-03-13 10:13:10,836 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.split	dst=null	perm=null
2015-03-13 10:13:10,836 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:13:10,837 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:13:10,838 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:13:10,838 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:13:10,839 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:13:10,839 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:13:10,840 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:13:10,841 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:13:10,841 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 31 submitted by user soberoi
2015-03-13 10:13:10,841 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0031
2015-03-13 10:13:10,842 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	IP=10.1.1.144	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1426266260362_0031
2015-03-13 10:13:10,842 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0031
2015-03-13 10:13:10,842 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0031 State change from NEW to NEW_SAVING
2015-03-13 10:13:10,842 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0031 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:13:10,842 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0031_000001
2015-03-13 10:13:10,842 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0031_000001 State change from NEW to SUBMITTED
2015-03-13 10:13:10,842 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0031 from user: soberoi activated in queue: default
2015-03-13 10:13:10,843 INFO  capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0031 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:13:10,843 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0031 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:13:10,843 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0031 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:13:10,843 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0031_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:13:10,843 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0031_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:13:10,844 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0031 State change from SUBMITTED to ACCEPTED
2015-03-13 10:13:10,845 INFO  mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0031/
2015-03-13 10:13:10,845 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [cogrouping] submitted hadoop job: job_1426266260362_0031
2015-03-13 10:13:10,845 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [cogrouping] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0031/
2015-03-13 10:13:10,962 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:13:10,963 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0031	CONTAINERID=container_1426266260362_0031_01_000001
2015-03-13 10:13:10,963 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0031_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:13:10,963 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0031 container=Container: [ContainerId: container_1426266260362_0031_01_000001, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0031_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:10,963 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:13:10,963 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:13:10,964 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:10,965 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0031 AttemptId: appattempt_1426266260362_0031_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0031_01_000001, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ]
2015-03-13 10:13:10,965 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0031_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:13:10,965 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0031_000001
2015-03-13 10:13:10,965 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0031_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:13:10,965 INFO  amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0031_000001
2015-03-13 10:13:10,966 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0031_01_000001, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] for AM appattempt_1426266260362_0031_000001
2015-03-13 10:13:10,966 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0031_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-03-13 10:13:10,969 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0031_000001 (auth:SIMPLE)
2015-03-13 10:13:10,970 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0031_01_000001 by user soberoi
2015-03-13 10:13:10,970 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0031
2015-03-13 10:13:10,970 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0031	CONTAINERID=container_1426266260362_0031_01_000001
2015-03-13 10:13:10,970 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0031 transitioned from NEW to INITING
2015-03-13 10:13:10,971 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0031_01_000001 to application application_1426266260362_0031
2015-03-13 10:13:10,971 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0031 transitioned from INITING to RUNNING
2015-03-13 10:13:10,971 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0031_01_000001, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] for AM appattempt_1426266260362_0031_000001
2015-03-13 10:13:10,971 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0031_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:13:10,971 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:13:10,971 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0031
2015-03-13 10:13:10,971 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:13:10,971 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:13:10,971 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:13:10,972 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:13:10,972 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0031_01_000001
2015-03-13 10:13:10,981 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1426266260362_0031_01_000001.tokens. Credentials list: 
2015-03-13 10:13:10,996 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:13:11,064 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1426266260362_0031_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000001.tokens
2015-03-13 10:13:11,065 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0031 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0031
2015-03-13 10:13:11,127 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.jar	dst=null	perm=null
2015-03-13 10:13:11,127 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.jar	dst=null	perm=null
2015-03-13 10:13:11,128 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.jar	dst=null	perm=null
2015-03-13 10:13:11,134 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63483, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1083975904_16473, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742199_1375, duration: 494000
2015-03-13 10:13:11,152 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:13:11,170 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:13:11,170 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:13:11,171 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:13:11,177 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63485, bytes: 222, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1083975904_16473, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742201_1377, duration: 174000
2015-03-13 10:13:11,189 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:13:11,206 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.split	dst=null	perm=null
2015-03-13 10:13:11,207 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.split	dst=null	perm=null
2015-03-13 10:13:11,207 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.split	dst=null	perm=null
2015-03-13 10:13:11,213 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63483, bytes: 2153, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1083975904_16473, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742200_1376, duration: 171000
2015-03-13 10:13:11,226 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:13:11,242 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.xml	dst=null	perm=null
2015-03-13 10:13:11,243 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.xml	dst=null	perm=null
2015-03-13 10:13:11,244 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.xml	dst=null	perm=null
2015-03-13 10:13:11,249 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63483, bytes: 101662, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1083975904_16473, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742202_1378, duration: 225000
2015-03-13 10:13:11,263 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:13:11,263 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:13:11,288 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:13:11,288 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:11,333 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:11,355 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000001/default_container_executor.sh]
2015-03-13 10:13:11,413 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742197_1373
2015-03-13 10:13:11,414 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742198_1374
2015-03-13 10:13:11,415 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742191_1367
2015-03-13 10:13:11,415 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742196_1372
2015-03-13 10:13:11,415 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742193_1369
2015-03-13 10:13:11,416 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742194_1370
2015-03-13 10:13:11,416 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742195_1371
2015-03-13 10:13:11,416 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742200_1376
2015-03-13 10:13:11,417 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742202_1378
2015-03-13 10:13:11,463 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742194_1370
2015-03-13 10:13:11,464 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742198_1374
2015-03-13 10:13:11,618 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742199_1375
2015-03-13 10:13:11,618 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742201_1377
2015-03-13 10:13:11,666 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742199_1375
2015-03-13 10:13:11,667 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742191_1367
2015-03-13 10:13:11,667 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742200_1376
2015-03-13 10:13:11,667 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742195_1371
2015-03-13 10:13:11,668 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742197_1373
2015-03-13 10:13:11,668 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742201_1377
2015-03-13 10:13:11,668 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742192_1368
2015-03-13 10:13:11,668 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742193_1369
2015-03-13 10:13:11,963 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:11,964 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:13:12,014 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742194_1370
2015-03-13 10:13:12,015 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742198_1374
2015-03-13 10:13:12,015 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742200_1376
2015-03-13 10:13:12,016 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742196_1372
2015-03-13 10:13:12,016 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742192_1368
2015-03-13 10:13:12,218 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742199_1375
2015-03-13 10:13:12,219 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742202_1378
2015-03-13 10:13:12,339 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:12,965 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:12,967 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:13:12,989 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/COMMIT_STARTED	dst=null	perm=null
2015-03-13 10:13:12,989 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/COMMIT_SUCCESS	dst=null	perm=null
2015-03-13 10:13:12,990 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/COMMIT_FAIL	dst=null	perm=null
2015-03-13 10:13:13,041 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031	dst=null	perm=null
2015-03-13 10:13:13,043 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:13:13,044 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:13:13,123 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60696 to replicate blk_1073742199_1375 to datanode(s) 127.0.0.1:60689
2015-03-13 10:13:13,123 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073742192_1368, blk_1073742177_1353, blk_1073742163_1339, blk_1073742180_1356, blk_1073742165_1341, blk_1073742182_1358, blk_1073742167_1343, blk_1073742168_1344, blk_1073742186_1362, blk_1073742187_1363, blk_1073742188_1364, blk_1073742189_1365]
2015-03-13 10:13:13,124 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073742177_1353, blk_1073742179_1355, blk_1073742180_1356, blk_1073742181_1357, blk_1073742182_1358, blk_1073742186_1362, blk_1073742187_1363, blk_1073742190_1366, blk_1073742192_1368, blk_1073742163_1339, blk_1073742165_1341, blk_1073742166_1342, blk_1073742167_1343, blk_1073742168_1344]
2015-03-13 10:13:13,334 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:13:13,341 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:13,341 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:13:13,396 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63505, bytes: 222, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-145669230_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742201_1377, duration: 133000
2015-03-13 10:13:13,887 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742192_1368 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742192 for deletion
2015-03-13 10:13:13,887 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742177_1353 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742177 for deletion
2015-03-13 10:13:13,887 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742163_1339 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742163 for deletion
2015-03-13 10:13:13,887 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742192_1368 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742192
2015-03-13 10:13:13,887 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742180_1356 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742180 for deletion
2015-03-13 10:13:13,887 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742177_1353 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742177
2015-03-13 10:13:13,887 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742165_1341 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742165 for deletion
2015-03-13 10:13:13,888 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742163_1339 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742163
2015-03-13 10:13:13,888 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742180_1356 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742180
2015-03-13 10:13:13,888 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742182_1358 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742182 for deletion
2015-03-13 10:13:13,888 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742167_1343 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742167 for deletion
2015-03-13 10:13:13,888 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742165_1341 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742165
2015-03-13 10:13:13,888 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742182_1358 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742182
2015-03-13 10:13:13,888 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742168_1344 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742168 for deletion
2015-03-13 10:13:13,888 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742186_1362 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742186 for deletion
2015-03-13 10:13:13,888 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742167_1343 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742167
2015-03-13 10:13:13,888 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742187_1363 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742187 for deletion
2015-03-13 10:13:13,888 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742168_1344 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742168
2015-03-13 10:13:13,889 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742188_1364 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742188 for deletion
2015-03-13 10:13:13,889 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742186_1362 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742186
2015-03-13 10:13:13,889 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742187_1363 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742187
2015-03-13 10:13:13,889 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742189_1365 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742189 for deletion
2015-03-13 10:13:13,889 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742188_1364 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742188
2015-03-13 10:13:13,889 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742189_1365 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742189
2015-03-13 10:13:13,967 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:14,078 INFO  datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-318492837-10.1.1.144-60696-1426266259571, infoPort=60697, ipcPort=60698, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073742199_1375 to 127.0.0.1:60689 
2015-03-13 10:13:14,079 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742177_1353 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742177 for deletion
2015-03-13 10:13:14,079 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742179_1355 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742179 for deletion
2015-03-13 10:13:14,079 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742180_1356 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742180 for deletion
2015-03-13 10:13:14,079 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742181_1357 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742181 for deletion
2015-03-13 10:13:14,079 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742182_1358 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742182 for deletion
2015-03-13 10:13:14,080 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742186_1362 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742186 for deletion
2015-03-13 10:13:14,080 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742180_1356 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742180
2015-03-13 10:13:14,080 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742187_1363 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742187 for deletion
2015-03-13 10:13:14,079 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742177_1353 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742177
2015-03-13 10:13:14,080 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742182_1358 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742182
2015-03-13 10:13:14,080 INFO  datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073742199_1375 (numBytes=254067) to /127.0.0.1:60689
2015-03-13 10:13:14,080 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742199_1375 src: /127.0.0.1:63508 dest: /127.0.0.1:60689
2015-03-13 10:13:14,080 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742190_1366 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir39/blk_1073742190 for deletion
2015-03-13 10:13:14,080 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742186_1362 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742186
2015-03-13 10:13:14,080 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742192_1368 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742192 for deletion
2015-03-13 10:13:14,080 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742179_1355 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742179
2015-03-13 10:13:14,081 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742190_1366 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir39/blk_1073742190
2015-03-13 10:13:14,081 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742163_1339 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742163 for deletion
2015-03-13 10:13:14,081 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742181_1357 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742181
2015-03-13 10:13:14,081 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742165_1341 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742165 for deletion
2015-03-13 10:13:14,081 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742166_1342 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742166 for deletion
2015-03-13 10:13:14,082 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742167_1343 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742167 for deletion
2015-03-13 10:13:14,082 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742168_1344 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742168 for deletion
2015-03-13 10:13:14,082 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742166_1342 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742166
2015-03-13 10:13:14,081 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742187_1363 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742187
2015-03-13 10:13:14,082 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742168_1344 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742168
2015-03-13 10:13:14,082 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742192_1368 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742192
2015-03-13 10:13:14,082 INFO  datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073742199_1375 src: /127.0.0.1:63508 dest: /127.0.0.1:60689 of size 254067
2015-03-13 10:13:14,082 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742163_1339 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742163
2015-03-13 10:13:14,083 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742165_1341 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742165
2015-03-13 10:13:14,083 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742167_1343 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742167
2015-03-13 10:13:14,083 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742199_1375 size 254067
2015-03-13 10:13:14,175 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0031_000001 (auth:SIMPLE)
2015-03-13 10:13:14,176 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0031_000001
2015-03-13 10:13:14,176 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi	IP=10.1.1.144	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1426266260362_0031	APPATTEMPTID=appattempt_1426266260362_0031_000001
2015-03-13 10:13:14,176 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0031_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:13:14,176 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0031 State change from ACCEPTED to RUNNING
2015-03-13 10:13:14,197 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job_1426266260362_0031_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:14,200 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:13:14,281 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job_1426266260362_0031_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:14,344 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:14,410 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job_1426266260362_0031_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742203_1379{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:13:14,446 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742203_1379 src: /127.0.0.1:63512 dest: /127.0.0.1:60686
2015-03-13 10:13:14,447 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742203_1379 src: /127.0.0.1:63513 dest: /127.0.0.1:60696
2015-03-13 10:13:14,449 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742203_1379 src: /127.0.0.1:63514 dest: /127.0.0.1:60693
2015-03-13 10:13:14,456 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63514, dest: /127.0.0.1:60693, bytes: 93209, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-145669230_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742203_1379, duration: 5703000
2015-03-13 10:13:14,456 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742203_1379, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:14,457 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742203_1379{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:14,457 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63513, dest: /127.0.0.1:60696, bytes: 93209, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-145669230_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742203_1379, duration: 6384000
2015-03-13 10:13:14,457 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742203_1379, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:14,457 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742203_1379{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:14,457 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63512, dest: /127.0.0.1:60686, bytes: 93209, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-145669230_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742203_1379, duration: 7109000
2015-03-13 10:13:14,458 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742203_1379, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:14,458 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742203_1379{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:14,463 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job_1426266260362_0031_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-145669230_1
2015-03-13 10:13:14,968 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:15,350 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:15,351 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:13:15,351 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0031	CONTAINERID=container_1426266260362_0031_01_000002
2015-03-13 10:13:15,351 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0031_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:13:15,351 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0031 container=Container: [ContainerId: container_1426266260362_0031_01_000002, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0031_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:15,351 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:13:15,351 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:15,352 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:13:15,352 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0031	CONTAINERID=container_1426266260362_0031_01_000003
2015-03-13 10:13:15,352 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0031_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available
2015-03-13 10:13:15,352 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0031 container=Container: [ContainerId: container_1426266260362_0031_01_000003, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0031_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:15,352 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:13:15,352 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:15,450 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:13:15,451 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0031	CONTAINERID=container_1426266260362_0031_01_000004
2015-03-13 10:13:15,451 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0031_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:13:15,451 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0031 container=Container: [ContainerId: container_1426266260362_0031_01_000004, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0031_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:15,451 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:13:15,451 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:15,452 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:13:15,452 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0031	CONTAINERID=container_1426266260362_0031_01_000005
2015-03-13 10:13:15,452 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0031_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:13:15,452 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0031 container=Container: [ContainerId: container_1426266260362_0031_01_000005, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0031_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:15,452 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:13:15,453 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:15,453 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:13:15,453 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0031	CONTAINERID=container_1426266260362_0031_01_000006
2015-03-13 10:13:15,453 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0031_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:13:15,453 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0031 container=Container: [ContainerId: container_1426266260362_0031_01_000006, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0031_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:15,454 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7
2015-03-13 10:13:15,454 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:15,454 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000007 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:13:15,454 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0031	CONTAINERID=container_1426266260362_0031_01_000007
2015-03-13 10:13:15,454 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0031_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:13:15,454 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0031 container=Container: [ContainerId: container_1426266260362_0031_01_000007, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0031_01_000007 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7 usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:15,454 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:10240, vCores:8>usedCapacity=0.625, absoluteUsedCapacity=0.625, numApps=2, numContainers=8
2015-03-13 10:13:15,454 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.625 absoluteUsedCapacity=0.625 used=<memory:10240, vCores:8> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:15,477 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742199_1375
2015-03-13 10:13:15,477 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742200_1376
2015-03-13 10:13:15,478 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742202_1378
2015-03-13 10:13:15,478 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742201_1377
2015-03-13 10:13:15,731 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0030_01_000001 succeeded 
2015-03-13 10:13:15,732 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:13:15,732 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0030_01_000001
2015-03-13 10:13:15,739 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000001
2015-03-13 10:13:15,739 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0030	CONTAINERID=container_1426266260362_0030_01_000001
2015-03-13 10:13:15,739 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:13:15,739 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0030_01_000001 from application application_1426266260362_0030
2015-03-13 10:13:15,739 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:15,740 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0030
2015-03-13 10:13:15,739 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000001
2015-03-13 10:13:15,739 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000001
2015-03-13 10:13:15,739 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000001
2015-03-13 10:13:15,968 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:16,128 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073742192_1368, blk_1073742177_1353, blk_1073742179_1355, blk_1073742181_1357, blk_1073742166_1342, blk_1073742167_1343, blk_1073742168_1344, blk_1073742186_1362, blk_1073742187_1363, blk_1073742188_1364, blk_1073742189_1365, blk_1073742190_1366]
2015-03-13 10:13:16,128 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073742179_1355, blk_1073742163_1339, blk_1073742180_1356, blk_1073742181_1357, blk_1073742165_1341, blk_1073742182_1358, blk_1073742166_1342, blk_1073742186_1362, blk_1073742187_1363, blk_1073742188_1364, blk_1073742189_1365, blk_1073742190_1366]
2015-03-13 10:13:16,211 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:13:16,211 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:13:16,212 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:13:16,212 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:13:16,212 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:13:16,212 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000007 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:13:16,239 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.jar	dst=null	perm=null
2015-03-13 10:13:16,240 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.jar	dst=null	perm=null
2015-03-13 10:13:16,248 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.xml	dst=null	perm=null
2015-03-13 10:13:16,249 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.xml	dst=null	perm=null
2015-03-13 10:13:16,251 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:13:16,252 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:13:16,257 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:13:16,258 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:13:16,259 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:13:16,260 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:13:16,317 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0031_000001 (auth:SIMPLE)
2015-03-13 10:13:16,317 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0031_000001 (auth:SIMPLE)
2015-03-13 10:13:16,331 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0031_01_000002 by user soberoi
2015-03-13 10:13:16,331 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0031_01_000004 by user soberoi
2015-03-13 10:13:16,331 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0031
2015-03-13 10:13:16,331 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0031_01_000007 by user soberoi
2015-03-13 10:13:16,332 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0031 transitioned from NEW to INITING
2015-03-13 10:13:16,332 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0031	CONTAINERID=container_1426266260362_0031_01_000007
2015-03-13 10:13:16,332 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0031_01_000005 by user soberoi
2015-03-13 10:13:16,331 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0031_01_000006 by user soberoi
2015-03-13 10:13:16,332 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0031_01_000007 to application application_1426266260362_0031
2015-03-13 10:13:16,332 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0031_01_000005 to application application_1426266260362_0031
2015-03-13 10:13:16,332 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0031	CONTAINERID=container_1426266260362_0031_01_000005
2015-03-13 10:13:16,332 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0031_01_000002 to application application_1426266260362_0031
2015-03-13 10:13:16,333 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0031 transitioned from INITING to RUNNING
2015-03-13 10:13:16,331 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0031	CONTAINERID=container_1426266260362_0031_01_000002
2015-03-13 10:13:16,333 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:13:16,333 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0031
2015-03-13 10:13:16,333 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0031
2015-03-13 10:13:16,333 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:13:16,331 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0031_01_000003 by user soberoi
2015-03-13 10:13:16,331 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0031
2015-03-13 10:13:16,333 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0031	CONTAINERID=container_1426266260362_0031_01_000003
2015-03-13 10:13:16,333 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0031
2015-03-13 10:13:16,333 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:13:16,332 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0031_01_000006 to application application_1426266260362_0031
2015-03-13 10:13:16,332 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0031	CONTAINERID=container_1426266260362_0031_01_000006
2015-03-13 10:13:16,334 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0031 transitioned from NEW to INITING
2015-03-13 10:13:16,334 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0031_01_000004 to application application_1426266260362_0031
2015-03-13 10:13:16,334 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0031 transitioned from INITING to RUNNING
2015-03-13 10:13:16,334 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:13:16,333 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0031	CONTAINERID=container_1426266260362_0031_01_000004
2015-03-13 10:13:16,334 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0031_01_000003 to application application_1426266260362_0031
2015-03-13 10:13:16,334 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0031_01_000002
2015-03-13 10:13:16,334 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000007 transitioned from NEW to LOCALIZING
2015-03-13 10:13:16,335 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:13:16,335 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:13:16,335 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:13:16,335 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:13:16,335 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0031
2015-03-13 10:13:16,335 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0031
2015-03-13 10:13:16,335 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:13:16,335 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0031
2015-03-13 10:13:16,336 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0031
2015-03-13 10:13:16,336 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:13:16,335 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0031
2015-03-13 10:13:16,336 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0031
2015-03-13 10:13:16,336 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:13:16,336 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:13:16,336 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0031_01_000003
2015-03-13 10:13:16,336 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0031
2015-03-13 10:13:16,336 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0031
2015-03-13 10:13:16,336 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:13:16,336 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0031
2015-03-13 10:13:16,336 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0031
2015-03-13 10:13:16,336 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0031
2015-03-13 10:13:16,336 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:13:16,336 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0031
2015-03-13 10:13:16,337 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0031
2015-03-13 10:13:16,337 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0031
2015-03-13 10:13:16,337 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:13:16,337 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0031
2015-03-13 10:13:16,337 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0031_01_000007
2015-03-13 10:13:16,337 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0031_01_000005
2015-03-13 10:13:16,338 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0031_01_000004
2015-03-13 10:13:16,338 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0031_01_000006
2015-03-13 10:13:16,351 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:13:16,351 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0030_01_000001
2015-03-13 10:13:16,351 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:16,351 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:16,352 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:13:16,352 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:13:16,352 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0030_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:13:16,352 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0030_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:13:16,352 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0030	CONTAINERID=container_1426266260362_0030_01_000001
2015-03-13 10:13:16,353 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0030_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:13:16,353 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:8192, vCores:7> numContainers=7 user=soberoi user-resources=<memory:8192, vCores:7>
2015-03-13 10:13:16,353 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0030_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:7>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=7 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:16,353 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0030_000001
2015-03-13 10:13:16,353 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0030_000001 State change from FINISHING to FINISHED
2015-03-13 10:13:16,353 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0030 State change from FINISHING to FINISHED
2015-03-13 10:13:16,354 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1426266260362_0030
2015-03-13 10:13:16,354 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0030,name=[B61955F7F1A34D09B0265BE65DDD3B28/C57B5DBC9F57493FBC8351F3D1E72603] lower*upper1*upper2/(1/3) ...rm/joinsamesourceintojoin,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0030/jobhistory/job/job_1426266260362_0030,appMasterHost=Edinburgh.local,startTime=1426266774213,finishTime=1426266789592,finalStatus=SUCCEEDED
2015-03-13 10:13:16,353 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:16,354 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:7>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=7
2015-03-13 10:13:16,354 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0030_000001 released container container_1426266260362_0030_01_000001 on node: host: 10.1.1.144:60715 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:13:16,354 INFO  capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0030_000001 is done. finalState=FINISHED
2015-03-13 10:13:16,354 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0030 requests cleared
2015-03-13 10:13:16,354 INFO  capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0030 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:13:16,354 INFO  capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0030 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:13:16,355 INFO  amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0030_000001
2015-03-13 10:13:16,360 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0030_000001 (auth:SIMPLE)
2015-03-13 10:13:16,362 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0030_01_000001
2015-03-13 10:13:16,363 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1426266260362_0031_01_000002.tokens. Credentials list: 
2015-03-13 10:13:16,364 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0031_01_000005.tokens. Credentials list: 
2015-03-13 10:13:16,364 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426266260362_0031_01_000003.tokens. Credentials list: 
2015-03-13 10:13:16,365 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1426266260362_0031_01_000006.tokens. Credentials list: 
2015-03-13 10:13:16,365 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1426266260362_0031_01_000007.tokens. Credentials list: 
2015-03-13 10:13:16,365 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0031_01_000004.tokens. Credentials list: 
2015-03-13 10:13:16,382 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:13:16,382 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:13:16,451 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:16,451 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:16,451 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:16,452 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:16,452 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:13:16,453 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:13:16,453 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:13:16,453 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000007 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:13:16,453 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0030 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:13:16,453 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0030
2015-03-13 10:13:16,454 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0030
2015-03-13 10:13:16,454 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0030 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:13:16,454 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0030, with delay of 10800 seconds
2015-03-13 10:13:16,454 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0030
2015-03-13 10:13:16,454 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0030
2015-03-13 10:13:16,454 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0030
2015-03-13 10:13:16,469 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0031_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000005.tokens
2015-03-13 10:13:16,469 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0031 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0031
2015-03-13 10:13:16,471 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1426266260362_0031_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000002.tokens
2015-03-13 10:13:16,471 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0031 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0031
2015-03-13 10:13:16,539 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.jar	dst=null	perm=null
2015-03-13 10:13:16,539 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.jar	dst=null	perm=null
2015-03-13 10:13:16,540 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.jar	dst=null	perm=null
2015-03-13 10:13:16,540 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.jar	dst=null	perm=null
2015-03-13 10:13:16,540 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.jar	dst=null	perm=null
2015-03-13 10:13:16,540 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.jar	dst=null	perm=null
2015-03-13 10:13:16,547 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63523, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-353960031_16621, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742199_1375, duration: 519000
2015-03-13 10:13:16,547 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63522, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-2105913678_16622, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742199_1375, duration: 546000
2015-03-13 10:13:16,571 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:13:16,571 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:13:16,591 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.xml	dst=null	perm=null
2015-03-13 10:13:16,592 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.xml	dst=null	perm=null
2015-03-13 10:13:16,593 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.xml	dst=null	perm=null
2015-03-13 10:13:16,593 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.xml	dst=null	perm=null
2015-03-13 10:13:16,593 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.xml	dst=null	perm=null
2015-03-13 10:13:16,594 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.xml	dst=null	perm=null
2015-03-13 10:13:16,600 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63523, bytes: 101662, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-2105913678_16622, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742202_1378, duration: 243000
2015-03-13 10:13:16,600 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63522, bytes: 101662, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-353960031_16621, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742202_1378, duration: 299000
2015-03-13 10:13:16,614 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:13:16,614 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000007 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:13:16,614 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:13:16,614 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:13:16,614 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:13:16,614 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:13:16,614 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:13:16,614 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:13:16,628 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742203_1379
2015-03-13 10:13:16,667 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742192_1368 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742192 for deletion
2015-03-13 10:13:16,667 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742177_1353 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742177 for deletion
2015-03-13 10:13:16,667 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742179_1355 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742179 for deletion
2015-03-13 10:13:16,667 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742181_1357 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742181 for deletion
2015-03-13 10:13:16,667 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742166_1342 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742166 for deletion
2015-03-13 10:13:16,667 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742167_1343 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742167 for deletion
2015-03-13 10:13:16,667 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742168_1344 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742168 for deletion
2015-03-13 10:13:16,667 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742186_1362 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742186 for deletion
2015-03-13 10:13:16,667 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742187_1363 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742187 for deletion
2015-03-13 10:13:16,667 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742188_1364 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742188 for deletion
2015-03-13 10:13:16,668 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742189_1365 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742189 for deletion
2015-03-13 10:13:16,668 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742190_1366 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742190 for deletion
2015-03-13 10:13:16,668 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742192_1368 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742192
2015-03-13 10:13:16,669 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742179_1355 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742179
2015-03-13 10:13:16,669 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742166_1342 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742166
2015-03-13 10:13:16,669 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742168_1344 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742168
2015-03-13 10:13:16,669 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742187_1363 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742187
2015-03-13 10:13:16,669 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742189_1365 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742189
2015-03-13 10:13:16,670 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742190_1366 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742190
2015-03-13 10:13:16,670 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742177_1353 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742177
2015-03-13 10:13:16,670 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742181_1357 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742181
2015-03-13 10:13:16,670 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742167_1343 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742167
2015-03-13 10:13:16,671 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742186_1362 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742186
2015-03-13 10:13:16,671 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742188_1364 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742188
2015-03-13 10:13:16,674 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742163_1339 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742163 for deletion
2015-03-13 10:13:16,674 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742179_1355 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742179 for deletion
2015-03-13 10:13:16,674 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742180_1356 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742180 for deletion
2015-03-13 10:13:16,674 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742165_1341 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742165 for deletion
2015-03-13 10:13:16,674 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742181_1357 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742181 for deletion
2015-03-13 10:13:16,674 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742166_1342 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742166 for deletion
2015-03-13 10:13:16,674 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742182_1358 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742182 for deletion
2015-03-13 10:13:16,674 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742186_1362 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742186 for deletion
2015-03-13 10:13:16,674 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742187_1363 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742187 for deletion
2015-03-13 10:13:16,684 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742188_1364 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742188 for deletion
2015-03-13 10:13:16,684 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742163_1339 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742163
2015-03-13 10:13:16,684 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742189_1365 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742189 for deletion
2015-03-13 10:13:16,684 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742203_1379
2015-03-13 10:13:16,684 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742179_1355 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742179
2015-03-13 10:13:16,684 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742180_1356 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742180
2015-03-13 10:13:16,685 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742165_1341 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742165
2015-03-13 10:13:16,685 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742166_1342 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742166
2015-03-13 10:13:16,684 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742190_1366 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742190 for deletion
2015-03-13 10:13:16,685 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742182_1358 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742182
2015-03-13 10:13:16,685 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742181_1357 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742181
2015-03-13 10:13:16,686 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742187_1363 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742187
2015-03-13 10:13:16,686 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742186_1362 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742186
2015-03-13 10:13:16,686 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742189_1365 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742189
2015-03-13 10:13:16,686 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742188_1364 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742188
2015-03-13 10:13:16,686 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742190_1366 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742190
2015-03-13 10:13:16,686 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:13:16,686 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:16,687 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000007 transitioned from LOCALIZED to RUNNING
2015-03-13 10:13:16,687 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:16,687 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:13:16,687 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:16,689 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:13:16,689 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:16,689 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:13:16,689 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:16,693 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:13:16,693 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:16,831 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000006/default_container_executor.sh]
2015-03-13 10:13:16,842 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000004/default_container_executor.sh]
2015-03-13 10:13:16,864 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000007/default_container_executor.sh]
2015-03-13 10:13:16,868 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000005/default_container_executor.sh]
2015-03-13 10:13:16,872 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000002/default_container_executor.sh]
2015-03-13 10:13:16,875 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000003/default_container_executor.sh]
2015-03-13 10:13:16,969 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:17,163 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0030 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:13:17,164 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0030
2015-03-13 10:13:17,164 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0030
2015-03-13 10:13:17,164 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0030 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:13:17,164 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0030, with delay of 10800 seconds
2015-03-13 10:13:17,164 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0030
2015-03-13 10:13:17,165 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0030
2015-03-13 10:13:17,165 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0030
2015-03-13 10:13:17,227 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742203_1379
2015-03-13 10:13:17,228 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:13:17,352 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:17,352 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:17,353 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0030 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:13:17,353 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0030
2015-03-13 10:13:17,353 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0030
2015-03-13 10:13:17,353 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0030
2015-03-13 10:13:17,353 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0030 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:13:17,353 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0030, with delay of 10800 seconds
2015-03-13 10:13:17,353 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0030
2015-03-13 10:13:17,353 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0030
2015-03-13 10:13:17,456 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:17,456 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:17,456 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:17,456 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:17,641 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:13:17,641 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:13:17,777 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426266260362_0031_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000003.tokens
2015-03-13 10:13:17,777 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0031 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0031
2015-03-13 10:13:17,778 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0031_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000004.tokens
2015-03-13 10:13:17,778 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0031 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0031
2015-03-13 10:13:17,883 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:13:17,973 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:18,011 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1426266260362_0031_01_000007.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000007.tokens
2015-03-13 10:13:18,011 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0031 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0031
2015-03-13 10:13:18,120 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:13:18,249 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1426266260362_0031_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000006.tokens
2015-03-13 10:13:18,250 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0031 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0031
2015-03-13 10:13:18,355 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:18,355 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:18,460 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:18,460 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:18,460 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:18,461 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:18,974 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:19,360 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:19,360 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:19,463 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:19,463 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:19,464 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:19,464 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:19,976 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:20,363 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:20,364 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:20,465 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:20,466 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:20,466 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:20,466 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:20,976 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:21,364 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:21,365 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:21,471 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:21,471 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:21,471 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:21,472 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:21,978 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:22,368 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:22,368 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:22,475 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:22,475 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:22,475 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:22,475 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:22,984 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:23,374 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:23,374 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:23,481 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:23,481 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:23,481 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:23,481 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:23,986 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:24,378 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:24,378 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:24,486 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:24,486 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:24,487 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:24,487 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:24,987 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:25,383 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:25,384 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:25,492 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:25,493 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:25,493 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:25,493 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:25,988 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:26,294 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.split	dst=null	perm=null
2015-03-13 10:13:26,343 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.split	dst=null	perm=null
2015-03-13 10:13:26,386 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:26,386 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:26,388 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.split	dst=null	perm=null
2015-03-13 10:13:26,417 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.split	dst=null	perm=null
2015-03-13 10:13:26,477 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.split	dst=null	perm=null
2015-03-13 10:13:26,493 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:26,494 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:26,494 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:26,494 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:26,512 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63538, bytes: 2153, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0031_m_000000_0_-2106661709_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742200_1376, duration: 168000
2015-03-13 10:13:26,568 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.split	dst=null	perm=null
2015-03-13 10:13:26,585 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63540, bytes: 2153, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0031_m_000001_0_-122747551_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742200_1376, duration: 193000
2015-03-13 10:13:26,613 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63541, bytes: 605, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0031_m_000005_0_-464622655_1, offset: 1536, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742200_1376, duration: 182000
2015-03-13 10:13:26,630 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63543, bytes: 1637, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0031_m_000002_0_-305312229_1, offset: 512, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742200_1376, duration: 178000
2015-03-13 10:13:26,647 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63544, bytes: 1121, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0031_m_000004_0_605245946_1, offset: 1024, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742200_1376, duration: 175000
2015-03-13 10:13:26,704 INFO  hs.JobHistory (JobHistory.java:run(178)) - Starting scan to move intermediate done files
2015-03-13 10:13:26,704 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt	dst=null	perm=null
2015-03-13 10:13:26,706 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:13:26,707 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:13:26,710 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0021.summary	dst=null	perm=null
2015-03-13 10:13:26,710 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0023.summary	dst=null	perm=null
2015-03-13 10:13:26,710 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0022.summary	dst=null	perm=null
2015-03-13 10:13:26,712 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63548, bytes: 415, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742092_1268, duration: 161000
2015-03-13 10:13:26,712 INFO  jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0022,submitTime=1426266637614,launchTime=1426266640995,firstMapTaskLaunchTime=1426266643151,firstReduceTaskLaunchTime=0,finishTime=1426266652550,resourcesPerMap=1024,resourcesPerReduce=0,numMaps=5,numReduces=0,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=45,reduceSlotSeconds=0,jobName=[5C1ADEBEAF9544CFBB574223654F352B/C41347FCE26941FD99688B6E707F843A] lower*upper/(2/2)
2015-03-13 10:13:26,712 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63549, bytes: 444, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742078_1254, duration: 133000
2015-03-13 10:13:26,712 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63547, bytes: 444, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742105_1281, duration: 99000
2015-03-13 10:13:26,713 INFO  jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0021,submitTime=1426266621046,launchTime=1426266624516,firstMapTaskLaunchTime=1426266626691,firstReduceTaskLaunchTime=0,finishTime=1426266636276,resourcesPerMap=1024,resourcesPerReduce=0,numMaps=5,numReduces=0,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=46,reduceSlotSeconds=0,jobName=[5665C2AB3C80426983CDE9B8E87C8DA6/3A3A52572DE2469599E707FB097F70CF] lower*upper/(1/1) ...dedpipesplatform/joinnone
2015-03-13 10:13:26,712 INFO  jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0023,submitTime=1426266653789,launchTime=1426266657150,firstMapTaskLaunchTime=1426266659312,firstReduceTaskLaunchTime=0,finishTime=1426266669026,resourcesPerMap=1024,resourcesPerReduce=0,numMaps=5,numReduces=0,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=47,reduceSlotSeconds=0,jobName=[5C1ADEBEAF9544CFBB574223654F352B/D216C764973C483CA6D2DDC3E72E5438] lower*upper/(1/2) ...dedpipesplatform/joinself
2015-03-13 10:13:26,713 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0023.summary]
2015-03-13 10:13:26,712 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0022.summary]
2015-03-13 10:13:26,713 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0021.summary]
2015-03-13 10:13:26,718 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742105_1281 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60689 
2015-03-13 10:13:26,718 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0023.summary	dst=null	perm=null
2015-03-13 10:13:26,718 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742092_1268 127.0.0.1:60693 127.0.0.1:60689 127.0.0.1:60696 
2015-03-13 10:13:26,718 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0022.summary	dst=null	perm=null
2015-03-13 10:13:26,718 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742078_1254 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60689 
2015-03-13 10:13:26,719 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0021.summary	dst=null	perm=null
2015-03-13 10:13:26,720 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000	dst=null	perm=null
2015-03-13 10:13:26,720 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000	dst=null	perm=null
2015-03-13 10:13:26,721 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000	dst=null	perm=null
2015-03-13 10:13:26,721 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0023-1426266653789-soberoi-%5B5C1ADEBEAF9544CFBB574223654F352B%2FD216C764973C483C-1426266669026-5-0-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0023-1426266653789-soberoi-%5B5C1ADEBEAF9544CFBB574223654F352B%2FD216C764973C483C-1426266669026-5-0-SUCCEEDED-default.jhist
2015-03-13 10:13:26,721 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0022-1426266637614-soberoi-%5B5C1ADEBEAF9544CFBB574223654F352B%2FC41347FCE26941FD-1426266652550-5-0-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0022-1426266637614-soberoi-%5B5C1ADEBEAF9544CFBB574223654F352B%2FC41347FCE26941FD-1426266652550-5-0-SUCCEEDED-default.jhist
2015-03-13 10:13:26,721 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0021-1426266621046-soberoi-%5B5665C2AB3C80426983CDE9B8E87C8DA6%2F3A3A52572DE24695-1426266636276-5-0-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0021-1426266621046-soberoi-%5B5665C2AB3C80426983CDE9B8E87C8DA6%2F3A3A52572DE24695-1426266636276-5-0-SUCCEEDED-default.jhist
2015-03-13 10:13:26,722 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0023-1426266653789-soberoi-%5B5C1ADEBEAF9544CFBB574223654F352B%2FD216C764973C483C-1426266669026-5-0-SUCCEEDED-default.jhist	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0023-1426266653789-soberoi-%5B5C1ADEBEAF9544CFBB574223654F352B%2FD216C764973C483C-1426266669026-5-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:26,722 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0021-1426266621046-soberoi-%5B5665C2AB3C80426983CDE9B8E87C8DA6%2F3A3A52572DE24695-1426266636276-5-0-SUCCEEDED-default.jhist	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0021-1426266621046-soberoi-%5B5665C2AB3C80426983CDE9B8E87C8DA6%2F3A3A52572DE24695-1426266636276-5-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:26,722 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0023_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0023_conf.xml
2015-03-13 10:13:26,722 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0022-1426266637614-soberoi-%5B5C1ADEBEAF9544CFBB574223654F352B%2FC41347FCE26941FD-1426266652550-5-0-SUCCEEDED-default.jhist	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0022-1426266637614-soberoi-%5B5C1ADEBEAF9544CFBB574223654F352B%2FC41347FCE26941FD-1426266652550-5-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:26,722 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0021_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0021_conf.xml
2015-03-13 10:13:26,723 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0022_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0022_conf.xml
2015-03-13 10:13:26,723 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0023_conf.xml	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0023_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:26,723 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0022_conf.xml	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0022_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:26,723 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0021_conf.xml	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0021_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:26,724 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0024.summary	dst=null	perm=null
2015-03-13 10:13:26,724 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0025.summary	dst=null	perm=null
2015-03-13 10:13:26,724 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0026.summary	dst=null	perm=null
2015-03-13 10:13:26,726 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63552, bytes: 430, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742142_1318, duration: 173000
2015-03-13 10:13:26,726 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63550, bytes: 452, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742132_1308, duration: 339000
2015-03-13 10:13:26,726 INFO  jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0024,submitTime=1426266670375,launchTime=1426266673648,firstMapTaskLaunchTime=1426266675804,firstReduceTaskLaunchTime=0,finishTime=1426266685513,resourcesPerMap=1024,resourcesPerReduce=0,numMaps=5,numReduces=0,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=47,reduceSlotSeconds=0,jobName=[716001CDD2B94A3FADE59C5DF8875A2D/4BC832EC1D1E4858AE3D38200A23E3C1] upper2*lower*upper1/(2/2)
2015-03-13 10:13:26,726 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63551, bytes: 423, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742119_1295, duration: 197000
2015-03-13 10:13:26,726 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0024.summary]
2015-03-13 10:13:26,726 INFO  jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0025,submitTime=1426266686752,launchTime=1426266690149,firstMapTaskLaunchTime=1426266692306,firstReduceTaskLaunchTime=0,finishTime=1426266702150,resourcesPerMap=1024,resourcesPerReduce=0,numMaps=5,numReduces=0,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=48,reduceSlotSeconds=0,jobName=[716001CDD2B94A3FADE59C5DF8875A2D/9FD5B5C1ECE64C749C8E187DBF5C6990] upper2*lower*upper1/(1/2) ...orm/joinaroundjoinswapped
2015-03-13 10:13:26,727 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0025.summary]
2015-03-13 10:13:26,726 INFO  jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0026,submitTime=1426266703493,launchTime=1426266706853,firstMapTaskLaunchTime=1426266709012,firstReduceTaskLaunchTime=1426266720953,finishTime=1426266723843,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=5,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=47,reduceSlotSeconds=2,jobName=[D22FDB06DDD24032BF29C6EAE9E54D4B/116CA5A33C1047FAA2216FF3C2C5902D] lower*upper/(2/2)
2015-03-13 10:13:26,727 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0026.summary]
2015-03-13 10:13:26,731 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742119_1295 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60689 
2015-03-13 10:13:26,731 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0024.summary	dst=null	perm=null
2015-03-13 10:13:26,731 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742142_1318 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60693 
2015-03-13 10:13:26,731 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0026.summary	dst=null	perm=null
2015-03-13 10:13:26,731 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742132_1308 127.0.0.1:60689 127.0.0.1:60693 127.0.0.1:60696 
2015-03-13 10:13:26,732 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0025.summary	dst=null	perm=null
2015-03-13 10:13:26,733 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000	dst=null	perm=null
2015-03-13 10:13:26,734 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000	dst=null	perm=null
2015-03-13 10:13:26,734 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000	dst=null	perm=null
2015-03-13 10:13:26,734 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0024-1426266670375-soberoi-%5B716001CDD2B94A3FADE59C5DF8875A2D%2F4BC832EC1D1E4858-1426266685513-5-0-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0024-1426266670375-soberoi-%5B716001CDD2B94A3FADE59C5DF8875A2D%2F4BC832EC1D1E4858-1426266685513-5-0-SUCCEEDED-default.jhist
2015-03-13 10:13:26,734 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0026-1426266703493-soberoi-%5BD22FDB06DDD24032BF29C6EAE9E54D4B%2F116CA5A33C1047FA-1426266723843-5-1-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0026-1426266703493-soberoi-%5BD22FDB06DDD24032BF29C6EAE9E54D4B%2F116CA5A33C1047FA-1426266723843-5-1-SUCCEEDED-default.jhist
2015-03-13 10:13:26,734 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0025-1426266686752-soberoi-%5B716001CDD2B94A3FADE59C5DF8875A2D%2F9FD5B5C1ECE64C74-1426266702150-5-0-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0025-1426266686752-soberoi-%5B716001CDD2B94A3FADE59C5DF8875A2D%2F9FD5B5C1ECE64C74-1426266702150-5-0-SUCCEEDED-default.jhist
2015-03-13 10:13:26,735 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0024-1426266670375-soberoi-%5B716001CDD2B94A3FADE59C5DF8875A2D%2F4BC832EC1D1E4858-1426266685513-5-0-SUCCEEDED-default.jhist	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0024-1426266670375-soberoi-%5B716001CDD2B94A3FADE59C5DF8875A2D%2F4BC832EC1D1E4858-1426266685513-5-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:26,735 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0025-1426266686752-soberoi-%5B716001CDD2B94A3FADE59C5DF8875A2D%2F9FD5B5C1ECE64C74-1426266702150-5-0-SUCCEEDED-default.jhist	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0025-1426266686752-soberoi-%5B716001CDD2B94A3FADE59C5DF8875A2D%2F9FD5B5C1ECE64C74-1426266702150-5-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:26,735 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0024_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0024_conf.xml
2015-03-13 10:13:26,735 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0026-1426266703493-soberoi-%5BD22FDB06DDD24032BF29C6EAE9E54D4B%2F116CA5A33C1047FA-1426266723843-5-1-SUCCEEDED-default.jhist	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0026-1426266703493-soberoi-%5BD22FDB06DDD24032BF29C6EAE9E54D4B%2F116CA5A33C1047FA-1426266723843-5-1-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:26,736 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0025_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0025_conf.xml
2015-03-13 10:13:26,736 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0026_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0026_conf.xml
2015-03-13 10:13:26,736 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0024_conf.xml	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0024_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:26,737 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0026_conf.xml	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0026_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:26,737 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0025_conf.xml	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0025_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:26,737 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0027.summary	dst=null	perm=null
2015-03-13 10:13:26,737 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0028.summary	dst=null	perm=null
2015-03-13 10:13:26,737 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0029.summary	dst=null	perm=null
2015-03-13 10:13:26,738 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63552, bytes: 444, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742155_1331, duration: 112000
2015-03-13 10:13:26,738 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63550, bytes: 423, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742169_1345, duration: 150000
2015-03-13 10:13:26,738 INFO  jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0027,submitTime=1426266725092,launchTime=1426266728780,firstMapTaskLaunchTime=1426266730941,firstReduceTaskLaunchTime=0,finishTime=1426266740198,resourcesPerMap=1024,resourcesPerReduce=0,numMaps=5,numReduces=0,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=45,reduceSlotSeconds=0,jobName=[D22FDB06DDD24032BF29C6EAE9E54D4B/55AECEF510524BE28EDC4742DCE94B2F] lower*upper/(1/2) ...atform/joinfilteredbranch
2015-03-13 10:13:26,739 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0027.summary]
2015-03-13 10:13:26,738 INFO  jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0028,submitTime=1426266741548,launchTime=1426266744942,firstMapTaskLaunchTime=1426266747098,firstReduceTaskLaunchTime=0,finishTime=1426266756416,resourcesPerMap=1024,resourcesPerReduce=0,numMaps=5,numReduces=0,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=45,reduceSlotSeconds=0,jobName=[B61955F7F1A34D09B0265BE65DDD3B28/31E34ADFFB5F45C187BD485C865354E1] lower*upper1*upper2/(3/3)
2015-03-13 10:13:26,739 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0028.summary]
2015-03-13 10:13:26,739 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63553, bytes: 423, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742183_1359, duration: 174000
2015-03-13 10:13:26,739 INFO  jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0029,submitTime=1426266757667,launchTime=1426266760938,firstMapTaskLaunchTime=1426266763100,firstReduceTaskLaunchTime=0,finishTime=1426266772967,resourcesPerMap=1024,resourcesPerReduce=0,numMaps=5,numReduces=0,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=47,reduceSlotSeconds=0,jobName=[B61955F7F1A34D09B0265BE65DDD3B28/8EF7DC42A1E14629BD263FCEE1EED9A7] lower*upper1*upper2/(2/3)
2015-03-13 10:13:26,739 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0029.summary]
2015-03-13 10:13:26,739 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742155_1331 127.0.0.1:60686 127.0.0.1:60693 127.0.0.1:60689 
2015-03-13 10:13:26,740 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0027.summary	dst=null	perm=null
2015-03-13 10:13:26,740 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742183_1359 127.0.0.1:60686 127.0.0.1:60693 127.0.0.1:60696 
2015-03-13 10:13:26,740 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742169_1345 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60696 
2015-03-13 10:13:26,740 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0029.summary	dst=null	perm=null
2015-03-13 10:13:26,741 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0028.summary	dst=null	perm=null
2015-03-13 10:13:26,742 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000	dst=null	perm=null
2015-03-13 10:13:26,742 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000	dst=null	perm=null
2015-03-13 10:13:26,742 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0027-1426266725092-soberoi-%5BD22FDB06DDD24032BF29C6EAE9E54D4B%2F55AECEF510524BE2-1426266740198-5-0-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0027-1426266725092-soberoi-%5BD22FDB06DDD24032BF29C6EAE9E54D4B%2F55AECEF510524BE2-1426266740198-5-0-SUCCEEDED-default.jhist
2015-03-13 10:13:26,742 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000	dst=null	perm=null
2015-03-13 10:13:26,742 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0028-1426266741548-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2F31E34ADFFB5F45C1-1426266756416-5-0-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0028-1426266741548-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2F31E34ADFFB5F45C1-1426266756416-5-0-SUCCEEDED-default.jhist
2015-03-13 10:13:26,743 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0029-1426266757667-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2F8EF7DC42A1E14629-1426266772967-5-0-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0029-1426266757667-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2F8EF7DC42A1E14629-1426266772967-5-0-SUCCEEDED-default.jhist
2015-03-13 10:13:26,743 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0027-1426266725092-soberoi-%5BD22FDB06DDD24032BF29C6EAE9E54D4B%2F55AECEF510524BE2-1426266740198-5-0-SUCCEEDED-default.jhist	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0027-1426266725092-soberoi-%5BD22FDB06DDD24032BF29C6EAE9E54D4B%2F55AECEF510524BE2-1426266740198-5-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:26,743 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0028-1426266741548-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2F31E34ADFFB5F45C1-1426266756416-5-0-SUCCEEDED-default.jhist	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0028-1426266741548-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2F31E34ADFFB5F45C1-1426266756416-5-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:26,743 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0027_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0027_conf.xml
2015-03-13 10:13:26,743 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0029-1426266757667-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2F8EF7DC42A1E14629-1426266772967-5-0-SUCCEEDED-default.jhist	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0029-1426266757667-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2F8EF7DC42A1E14629-1426266772967-5-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:26,744 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0028_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0028_conf.xml
2015-03-13 10:13:26,744 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0029_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0029_conf.xml
2015-03-13 10:13:26,745 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0027_conf.xml	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0027_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:26,745 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0029_conf.xml	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0029_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:26,745 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0028_conf.xml	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0028_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:26,745 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0030.summary	dst=null	perm=null
2015-03-13 10:13:26,746 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63548, bytes: 452, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742196_1372, duration: 146000
2015-03-13 10:13:26,746 INFO  jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0030,submitTime=1426266774213,launchTime=1426266777603,firstMapTaskLaunchTime=1426266779751,firstReduceTaskLaunchTime=0,finishTime=1426266789493,resourcesPerMap=1024,resourcesPerReduce=0,numMaps=5,numReduces=0,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=47,reduceSlotSeconds=0,jobName=[B61955F7F1A34D09B0265BE65DDD3B28/C57B5DBC9F57493FBC8351F3D1E72603] lower*upper1*upper2/(1/3) ...rm/joinsamesourceintojoin
2015-03-13 10:13:26,747 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0030.summary]
2015-03-13 10:13:26,748 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742196_1372 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60686 
2015-03-13 10:13:26,748 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0030.summary	dst=null	perm=null
2015-03-13 10:13:26,749 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63545, bytes: 1121, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0031_m_000003_0_1621922467_1, offset: 1024, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742200_1376, duration: 153000
2015-03-13 10:13:26,750 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000	dst=null	perm=null
2015-03-13 10:13:26,750 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0030-1426266774213-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2FC57B5DBC9F57493F-1426266789493-5-0-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0030-1426266774213-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2FC57B5DBC9F57493F-1426266789493-5-0-SUCCEEDED-default.jhist
2015-03-13 10:13:26,755 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0030-1426266774213-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2FC57B5DBC9F57493F-1426266789493-5-0-SUCCEEDED-default.jhist	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0030-1426266774213-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2FC57B5DBC9F57493F-1426266789493-5-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:26,755 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0030_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0030_conf.xml
2015-03-13 10:13:26,756 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0030_conf.xml	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0030_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:26,774 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:13:26,777 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63541, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0031_m_000005_0_-464622655_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 145000
2015-03-13 10:13:26,778 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt	dst=null	perm=null
2015-03-13 10:13:26,782 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63554, bytes: 56, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0031_m_000001_0_-122747551_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741912_1088, duration: 149000
2015-03-13 10:13:26,805 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:13:26,845 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:13:26,849 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63555, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0031_m_000004_0_605245946_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 160000
2015-03-13 10:13:26,887 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:13:26,891 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63556, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0031_m_000003_0_1621922467_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 155000
2015-03-13 10:13:26,994 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:27,380 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt	dst=null	perm=null
2015-03-13 10:13:27,390 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:27,390 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:27,425 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:13:27,430 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt	dst=null	perm=null
2015-03-13 10:13:27,433 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt	dst=null	perm=null
2015-03-13 10:13:27,439 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63557, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0031_m_000000_0_-2106661709_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741913_1089, duration: 160000
2015-03-13 10:13:27,444 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63538, bytes: 56, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0031_m_000000_0_-2106661709_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741912_1088, duration: 166000
2015-03-13 10:13:27,450 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:13:27,454 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt	dst=null	perm=null
2015-03-13 10:13:27,460 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:13:27,464 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:13:27,467 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt	dst=null	perm=null
2015-03-13 10:13:27,470 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt	dst=null	perm=null
2015-03-13 10:13:27,472 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63558, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0031_m_000005_0_-464622655_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 138000
2015-03-13 10:13:27,475 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63559, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0031_m_000001_0_-122747551_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741913_1089, duration: 138000
2015-03-13 10:13:27,489 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:13:27,498 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:27,498 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:27,499 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:27,499 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:27,506 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup/_temporary/1/_temporary/attempt_1426266260362_0031_m_000005_0	dst=null	perm=null
2015-03-13 10:13:27,510 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup/_temporary/1/_temporary/attempt_1426266260362_0031_m_000000_0	dst=null	perm=null
2015-03-13 10:13:27,530 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0031_000001 (auth:SIMPLE)
2015-03-13 10:13:27,530 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0031_000001 (auth:SIMPLE)
2015-03-13 10:13:27,532 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0031_01_000007
2015-03-13 10:13:27,532 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0031_01_000002
2015-03-13 10:13:27,532 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000007 transitioned from RUNNING to KILLING
2015-03-13 10:13:27,532 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:13:27,532 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0031	CONTAINERID=container_1426266260362_0031_01_000007
2015-03-13 10:13:27,532 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0031_01_000002
2015-03-13 10:13:27,532 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0031_01_000007
2015-03-13 10:13:27,532 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:27,532 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0031	CONTAINERID=container_1426266260362_0031_01_000002
2015-03-13 10:13:27,533 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:27,533 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:27,533 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:13:27,533 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:13:27,533 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:27,535 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:13:27,546 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0031_01_000002 is : 143
2015-03-13 10:13:27,547 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0031_01_000007 is : 143
2015-03-13 10:13:27,550 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job_1426266260362_0031_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073742204_1380{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:13:27,552 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742204_1380 src: /127.0.0.1:63563 dest: /127.0.0.1:60693
2015-03-13 10:13:27,553 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742204_1380 src: /127.0.0.1:63564 dest: /127.0.0.1:60686
2015-03-13 10:13:27,555 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742204_1380 src: /127.0.0.1:63565 dest: /127.0.0.1:60696
2015-03-13 10:13:27,558 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000007 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:13:27,559 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:13:27,559 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000007
2015-03-13 10:13:27,559 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0031	CONTAINERID=container_1426266260362_0031_01_000007
2015-03-13 10:13:27,559 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000007 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:13:27,559 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0031	CONTAINERID=container_1426266260362_0031_01_000002
2015-03-13 10:13:27,559 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:13:27,559 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000002
2015-03-13 10:13:27,559 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0031_01_000007 from application application_1426266260362_0031
2015-03-13 10:13:27,559 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:27,560 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0031
2015-03-13 10:13:27,560 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000002
2015-03-13 10:13:27,560 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000007
2015-03-13 10:13:27,560 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000007
2015-03-13 10:13:27,560 INFO  hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job_1426266260362_0031_1.jhist for DFSClient_NONMAPREDUCE_-145669230_1
2015-03-13 10:13:27,559 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0031_01_000002 from application application_1426266260362_0031
2015-03-13 10:13:27,561 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:27,561 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0031
2015-03-13 10:13:27,559 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000007
2015-03-13 10:13:27,561 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000002
2015-03-13 10:13:27,559 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000002
2015-03-13 10:13:27,565 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:13:27,571 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63566, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0031_m_000002_0_-305312229_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 138000
2015-03-13 10:13:27,577 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63566, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0031_m_000002_0_-305312229_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 177000
2015-03-13 10:13:27,579 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:13:27,582 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:13:27,587 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63567, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0031_m_000004_0_605245946_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 149000
2015-03-13 10:13:27,591 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup/_temporary/1/_temporary/attempt_1426266260362_0031_m_000001_0	dst=null	perm=null
2015-03-13 10:13:27,604 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0031_01_000003
2015-03-13 10:13:27,605 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0031	CONTAINERID=container_1426266260362_0031_01_000003
2015-03-13 10:13:27,605 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:13:27,605 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0031_01_000003
2015-03-13 10:13:27,605 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:13:27,605 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0031_01_000002
2015-03-13 10:13:27,605 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:13:27,605 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:13:27,606 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0031_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:13:27,606 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0031	CONTAINERID=container_1426266260362_0031_01_000002
2015-03-13 10:13:27,606 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0031_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:13:27,606 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:7168, vCores:6> numContainers=6 user=soberoi user-resources=<memory:7168, vCores:6>
2015-03-13 10:13:27,606 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0031_01_000002, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=1, numContainers=6 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:27,606 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:27,606 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=1, numContainers=6
2015-03-13 10:13:27,606 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0031_000001 released container container_1426266260362_0031_01_000002 on node: host: 10.1.1.144:60715 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:13:27,617 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0031_01_000003 is : 143
2015-03-13 10:13:27,623 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup/_temporary/1/_temporary/attempt_1426266260362_0031_m_000002_0	dst=null	perm=null
2015-03-13 10:13:27,626 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:13:27,629 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:13:27,630 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000003
2015-03-13 10:13:27,631 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000003
2015-03-13 10:13:27,631 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000003
2015-03-13 10:13:27,632 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000003
2015-03-13 10:13:27,633 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0031	CONTAINERID=container_1426266260362_0031_01_000003
2015-03-13 10:13:27,634 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:13:27,634 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0031_01_000003 from application application_1426266260362_0031
2015-03-13 10:13:27,634 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:27,634 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0031
2015-03-13 10:13:27,637 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0031_01_000004
2015-03-13 10:13:27,637 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0031	CONTAINERID=container_1426266260362_0031_01_000004
2015-03-13 10:13:27,637 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:13:27,637 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0031_01_000004
2015-03-13 10:13:27,638 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:13:27,638 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:27,638 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:27,638 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:13:27,638 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0031_01_000007
2015-03-13 10:13:27,639 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000007 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:13:27,639 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0031_01_000007 in state: COMPLETED event:FINISHED
2015-03-13 10:13:27,639 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0031	CONTAINERID=container_1426266260362_0031_01_000007
2015-03-13 10:13:27,639 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0031_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:13:27,639 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:13:27,639 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0031_01_000007, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:27,639 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:27,639 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:13:27,639 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0031_000001 released container container_1426266260362_0031_01_000007 on node: host: 10.1.1.144:60711 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:13:27,650 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0031_01_000004 is : 143
2015-03-13 10:13:27,651 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup/_temporary/1/_temporary/attempt_1426266260362_0031_m_000004_0	dst=null	perm=null
2015-03-13 10:13:27,655 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:13:27,659 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:13:27,660 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0031_01_000006
2015-03-13 10:13:27,660 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0031	CONTAINERID=container_1426266260362_0031_01_000006
2015-03-13 10:13:27,660 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: -1000
2015-03-13 10:13:27,661 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:27,661 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:27,662 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:13:27,662 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:13:27,662 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000004
2015-03-13 10:13:27,663 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000004
2015-03-13 10:13:27,663 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000004
2015-03-13 10:13:27,663 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000004
2015-03-13 10:13:27,663 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0031_01_000006
2015-03-13 10:13:27,668 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63568, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0031_m_000003_0_1621922467_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 132000
2015-03-13 10:13:27,677 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0031_01_000006 is : 143
2015-03-13 10:13:27,688 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0031	CONTAINERID=container_1426266260362_0031_01_000004
2015-03-13 10:13:27,688 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:13:27,689 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:13:27,689 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0031_01_000004 from application application_1426266260362_0031
2015-03-13 10:13:27,689 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:27,689 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0031
2015-03-13 10:13:27,689 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000006
2015-03-13 10:13:27,689 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000006
2015-03-13 10:13:27,689 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000006
2015-03-13 10:13:27,690 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000006
2015-03-13 10:13:27,690 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0031	CONTAINERID=container_1426266260362_0031_01_000006
2015-03-13 10:13:27,690 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:13:27,691 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0031_01_000006 from application application_1426266260362_0031
2015-03-13 10:13:27,691 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:27,691 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0031
2015-03-13 10:13:27,696 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup/_temporary/1/_temporary/attempt_1426266260362_0031_m_000003_0	dst=null	perm=null
2015-03-13 10:13:27,702 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0031_01_000005
2015-03-13 10:13:27,702 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0031	CONTAINERID=container_1426266260362_0031_01_000005
2015-03-13 10:13:27,702 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:13:27,702 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0031_01_000004
2015-03-13 10:13:27,702 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:13:27,703 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0031_01_000005
2015-03-13 10:13:27,703 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:13:27,703 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:13:27,703 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0031_01_000006
2015-03-13 10:13:27,703 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:13:27,703 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0031_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:13:27,704 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0031	CONTAINERID=container_1426266260362_0031_01_000004
2015-03-13 10:13:27,704 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0031_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:13:27,704 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:13:27,704 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0031_01_000004, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:27,704 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:27,704 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:13:27,704 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0031_000001 released container container_1426266260362_0031_01_000004 on node: host: 10.1.1.144:60711 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:13:27,704 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:13:27,704 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0031_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:13:27,704 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0031	CONTAINERID=container_1426266260362_0031_01_000006
2015-03-13 10:13:27,704 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0031_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:13:27,705 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:13:27,705 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0031_01_000006, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:27,705 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:27,705 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:13:27,705 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0031_000001 released container container_1426266260362_0031_01_000006 on node: host: 10.1.1.144:60711 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:13:27,713 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0031_01_000005 is : 143
2015-03-13 10:13:27,725 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:13:27,725 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000005
2015-03-13 10:13:27,725 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000005
2015-03-13 10:13:27,725 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000005
2015-03-13 10:13:27,726 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000005
2015-03-13 10:13:27,726 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0031	CONTAINERID=container_1426266260362_0031_01_000005
2015-03-13 10:13:27,726 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:13:27,726 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0031_01_000005 from application application_1426266260362_0031
2015-03-13 10:13:27,727 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:27,727 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0031
2015-03-13 10:13:27,995 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:28,139 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073742196_1372, blk_1073742132_1308, blk_1073742119_1295, blk_1073742105_1281, blk_1073742155_1331, blk_1073742092_1268, blk_1073742078_1254]
2015-03-13 10:13:28,140 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073742196_1372, blk_1073742183_1359, blk_1073742169_1345, blk_1073742105_1281, blk_1073742155_1331, blk_1073742142_1318]
2015-03-13 10:13:28,606 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:13:28,606 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0031_01_000003
2015-03-13 10:13:28,606 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:13:28,606 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0031_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:13:28,607 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0031	CONTAINERID=container_1426266260362_0031_01_000003
2015-03-13 10:13:28,607 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0031_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:13:28,607 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:13:28,607 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0031_01_000003, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:28,607 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:28,607 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:13:28,607 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0031_000001 released container container_1426266260362_0031_01_000003 on node: host: 10.1.1.144:60715 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:13:28,672 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742132_1308 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742132 for deletion
2015-03-13 10:13:28,672 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742196_1372 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742196 for deletion
2015-03-13 10:13:28,673 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742119_1295 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742119 for deletion
2015-03-13 10:13:28,673 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742105_1281 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742105 for deletion
2015-03-13 10:13:28,673 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742132_1308 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742132
2015-03-13 10:13:28,673 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742155_1331 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742155 for deletion
2015-03-13 10:13:28,673 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742092_1268 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742092 for deletion
2015-03-13 10:13:28,673 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742105_1281 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742105
2015-03-13 10:13:28,673 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742078_1254 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742078 for deletion
2015-03-13 10:13:28,673 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742196_1372 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742196
2015-03-13 10:13:28,674 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742155_1331 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742155
2015-03-13 10:13:28,674 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742119_1295 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742119
2015-03-13 10:13:28,674 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742078_1254 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742078
2015-03-13 10:13:28,674 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742092_1268 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742092
2015-03-13 10:13:28,693 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742196_1372 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742196 for deletion
2015-03-13 10:13:28,693 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742183_1359 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742183 for deletion
2015-03-13 10:13:28,693 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742105_1281 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742105 for deletion
2015-03-13 10:13:28,693 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742196_1372 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742196
2015-03-13 10:13:28,694 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742169_1345 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742169 for deletion
2015-03-13 10:13:28,694 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742183_1359 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742183
2015-03-13 10:13:28,694 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742155_1331 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742155 for deletion
2015-03-13 10:13:28,694 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742105_1281 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742105
2015-03-13 10:13:28,694 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742169_1345 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742169
2015-03-13 10:13:28,694 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742142_1318 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742142 for deletion
2015-03-13 10:13:28,694 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742155_1331 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742155
2015-03-13 10:13:28,695 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742142_1318 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742142
2015-03-13 10:13:28,705 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:13:28,705 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0031_01_000005
2015-03-13 10:13:28,705 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:13:28,705 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0031_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:13:28,706 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0031	CONTAINERID=container_1426266260362_0031_01_000005
2015-03-13 10:13:28,706 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0031_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:13:28,706 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:13:28,706 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0031_01_000005, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:28,706 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:28,706 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:13:28,706 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0031_000001 released container container_1426266260362_0031_01_000005 on node: host: 10.1.1.144:60711 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:13:28,996 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:29,611 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000008 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:13:29,611 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0031	CONTAINERID=container_1426266260362_0031_01_000008
2015-03-13 10:13:29,611 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0031_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:13:29,611 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0031 container=Container: [ContainerId: container_1426266260362_0031_01_000008, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0031_01_000008 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:29,612 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:13:29,612 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:30,001 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:30,289 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000008 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:13:30,297 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0031_01_000008 by user soberoi
2015-03-13 10:13:30,297 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0031	CONTAINERID=container_1426266260362_0031_01_000008
2015-03-13 10:13:30,297 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0031_01_000008 to application application_1426266260362_0031
2015-03-13 10:13:30,298 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000008 transitioned from NEW to LOCALIZING
2015-03-13 10:13:30,298 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0031
2015-03-13 10:13:30,298 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0031
2015-03-13 10:13:30,298 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:13:30,298 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0031
2015-03-13 10:13:30,298 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000008 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:13:30,327 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000008 transitioned from LOCALIZED to RUNNING
2015-03-13 10:13:30,327 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:30,392 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000008/default_container_executor.sh]
2015-03-13 10:13:30,614 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 8 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:30,614 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000008 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:13:31,006 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:31,143 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073742196_1372, blk_1073742132_1308, blk_1073742183_1359, blk_1073742119_1295, blk_1073742169_1345, blk_1073742105_1281, blk_1073742092_1268, blk_1073742142_1318, blk_1073742078_1254]
2015-03-13 10:13:31,144 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073742132_1308, blk_1073742183_1359, blk_1073742119_1295, blk_1073742169_1345, blk_1073742155_1331, blk_1073742092_1268, blk_1073742142_1318, blk_1073742078_1254]
2015-03-13 10:13:31,296 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:13:31,615 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 8 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:31,899 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742132_1308 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742132 for deletion
2015-03-13 10:13:31,899 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742119_1295 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742119 for deletion
2015-03-13 10:13:31,900 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742183_1359 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742183 for deletion
2015-03-13 10:13:31,900 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742169_1345 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742169 for deletion
2015-03-13 10:13:31,900 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742132_1308 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742132
2015-03-13 10:13:31,900 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742155_1331 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742155 for deletion
2015-03-13 10:13:31,900 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742092_1268 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742092 for deletion
2015-03-13 10:13:31,900 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742119_1295 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742119
2015-03-13 10:13:31,900 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742169_1345 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742169
2015-03-13 10:13:31,900 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742183_1359 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742183
2015-03-13 10:13:31,900 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742092_1268 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742092
2015-03-13 10:13:31,901 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742155_1331 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742155
2015-03-13 10:13:31,900 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742078_1254 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742078 for deletion
2015-03-13 10:13:31,901 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742142_1318 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742142 for deletion
2015-03-13 10:13:31,901 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742078_1254 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742078
2015-03-13 10:13:31,901 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742142_1318 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742142
2015-03-13 10:13:32,011 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:32,099 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742132_1308 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742132 for deletion
2015-03-13 10:13:32,099 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742196_1372 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742196 for deletion
2015-03-13 10:13:32,099 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742119_1295 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742119 for deletion
2015-03-13 10:13:32,099 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742132_1308 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742132
2015-03-13 10:13:32,099 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742183_1359 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742183 for deletion
2015-03-13 10:13:32,099 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742196_1372 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742196
2015-03-13 10:13:32,099 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742105_1281 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742105 for deletion
2015-03-13 10:13:32,100 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742169_1345 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742169 for deletion
2015-03-13 10:13:32,100 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742092_1268 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742092 for deletion
2015-03-13 10:13:32,100 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742119_1295 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742119
2015-03-13 10:13:32,100 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742078_1254 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742078 for deletion
2015-03-13 10:13:32,100 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742142_1318 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742142 for deletion
2015-03-13 10:13:32,100 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742183_1359 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742183
2015-03-13 10:13:32,100 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742078_1254 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742078
2015-03-13 10:13:32,100 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742105_1281 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742105
2015-03-13 10:13:32,100 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742142_1318 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742142
2015-03-13 10:13:32,100 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742169_1345 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742169
2015-03-13 10:13:32,101 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742092_1268 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742092
2015-03-13 10:13:32,620 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 8 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:32,772 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup/_temporary/1/_temporary/attempt_1426266260362_0031_r_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:32,827 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup/_temporary/1/_temporary/attempt_1426266260362_0031_r_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073742205_1381{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:13:32,886 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742205_1381 src: /127.0.0.1:63575 dest: /127.0.0.1:60696
2015-03-13 10:13:32,888 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742205_1381 src: /127.0.0.1:63576 dest: /127.0.0.1:60689
2015-03-13 10:13:32,889 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742205_1381 src: /127.0.0.1:63577 dest: /127.0.0.1:60686
2015-03-13 10:13:32,899 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63577, dest: /127.0.0.1:60686, bytes: 592, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0031_r_000000_0_704706670_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742205_1381, duration: 9221000
2015-03-13 10:13:32,900 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742205_1381, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:32,900 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742205_1381{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:32,900 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63576, dest: /127.0.0.1:60689, bytes: 592, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0031_r_000000_0_704706670_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742205_1381, duration: 9859000
2015-03-13 10:13:32,900 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742205_1381, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:32,901 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742205_1381{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:32,901 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63575, dest: /127.0.0.1:60696, bytes: 592, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0031_r_000000_0_704706670_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742205_1381, duration: 10614000
2015-03-13 10:13:32,901 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742205_1381, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:32,901 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742205_1381{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:32,904 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup/_temporary/1/_temporary/attempt_1426266260362_0031_r_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0031_r_000000_0_704706670_1
2015-03-13 10:13:32,912 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup/_temporary/1/_temporary/attempt_1426266260362_0031_r_000000_0	dst=null	perm=null
2015-03-13 10:13:32,918 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup/_temporary/1/_temporary/attempt_1426266260362_0031_r_000000_0	dst=null	perm=null
2015-03-13 10:13:32,919 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup/_temporary/1/task_1426266260362_0031_r_000000	dst=null	perm=null
2015-03-13 10:13:32,922 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup/_temporary/1/_temporary/attempt_1426266260362_0031_r_000000_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup/_temporary/1/task_1426266260362_0031_r_000000	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:13:32,932 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0031_01_000008
2015-03-13 10:13:32,932 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0031	CONTAINERID=container_1426266260362_0031_01_000008
2015-03-13 10:13:32,932 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000008 transitioned from RUNNING to KILLING
2015-03-13 10:13:32,932 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0031_01_000008
2015-03-13 10:13:32,932 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 8 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:13:32,937 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:32,939 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-145669230_1
2015-03-13 10:13:32,943 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0031_01_000008 is : 143
2015-03-13 10:13:32,943 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup/_temporary/1	dst=null	perm=null
2015-03-13 10:13:32,949 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup	dst=null	perm=null
2015-03-13 10:13:32,950 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup	dst=null	perm=null
2015-03-13 10:13:32,951 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup/_temporary/1/task_1426266260362_0031_r_000000	dst=null	perm=null
2015-03-13 10:13:32,953 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup/part-00000	dst=null	perm=null
2015-03-13 10:13:32,955 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000008 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:13:32,955 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000008
2015-03-13 10:13:32,955 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000008
2015-03-13 10:13:32,955 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000008
2015-03-13 10:13:32,955 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0031	CONTAINERID=container_1426266260362_0031_01_000008
2015-03-13 10:13:32,955 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000008 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:13:32,955 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000008
2015-03-13 10:13:32,956 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0031_01_000008 from application application_1426266260362_0031
2015-03-13 10:13:32,956 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:32,956 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0031
2015-03-13 10:13:32,956 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup/_temporary/1/task_1426266260362_0031_r_000000/part-00000	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup/part-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:32,960 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup/_temporary	dst=null	perm=null
2015-03-13 10:13:32,964 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:32,966 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-145669230_1
2015-03-13 10:13:32,968 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:32,972 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-145669230_1
2015-03-13 10:13:32,987 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63565, dest: /127.0.0.1:60696, bytes: 74735, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-145669230_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742204_1380, duration: 5430210000
2015-03-13 10:13:32,987 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742204_1380, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:32,991 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742204_1380{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:13:32,991 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63564, dest: /127.0.0.1:60686, bytes: 74735, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-145669230_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742204_1380, duration: 5434386000
2015-03-13 10:13:32,992 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742204_1380, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:32,993 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63563, dest: /127.0.0.1:60693, bytes: 74735, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-145669230_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742204_1380, duration: 5435913000
2015-03-13 10:13:32,993 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742204_1380, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:32,994 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742204_1380{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:13:32,994 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742204_1380{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:13:32,996 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job_1426266260362_0031_1.jhist is closed by DFSClient_NONMAPREDUCE_-145669230_1
2015-03-13 10:13:32,997 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0031.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:33,000 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0031.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742206_1382{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:13:33,002 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742206_1382 src: /127.0.0.1:63578 dest: /127.0.0.1:60689
2015-03-13 10:13:33,003 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742206_1382 src: /127.0.0.1:63579 dest: /127.0.0.1:60686
2015-03-13 10:13:33,004 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742206_1382 src: /127.0.0.1:63580 dest: /127.0.0.1:60693
2015-03-13 10:13:33,006 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63580, dest: /127.0.0.1:60693, bytes: 454, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-145669230_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742206_1382, duration: 1075000
2015-03-13 10:13:33,006 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742206_1382, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:33,007 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742206_1382{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:33,007 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63579, dest: /127.0.0.1:60686, bytes: 454, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-145669230_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742206_1382, duration: 1574000
2015-03-13 10:13:33,007 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742206_1382, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:33,007 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742206_1382{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:33,008 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63578, dest: /127.0.0.1:60689, bytes: 454, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-145669230_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742206_1382, duration: 2315000
2015-03-13 10:13:33,008 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742206_1382, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:33,008 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742206_1382{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:33,010 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0031.summary_tmp is closed by DFSClient_NONMAPREDUCE_-145669230_1
2015-03-13 10:13:33,013 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0031.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:33,014 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:33,019 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job_1426266260362_0031_1.jhist	dst=null	perm=null
2015-03-13 10:13:33,020 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0031-1426266790841-soberoi-%5B362219F930134AB6824D0C362D17B53B%2F9DE4798541024E2F-1426266812972-6-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:13:33,023 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job_1426266260362_0031_1.jhist	dst=null	perm=null
2015-03-13 10:13:33,024 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0031-1426266790841-soberoi-%5B362219F930134AB6824D0C362D17B53B%2F9DE4798541024E2F-1426266812972-6-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:13:33,025 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job_1426266260362_0031_1.jhist	dst=null	perm=null
2015-03-13 10:13:33,026 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0031-1426266790841-soberoi-%5B362219F930134AB6824D0C362D17B53B%2F9DE4798541024E2F-1426266812972-6-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:33,029 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63581, bytes: 75319, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-145669230_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742204_1380, duration: 312000
2015-03-13 10:13:33,030 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0031-1426266790841-soberoi-%5B362219F930134AB6824D0C362D17B53B%2F9DE4798541024E2F-1426266812972-6-1-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742207_1383{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:13:33,032 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742207_1383 src: /127.0.0.1:63582 dest: /127.0.0.1:60696
2015-03-13 10:13:33,033 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742207_1383 src: /127.0.0.1:63583 dest: /127.0.0.1:60686
2015-03-13 10:13:33,034 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742207_1383 src: /127.0.0.1:63584 dest: /127.0.0.1:60693
2015-03-13 10:13:33,038 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63584, dest: /127.0.0.1:60693, bytes: 74735, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-145669230_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742207_1383, duration: 1831000
2015-03-13 10:13:33,038 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742207_1383, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:33,038 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742207_1383{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:33,038 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63583, dest: /127.0.0.1:60686, bytes: 74735, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-145669230_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742207_1383, duration: 2393000
2015-03-13 10:13:33,039 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742207_1383, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:33,039 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742207_1383{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:33,039 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63582, dest: /127.0.0.1:60696, bytes: 74735, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-145669230_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742207_1383, duration: 3140000
2015-03-13 10:13:33,039 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742207_1383, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:33,040 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742207_1383{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:33,041 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0031-1426266790841-soberoi-%5B362219F930134AB6824D0C362D17B53B%2F9DE4798541024E2F-1426266812972-6-1-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-145669230_1
2015-03-13 10:13:33,043 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0031-1426266790841-soberoi-%5B362219F930134AB6824D0C362D17B53B%2F9DE4798541024E2F-1426266812972-6-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:33,044 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job_1426266260362_0031_1_conf.xml	dst=null	perm=null
2015-03-13 10:13:33,045 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0031_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:13:33,045 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job_1426266260362_0031_1_conf.xml	dst=null	perm=null
2015-03-13 10:13:33,046 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0031_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:13:33,047 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job_1426266260362_0031_1_conf.xml	dst=null	perm=null
2015-03-13 10:13:33,048 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0031_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:33,050 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63581, bytes: 93941, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-145669230_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742203_1379, duration: 245000
2015-03-13 10:13:33,051 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0031_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742208_1384{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:13:33,052 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742208_1384 src: /127.0.0.1:63585 dest: /127.0.0.1:60686
2015-03-13 10:13:33,054 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742208_1384 src: /127.0.0.1:63586 dest: /127.0.0.1:60693
2015-03-13 10:13:33,055 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742208_1384 src: /127.0.0.1:63587 dest: /127.0.0.1:60689
2015-03-13 10:13:33,057 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63587, dest: /127.0.0.1:60689, bytes: 93209, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-145669230_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742208_1384, duration: 1662000
2015-03-13 10:13:33,057 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742208_1384, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:33,058 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742208_1384{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:13:33,058 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63586, dest: /127.0.0.1:60693, bytes: 93209, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-145669230_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742208_1384, duration: 2233000
2015-03-13 10:13:33,058 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742208_1384, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:33,058 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742208_1384{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:13:33,059 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63585, dest: /127.0.0.1:60686, bytes: 93209, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-145669230_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742208_1384, duration: 2895000
2015-03-13 10:13:33,059 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742208_1384, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:33,059 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742208_1384{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:13:33,061 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0031_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-145669230_1
2015-03-13 10:13:33,062 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0031_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:33,064 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0031.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0031.summary	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:33,066 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0031_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0031_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:33,068 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0031-1426266790841-soberoi-%5B362219F930134AB6824D0C362D17B53B%2F9DE4798541024E2F-1426266812972-6-1-SUCCEEDED-default.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0031-1426266790841-soberoi-%5B362219F930134AB6824D0C362D17B53B%2F9DE4798541024E2F-1426266812972-6-1-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:33,074 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0031_000001 State change from RUNNING to FINISHING
2015-03-13 10:13:33,074 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0031
2015-03-13 10:13:33,074 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0031 State change from RUNNING to REMOVING
2015-03-13 10:13:33,074 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0031
2015-03-13 10:13:33,074 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0031 State change from REMOVING to FINISHING
2015-03-13 10:13:33,937 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 8 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:13:33,937 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0031_01_000008
2015-03-13 10:13:33,937 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000008 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:13:33,938 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0031_01_000008 in state: COMPLETED event:FINISHED
2015-03-13 10:13:33,938 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0031	CONTAINERID=container_1426266260362_0031_01_000008
2015-03-13 10:13:33,938 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0031_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:13:33,938 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:13:33,938 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0031_01_000008, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:33,938 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:33,939 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:13:33,939 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0031_000001 released container container_1426266260362_0031_01_000008 on node: host: 10.1.1.144:60715 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:13:34,019 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:34,085 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742199_1375 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60689 
2015-03-13 10:13:34,086 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742200_1376 127.0.0.1:60693 127.0.0.1:60689 127.0.0.1:60686 127.0.0.1:60696 
2015-03-13 10:13:34,086 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742201_1377 127.0.0.1:60689 127.0.0.1:60693 127.0.0.1:60686 
2015-03-13 10:13:34,086 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742202_1378 127.0.0.1:60689 127.0.0.1:60696 127.0.0.1:60686 
2015-03-13 10:13:34,086 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742204_1380 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60696 
2015-03-13 10:13:34,086 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742203_1379 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60693 
2015-03-13 10:13:34,086 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031	dst=null	perm=null
2015-03-13 10:13:34,114 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup	dst=null	perm=null
2015-03-13 10:13:34,115 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup/_temporary
2015-03-13 10:13:34,115 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup/_temporary	dst=null	perm=null
2015-03-13 10:13:34,121 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:13:34,122 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:13:34,122 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:13:34,123 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup	dst=null	perm=null
2015-03-13 10:13:34,124 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup	dst=null	perm=null
2015-03-13 10:13:34,124 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup	dst=null	perm=null
2015-03-13 10:13:34,125 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:13:34,125 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup/part-00000	dst=null	perm=null
2015-03-13 10:13:34,127 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63588, bytes: 600, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742205_1381, duration: 189000
2015-03-13 10:13:34,133 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:13:34,134 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:13:34,134 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:13:34,135 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup	dst=null	perm=null
2015-03-13 10:13:34,136 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup	dst=null	perm=null
2015-03-13 10:13:34,136 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup	dst=null	perm=null
2015-03-13 10:13:34,137 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:13:34,137 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup/part-00000	dst=null	perm=null
2015-03-13 10:13:34,138 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63588, bytes: 600, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742205_1381, duration: 168000
2015-03-13 10:13:34,139 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup
2015-03-13 10:13:34,139 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup	dst=null	perm=null
2015-03-13 10:13:34,140 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup	dst=null	perm=null
2015-03-13 10:13:34,140 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup	dst=null	perm=null
2015-03-13 10:13:34,141 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup	dst=null	perm=null
2015-03-13 10:13:34,141 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup/part-00000	dst=null	perm=null
2015-03-13 10:13:34,142 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup/part-00000	dst=null	perm=null
2015-03-13 10:13:34,144 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63589, bytes: 600, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742205_1381, duration: 180000
2015-03-13 10:13:34,144 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073742199_1375, blk_1073742200_1376, blk_1073742201_1377, blk_1073742203_1379, blk_1073742204_1380]
2015-03-13 10:13:34,144 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073742199_1375, blk_1073742200_1376, blk_1073742201_1377, blk_1073742202_1378]
2015-03-13 10:13:34,145 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs-sparse.txt	dst=null	perm=null
2015-03-13 10:13:34,145 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs-sparse.txt	dst=null	perm=null
2015-03-13 10:13:34,146 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs-sparse.txt	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:13:34,147 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs-sparse.txt. BP-1005356445-10.1.1.144-1426266257849 blk_1073742209_1385{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:13:34,148 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742209_1385 src: /127.0.0.1:63590 dest: /127.0.0.1:60696
2015-03-13 10:13:34,149 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742209_1385 src: /127.0.0.1:63591 dest: /127.0.0.1:60689
2015-03-13 10:13:34,150 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742209_1385 src: /127.0.0.1:63592 dest: /127.0.0.1:60693
2015-03-13 10:13:34,153 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63592, dest: /127.0.0.1:60693, bytes: 83, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742209_1385, duration: 1192000
2015-03-13 10:13:34,153 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742209_1385, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:34,153 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742209_1385{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:34,153 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63591, dest: /127.0.0.1:60689, bytes: 83, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742209_1385, duration: 1404000
2015-03-13 10:13:34,153 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742209_1385, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:34,154 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742209_1385{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:34,154 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63590, dest: /127.0.0.1:60696, bytes: 83, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742209_1385, duration: 2059000
2015-03-13 10:13:34,154 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742209_1385, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:34,154 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742209_1385{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:34,155 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs-sparse.txt is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:13:34,156 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs-sparse.txt	dst=null	perm=null
2015-03-13 10:13:34,156 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs-sparse.txt	dst=null	perm=null
2015-03-13 10:13:34,157 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs-sparse.txt	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:13:34,158 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs-sparse.txt. BP-1005356445-10.1.1.144-1426266257849 blk_1073742210_1386{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:13:34,159 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742210_1386 src: /127.0.0.1:63593 dest: /127.0.0.1:60693
2015-03-13 10:13:34,160 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742210_1386 src: /127.0.0.1:63594 dest: /127.0.0.1:60689
2015-03-13 10:13:34,161 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742210_1386 src: /127.0.0.1:63595 dest: /127.0.0.1:60686
2015-03-13 10:13:34,164 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63595, dest: /127.0.0.1:60686, bytes: 48, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742210_1386, duration: 1269000
2015-03-13 10:13:34,164 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742210_1386, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:34,164 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742210_1386{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:34,165 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63594, dest: /127.0.0.1:60689, bytes: 48, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742210_1386, duration: 1675000
2015-03-13 10:13:34,165 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742210_1386, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:34,165 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742210_1386{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:34,165 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63593, dest: /127.0.0.1:60693, bytes: 48, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742210_1386, duration: 2225000
2015-03-13 10:13:34,165 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742210_1386, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:34,165 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742210_1386{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:34,167 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs-sparse.txt is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:13:34,179 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:13:34,180 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:13:34,181 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:13:34,198 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner	dst=null	perm=null
2015-03-13 10:13:34,199 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting
2015-03-13 10:13:34,199 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  source: Hfs["TextDelimited[['num', 'char' | Integer, String]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs-sparse.txt"]
2015-03-13 10:13:34,200 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  source: Hfs["TextDelimited[['num', 'char' | Integer, String]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs-sparse.txt"]
2015-03-13 10:13:34,200 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  sink: Hfs["TextDelimited[[0:3]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner"]
2015-03-13 10:13:34,200 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  parallel execution is enabled: true
2015-03-13 10:13:34,200 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  starting jobs: 1
2015-03-13 10:13:34,200 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  allocating threads: 1
2015-03-13 10:13:34,201 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (1/1) ...edpipesplatform/joininner
2015-03-13 10:13:34,208 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:13:34,216 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:13:34,217 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner	dst=null	perm=null
2015-03-13 10:13:34,217 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:13:34,218 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:13:34,220 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 32
2015-03-13 10:13:34,220 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032	dst=null	perm=null
2015-03-13 10:13:34,221 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032	dst=null	perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:13:34,222 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032	dst=null	perm=soberoi:supergroup:rwx------
2015-03-13 10:13:34,223 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.jar	dst=null	perm=null
2015-03-13 10:13:34,224 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:13:34,225 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073742211_1387{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:13:34,227 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742211_1387 src: /127.0.0.1:63597 dest: /127.0.0.1:60693
2015-03-13 10:13:34,228 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742211_1387 src: /127.0.0.1:63598 dest: /127.0.0.1:60689
2015-03-13 10:13:34,229 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742211_1387 src: /127.0.0.1:63599 dest: /127.0.0.1:60686
2015-03-13 10:13:34,233 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63599, dest: /127.0.0.1:60686, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742211_1387, duration: 1947000
2015-03-13 10:13:34,233 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742211_1387, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:34,233 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742211_1387{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:34,233 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63598, dest: /127.0.0.1:60689, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742211_1387, duration: 2724000
2015-03-13 10:13:34,233 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742211_1387, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:34,234 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742211_1387{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:34,234 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63597, dest: /127.0.0.1:60693, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742211_1387, duration: 3234000
2015-03-13 10:13:34,234 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742211_1387, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:34,235 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742211_1387{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:34,236 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:13:34,236 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.jar
2015-03-13 10:13:34,236 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.jar	dst=null	perm=null
2015-03-13 10:13:34,237 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:13:34,238 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:13:34,239 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:13:34,239 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:13:34,240 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:13:34,240 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:13:34,241 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:13:34,241 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:13:34,242 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:13:34,242 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:13:34,243 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs-sparse.txt	dst=null	perm=null
2015-03-13 10:13:34,244 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:13:34,244 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs-sparse.txt	dst=null	perm=null
2015-03-13 10:13:34,246 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:13:34,247 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:13:34,247 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.split
2015-03-13 10:13:34,248 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.split	dst=null	perm=null
2015-03-13 10:13:34,249 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073742212_1388{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:13:34,250 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742212_1388 src: /127.0.0.1:63600 dest: /127.0.0.1:60693
2015-03-13 10:13:34,251 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742212_1388 src: /127.0.0.1:63601 dest: /127.0.0.1:60686
2015-03-13 10:13:34,252 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742212_1388 src: /127.0.0.1:63602 dest: /127.0.0.1:60696
2015-03-13 10:13:34,253 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742212_1388 src: /127.0.0.1:63603 dest: /127.0.0.1:60689
2015-03-13 10:13:34,255 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63603, dest: /127.0.0.1:60689, bytes: 1807, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742212_1388, duration: 1599000
2015-03-13 10:13:34,256 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742212_1388, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:34,256 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742212_1388{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:13:34,256 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63602, dest: /127.0.0.1:60696, bytes: 1807, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742212_1388, duration: 1794000
2015-03-13 10:13:34,256 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742212_1388, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:34,256 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742212_1388{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:13:34,257 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63601, dest: /127.0.0.1:60686, bytes: 1807, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742212_1388, duration: 2673000
2015-03-13 10:13:34,257 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742212_1388, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:34,257 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742212_1388{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:13:34,257 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63600, dest: /127.0.0.1:60693, bytes: 1807, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742212_1388, duration: 3055000
2015-03-13 10:13:34,258 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742212_1388, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:34,258 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742212_1388{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:13:34,259 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:13:34,261 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:13:34,262 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:13:34,263 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073742213_1389{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:13:34,264 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742213_1389 src: /127.0.0.1:63604 dest: /127.0.0.1:60689
2015-03-13 10:13:34,265 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742213_1389 src: /127.0.0.1:63605 dest: /127.0.0.1:60696
2015-03-13 10:13:34,266 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742213_1389 src: /127.0.0.1:63606 dest: /127.0.0.1:60693
2015-03-13 10:13:34,268 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63606, dest: /127.0.0.1:60693, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742213_1389, duration: 949000
2015-03-13 10:13:34,268 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742213_1389, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:34,269 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742213_1389{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:34,269 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63605, dest: /127.0.0.1:60696, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742213_1389, duration: 1178000
2015-03-13 10:13:34,269 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742213_1389, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:34,269 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742213_1389{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:34,270 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63604, dest: /127.0.0.1:60689, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742213_1389, duration: 1955000
2015-03-13 10:13:34,270 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742213_1389, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:34,270 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742213_1389{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:34,271 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:13:34,271 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:13:34,272 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:13:34,274 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:13:34,274 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:13:34,275 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:13:34,275 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:13:34,285 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742214_1390{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:13:34,286 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742214_1390 src: /127.0.0.1:63607 dest: /127.0.0.1:60696
2015-03-13 10:13:34,287 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742214_1390 src: /127.0.0.1:63608 dest: /127.0.0.1:60686
2015-03-13 10:13:34,288 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742214_1390 src: /127.0.0.1:63609 dest: /127.0.0.1:60689
2015-03-13 10:13:34,291 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63609, dest: /127.0.0.1:60689, bytes: 98280, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742214_1390, duration: 1564000
2015-03-13 10:13:34,291 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742214_1390, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:34,291 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742214_1390{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:13:34,292 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63608, dest: /127.0.0.1:60686, bytes: 98280, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742214_1390, duration: 2081000
2015-03-13 10:13:34,292 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742214_1390, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:34,292 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742214_1390{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:13:34,292 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63607, dest: /127.0.0.1:60696, bytes: 98280, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742214_1390, duration: 2689000
2015-03-13 10:13:34,292 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742214_1390, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:34,293 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742214_1390{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:13:34,294 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:13:34,294 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0032
2015-03-13 10:13:34,295 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032	dst=null	perm=null
2015-03-13 10:13:34,296 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.xml	dst=null	perm=null
2015-03-13 10:13:34,296 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.xml	dst=null	perm=null
2015-03-13 10:13:34,297 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.jar	dst=null	perm=null
2015-03-13 10:13:34,297 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.jar	dst=null	perm=null
2015-03-13 10:13:34,298 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.split	dst=null	perm=null
2015-03-13 10:13:34,298 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.split	dst=null	perm=null
2015-03-13 10:13:34,299 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:13:34,299 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:13:34,301 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:13:34,301 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:13:34,302 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:13:34,302 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:13:34,303 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:13:34,304 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:13:34,305 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 32 submitted by user soberoi
2015-03-13 10:13:34,305 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0032
2015-03-13 10:13:34,305 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	IP=10.1.1.144	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1426266260362_0032
2015-03-13 10:13:34,305 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0032
2015-03-13 10:13:34,305 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0032 State change from NEW to NEW_SAVING
2015-03-13 10:13:34,305 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0032 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:13:34,305 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0032_000001
2015-03-13 10:13:34,306 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0032_000001 State change from NEW to SUBMITTED
2015-03-13 10:13:34,306 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0032 from user: soberoi activated in queue: default
2015-03-13 10:13:34,306 INFO  capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0032 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:13:34,306 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0032 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:13:34,306 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0032_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:13:34,306 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0032 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:13:34,306 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0032_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:13:34,306 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0032 State change from SUBMITTED to ACCEPTED
2015-03-13 10:13:34,308 INFO  mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0032/
2015-03-13 10:13:34,308 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1426266260362_0032
2015-03-13 10:13:34,308 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0032/
2015-03-13 10:13:34,676 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742199_1375 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir2/blk_1073742199 for deletion
2015-03-13 10:13:34,676 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742200_1376 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742200 for deletion
2015-03-13 10:13:34,676 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742201_1377 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir2/blk_1073742201 for deletion
2015-03-13 10:13:34,677 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742202_1378 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742202 for deletion
2015-03-13 10:13:34,677 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742199_1375 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir2/blk_1073742199
2015-03-13 10:13:34,677 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742200_1376 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742200
2015-03-13 10:13:34,677 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742201_1377 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir2/blk_1073742201
2015-03-13 10:13:34,677 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742202_1378 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742202
2015-03-13 10:13:34,728 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0032_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:13:34,728 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0032	CONTAINERID=container_1426266260362_0032_01_000001
2015-03-13 10:13:34,729 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0032_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:13:34,729 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0032 container=Container: [ContainerId: container_1426266260362_0032_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0032_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:34,729 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:13:34,729 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0032_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:13:34,729 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:34,730 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0032 AttemptId: appattempt_1426266260362_0032_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0032_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ]
2015-03-13 10:13:34,730 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0032_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:13:34,730 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0032_000001
2015-03-13 10:13:34,731 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0032_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:13:34,731 INFO  amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0032_000001
2015-03-13 10:13:34,732 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0032_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] for AM appattempt_1426266260362_0032_000001
2015-03-13 10:13:34,732 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0032_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-03-13 10:13:34,734 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0032_000001 (auth:SIMPLE)
2015-03-13 10:13:34,735 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0032_01_000001 by user soberoi
2015-03-13 10:13:34,735 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0032
2015-03-13 10:13:34,735 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0032	CONTAINERID=container_1426266260362_0032_01_000001
2015-03-13 10:13:34,735 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0032 transitioned from NEW to INITING
2015-03-13 10:13:34,735 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0032_01_000001 to application application_1426266260362_0032
2015-03-13 10:13:34,736 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0032 transitioned from INITING to RUNNING
2015-03-13 10:13:34,736 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0032_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] for AM appattempt_1426266260362_0032_000001
2015-03-13 10:13:34,736 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0032_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:13:34,736 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:13:34,736 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0032
2015-03-13 10:13:34,736 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:13:34,736 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:13:34,736 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:13:34,737 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:13:34,737 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0032_01_000001
2015-03-13 10:13:34,745 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1426266260362_0032_01_000001.tokens. Credentials list: 
2015-03-13 10:13:34,759 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:13:34,826 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1426266260362_0032_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000001.tokens
2015-03-13 10:13:34,826 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0032 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0032
2015-03-13 10:13:34,882 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.jar	dst=null	perm=null
2015-03-13 10:13:34,883 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.jar	dst=null	perm=null
2015-03-13 10:13:34,884 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.jar	dst=null	perm=null
2015-03-13 10:13:34,890 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63613, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-202646282_17113, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742211_1387, duration: 518000
2015-03-13 10:13:34,900 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742199_1375 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742199 for deletion
2015-03-13 10:13:34,900 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742200_1376 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742200 for deletion
2015-03-13 10:13:34,900 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742201_1377 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742201 for deletion
2015-03-13 10:13:34,900 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742203_1379 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742203 for deletion
2015-03-13 10:13:34,901 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742199_1375 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742199
2015-03-13 10:13:34,901 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742204_1380 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742204 for deletion
2015-03-13 10:13:34,901 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742201_1377 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742201
2015-03-13 10:13:34,901 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742200_1376 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742200
2015-03-13 10:13:34,901 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742204_1380 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742204
2015-03-13 10:13:34,901 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742203_1379 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742203
2015-03-13 10:13:34,909 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:13:34,926 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:13:34,926 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:13:34,927 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:13:34,932 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63588, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-202646282_17113, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742213_1389, duration: 173000
2015-03-13 10:13:34,944 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:13:34,960 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.split	dst=null	perm=null
2015-03-13 10:13:34,961 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.split	dst=null	perm=null
2015-03-13 10:13:34,962 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.split	dst=null	perm=null
2015-03-13 10:13:34,967 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63589, bytes: 1823, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-202646282_17113, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742212_1388, duration: 191000
2015-03-13 10:13:34,979 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:13:34,997 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.xml	dst=null	perm=null
2015-03-13 10:13:34,998 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.xml	dst=null	perm=null
2015-03-13 10:13:34,999 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.xml	dst=null	perm=null
2015-03-13 10:13:35,005 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63588, bytes: 99048, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-202646282_17113, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742214_1390, duration: 264000
2015-03-13 10:13:35,019 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:13:35,019 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:13:35,020 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:35,047 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:13:35,047 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:35,112 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000001/default_container_executor.sh]
2015-03-13 10:13:35,487 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742208_1384
2015-03-13 10:13:35,488 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742214_1390
2015-03-13 10:13:35,488 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742210_1386
2015-03-13 10:13:35,693 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742211_1387
2015-03-13 10:13:35,693 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742206_1382
2015-03-13 10:13:35,693 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742205_1381
2015-03-13 10:13:35,694 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742212_1388
2015-03-13 10:13:35,694 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742209_1385
2015-03-13 10:13:35,694 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742213_1389
2015-03-13 10:13:35,733 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:35,733 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0032_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:13:36,024 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:36,644 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742212_1388
2015-03-13 10:13:36,644 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742214_1390
2015-03-13 10:13:36,645 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742204_1380
2015-03-13 10:13:36,683 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:13:36,695 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742208_1384
2015-03-13 10:13:36,696 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742206_1382
2015-03-13 10:13:36,696 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742210_1386
2015-03-13 10:13:36,697 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742211_1387
2015-03-13 10:13:36,697 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742213_1389
2015-03-13 10:13:36,697 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742212_1388
2015-03-13 10:13:36,704 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/COMMIT_STARTED	dst=null	perm=null
2015-03-13 10:13:36,705 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/COMMIT_SUCCESS	dst=null	perm=null
2015-03-13 10:13:36,706 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/COMMIT_FAIL	dst=null	perm=null
2015-03-13 10:13:36,737 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:36,755 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032	dst=null	perm=null
2015-03-13 10:13:36,756 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:13:36,757 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:13:36,849 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742211_1387
2015-03-13 10:13:36,850 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742210_1386
2015-03-13 10:13:36,850 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742205_1381
2015-03-13 10:13:36,850 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742207_1383
2015-03-13 10:13:36,850 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742206_1382
2015-03-13 10:13:36,851 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742208_1384
2015-03-13 10:13:36,898 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742207_1383
2015-03-13 10:13:36,898 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742209_1385
2015-03-13 10:13:37,025 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:37,037 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:13:37,043 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:13:37,101 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63615, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1939842295_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742213_1389, duration: 125000
2015-03-13 10:13:37,147 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60686 to replicate blk_1073742211_1387 to datanode(s) 127.0.0.1:60696
2015-03-13 10:13:37,147 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073742199_1375, blk_1073742200_1376, blk_1073742201_1377, blk_1073742202_1378, blk_1073742203_1379, blk_1073742204_1380]
2015-03-13 10:13:37,147 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073742199_1375, blk_1073742200_1376, blk_1073742202_1378, blk_1073742203_1379, blk_1073742204_1380]
2015-03-13 10:13:37,244 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742212_1388
2015-03-13 10:13:37,244 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742205_1381
2015-03-13 10:13:37,245 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742207_1383
2015-03-13 10:13:37,245 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742204_1380
2015-03-13 10:13:37,246 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742214_1390
2015-03-13 10:13:37,246 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742209_1385
2015-03-13 10:13:37,246 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742213_1389
2015-03-13 10:13:37,703 INFO  datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-1907321454-10.1.1.144-60686-1426266259166, infoPort=60687, ipcPort=60688, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073742211_1387 to 127.0.0.1:60696 
2015-03-13 10:13:37,703 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742199_1375 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742199 for deletion
2015-03-13 10:13:37,704 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742200_1376 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742200 for deletion
2015-03-13 10:13:37,704 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742201_1377 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742201 for deletion
2015-03-13 10:13:37,704 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742202_1378 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742202 for deletion
2015-03-13 10:13:37,704 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742199_1375 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742199
2015-03-13 10:13:37,704 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742203_1379 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742203 for deletion
2015-03-13 10:13:37,704 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742204_1380 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742204 for deletion
2015-03-13 10:13:37,704 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742201_1377 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742201
2015-03-13 10:13:37,704 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742203_1379 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742203
2015-03-13 10:13:37,705 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742200_1376 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742200
2015-03-13 10:13:37,705 INFO  datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073742211_1387 (numBytes=254067) to /127.0.0.1:60696
2015-03-13 10:13:37,705 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742202_1378 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742202
2015-03-13 10:13:37,705 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742204_1380 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742204
2015-03-13 10:13:37,705 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742211_1387 src: /127.0.0.1:63618 dest: /127.0.0.1:60696
2015-03-13 10:13:37,707 INFO  datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073742211_1387 src: /127.0.0.1:63618 dest: /127.0.0.1:60696 of size 254067
2015-03-13 10:13:37,708 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742211_1387 size 254067
2015-03-13 10:13:37,741 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:37,901 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0032_000001 (auth:SIMPLE)
2015-03-13 10:13:37,902 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0032_000001
2015-03-13 10:13:37,902 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi	IP=10.1.1.144	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1426266260362_0032	APPATTEMPTID=appattempt_1426266260362_0032_000001
2015-03-13 10:13:37,902 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0032_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:13:37,903 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0032 State change from ACCEPTED to RUNNING
2015-03-13 10:13:37,920 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job_1426266260362_0032_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:37,923 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:13:37,982 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job_1426266260362_0032_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:38,025 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:38,098 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job_1426266260362_0032_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742215_1391{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:13:38,100 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742199_1375 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742199 for deletion
2015-03-13 10:13:38,100 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742200_1376 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742200 for deletion
2015-03-13 10:13:38,100 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742202_1378 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742202 for deletion
2015-03-13 10:13:38,100 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742203_1379 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742203 for deletion
2015-03-13 10:13:38,100 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742204_1380 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742204 for deletion
2015-03-13 10:13:38,100 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742199_1375 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742199
2015-03-13 10:13:38,101 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742200_1376 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742200
2015-03-13 10:13:38,101 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742202_1378 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742202
2015-03-13 10:13:38,101 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742203_1379 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742203
2015-03-13 10:13:38,101 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742204_1380 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742204
2015-03-13 10:13:38,140 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742215_1391 src: /127.0.0.1:63622 dest: /127.0.0.1:60696
2015-03-13 10:13:38,142 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742215_1391 src: /127.0.0.1:63623 dest: /127.0.0.1:60689
2015-03-13 10:13:38,143 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742215_1391 src: /127.0.0.1:63624 dest: /127.0.0.1:60693
2015-03-13 10:13:38,150 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63624, dest: /127.0.0.1:60693, bytes: 91086, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1939842295_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742215_1391, duration: 5709000
2015-03-13 10:13:38,150 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742215_1391, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:38,151 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742215_1391{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:38,151 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63623, dest: /127.0.0.1:60689, bytes: 91086, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1939842295_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742215_1391, duration: 6608000
2015-03-13 10:13:38,151 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742215_1391, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:38,152 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742215_1391{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:38,152 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63622, dest: /127.0.0.1:60696, bytes: 91086, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1939842295_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742215_1391, duration: 7739000
2015-03-13 10:13:38,152 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742215_1391, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:38,153 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742215_1391{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:38,156 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job_1426266260362_0032_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-1939842295_1
2015-03-13 10:13:38,743 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:38,957 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0032_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:13:38,957 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0032	CONTAINERID=container_1426266260362_0032_01_000002
2015-03-13 10:13:38,957 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0032_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:13:38,957 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0032 container=Container: [ContainerId: container_1426266260362_0032_01_000002, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0032_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:38,957 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:13:38,958 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:38,958 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0032_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:13:38,958 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0032	CONTAINERID=container_1426266260362_0032_01_000003
2015-03-13 10:13:38,958 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0032_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:13:38,959 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0032 container=Container: [ContainerId: container_1426266260362_0032_01_000003, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0032_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:38,959 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:13:38,959 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:38,959 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0032_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:13:38,960 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0032	CONTAINERID=container_1426266260362_0032_01_000004
2015-03-13 10:13:38,960 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0032_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:13:38,960 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0032 container=Container: [ContainerId: container_1426266260362_0032_01_000004, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0032_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:38,960 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:13:38,960 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:38,960 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0032_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:13:38,960 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0032	CONTAINERID=container_1426266260362_0032_01_000005
2015-03-13 10:13:38,960 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0032_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:13:38,961 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0032 container=Container: [ContainerId: container_1426266260362_0032_01_000005, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0032_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:38,961 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:13:38,961 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:39,031 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:39,032 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0032_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:13:39,032 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0032	CONTAINERID=container_1426266260362_0032_01_000006
2015-03-13 10:13:39,032 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0032_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:13:39,032 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0032 container=Container: [ContainerId: container_1426266260362_0032_01_000006, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0032_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:39,032 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7
2015-03-13 10:13:39,033 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:39,116 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0031_01_000001 succeeded 
2015-03-13 10:13:39,116 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:13:39,116 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0031_01_000001
2015-03-13 10:13:39,123 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000001
2015-03-13 10:13:39,123 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000001
2015-03-13 10:13:39,124 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000001
2015-03-13 10:13:39,124 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0031	CONTAINERID=container_1426266260362_0031_01_000001
2015-03-13 10:13:39,124 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000001
2015-03-13 10:13:39,124 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:13:39,124 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0031_01_000001 from application application_1426266260362_0031
2015-03-13 10:13:39,124 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:39,124 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0031
2015-03-13 10:13:39,748 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:39,933 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0032_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:13:39,933 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0032_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:13:39,934 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0032_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:13:39,934 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0032_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:13:39,934 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0032_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:13:39,963 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.jar	dst=null	perm=null
2015-03-13 10:13:39,964 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.jar	dst=null	perm=null
2015-03-13 10:13:39,972 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.xml	dst=null	perm=null
2015-03-13 10:13:39,973 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.xml	dst=null	perm=null
2015-03-13 10:13:39,975 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:13:39,976 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:13:39,981 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:13:39,983 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:13:39,984 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:13:39,985 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:13:40,045 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:13:40,045 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0031_01_000001
2015-03-13 10:13:40,046 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:13:40,046 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0031_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:13:40,046 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0031_000001
2015-03-13 10:13:40,046 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0031	CONTAINERID=container_1426266260362_0031_01_000001
2015-03-13 10:13:40,046 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0031_000001 State change from FINISHING to FINISHED
2015-03-13 10:13:40,046 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0031 State change from FINISHING to FINISHED
2015-03-13 10:13:40,046 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1426266260362_0031
2015-03-13 10:13:40,047 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0031,name=[362219F930134AB6824D0C362D17B53B/9DE4798541024E2FA2C199E3C3EC73F2] cogrouping/(1/1) ...platform/joinsintocogroup,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0031/jobhistory/job/job_1426266260362_0031,appMasterHost=Edinburgh.local,startTime=1426266790841,finishTime=1426266813074,finalStatus=SUCCEEDED
2015-03-13 10:13:40,046 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0031_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:13:40,047 INFO  amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0031_000001
2015-03-13 10:13:40,047 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:7168, vCores:6> numContainers=6 user=soberoi user-resources=<memory:7168, vCores:6>
2015-03-13 10:13:40,047 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0031_01_000001, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:40,047 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:40,047 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6
2015-03-13 10:13:40,047 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0031_000001 released container container_1426266260362_0031_01_000001 on node: host: 10.1.1.144:60719 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:13:40,047 INFO  capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0031_000001 is done. finalState=FINISHED
2015-03-13 10:13:40,047 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0031 requests cleared
2015-03-13 10:13:40,048 INFO  capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0031 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:13:40,048 INFO  capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0031 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:13:40,049 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0031_000001 (auth:SIMPLE)
2015-03-13 10:13:40,050 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0031_01_000001
2015-03-13 10:13:40,062 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0032_000001 (auth:SIMPLE)
2015-03-13 10:13:40,062 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0032_000001 (auth:SIMPLE)
2015-03-13 10:13:40,065 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0032_01_000004 by user soberoi
2015-03-13 10:13:40,065 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0032
2015-03-13 10:13:40,065 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0032	CONTAINERID=container_1426266260362_0032_01_000004
2015-03-13 10:13:40,065 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0032_01_000005 by user soberoi
2015-03-13 10:13:40,066 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0032_01_000002 by user soberoi
2015-03-13 10:13:40,065 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0032_01_000006 by user soberoi
2015-03-13 10:13:40,066 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0032_01_000003 by user soberoi
2015-03-13 10:13:40,066 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0032 transitioned from NEW to INITING
2015-03-13 10:13:40,066 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0032_01_000004 to application application_1426266260362_0032
2015-03-13 10:13:40,066 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0032	CONTAINERID=container_1426266260362_0032_01_000003
2015-03-13 10:13:40,066 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0032	CONTAINERID=container_1426266260362_0032_01_000002
2015-03-13 10:13:40,066 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0032	CONTAINERID=container_1426266260362_0032_01_000005
2015-03-13 10:13:40,066 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0032_01_000005 to application application_1426266260362_0032
2015-03-13 10:13:40,067 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0032_01_000002 to application application_1426266260362_0032
2015-03-13 10:13:40,067 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0032_01_000003 to application application_1426266260362_0032
2015-03-13 10:13:40,068 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0032 transitioned from INITING to RUNNING
2015-03-13 10:13:40,066 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0032
2015-03-13 10:13:40,068 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:13:40,068 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0032	CONTAINERID=container_1426266260362_0032_01_000006
2015-03-13 10:13:40,068 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:13:40,068 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:13:40,068 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:13:40,068 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0032
2015-03-13 10:13:40,068 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0032
2015-03-13 10:13:40,069 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:13:40,069 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0032
2015-03-13 10:13:40,069 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:13:40,069 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0032 transitioned from NEW to INITING
2015-03-13 10:13:40,069 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0032_01_000006 to application application_1426266260362_0032
2015-03-13 10:13:40,069 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:13:40,069 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0032 transitioned from INITING to RUNNING
2015-03-13 10:13:40,069 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0032
2015-03-13 10:13:40,069 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0032
2015-03-13 10:13:40,069 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:13:40,069 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:13:40,069 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0032
2015-03-13 10:13:40,069 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0032
2015-03-13 10:13:40,070 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0032
2015-03-13 10:13:40,070 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0032
2015-03-13 10:13:40,070 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0032
2015-03-13 10:13:40,070 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:13:40,070 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0032
2015-03-13 10:13:40,070 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0032
2015-03-13 10:13:40,070 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0032
2015-03-13 10:13:40,070 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:13:40,070 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0032
2015-03-13 10:13:40,070 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0032_01_000004
2015-03-13 10:13:40,070 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:13:40,071 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0032
2015-03-13 10:13:40,071 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:13:40,071 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:13:40,071 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0032_01_000006
2015-03-13 10:13:40,071 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0032_01_000005
2015-03-13 10:13:40,073 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0032_01_000002
2015-03-13 10:13:40,074 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0032_01_000003
2015-03-13 10:13:40,093 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426266260362_0032_01_000004.tokens. Credentials list: 
2015-03-13 10:13:40,094 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1426266260362_0032_01_000002.tokens. Credentials list: 
2015-03-13 10:13:40,094 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0032_01_000006.tokens. Credentials list: 
2015-03-13 10:13:40,094 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426266260362_0032_01_000003.tokens. Credentials list: 
2015-03-13 10:13:40,095 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426266260362_0032_01_000005.tokens. Credentials list: 
2015-03-13 10:13:40,111 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:13:40,111 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:13:40,198 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426266260362_0032_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000004.tokens
2015-03-13 10:13:40,198 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0032_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000006.tokens
2015-03-13 10:13:40,198 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0032 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0032
2015-03-13 10:13:40,198 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0032 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0032
2015-03-13 10:13:40,269 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.jar	dst=null	perm=null
2015-03-13 10:13:40,269 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.jar	dst=null	perm=null
2015-03-13 10:13:40,270 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.jar	dst=null	perm=null
2015-03-13 10:13:40,270 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.jar	dst=null	perm=null
2015-03-13 10:13:40,271 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.jar	dst=null	perm=null
2015-03-13 10:13:40,271 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.jar	dst=null	perm=null
2015-03-13 10:13:40,280 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63632, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1021072591_17259, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742211_1387, duration: 490000
2015-03-13 10:13:40,280 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63633, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_340007280_17260, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742211_1387, duration: 560000
2015-03-13 10:13:40,301 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:13:40,301 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:13:40,321 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.xml	dst=null	perm=null
2015-03-13 10:13:40,322 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.xml	dst=null	perm=null
2015-03-13 10:13:40,322 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.xml	dst=null	perm=null
2015-03-13 10:13:40,322 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.xml	dst=null	perm=null
2015-03-13 10:13:40,323 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.xml	dst=null	perm=null
2015-03-13 10:13:40,323 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.xml	dst=null	perm=null
2015-03-13 10:13:40,331 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63633, bytes: 99048, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1021072591_17259, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742214_1390, duration: 294000
2015-03-13 10:13:40,331 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63634, bytes: 99048, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_340007280_17260, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742214_1390, duration: 265000
2015-03-13 10:13:40,349 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:13:40,349 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:13:40,349 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:13:40,349 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:13:40,349 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:13:40,350 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:13:40,349 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:13:40,397 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:13:40,397 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:40,397 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:13:40,397 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:40,403 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:13:40,404 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:40,405 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:13:40,405 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:13:40,405 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:40,406 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:40,545 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000006/default_container_executor.sh]
2015-03-13 10:13:40,545 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000002/default_container_executor.sh]
2015-03-13 10:13:40,553 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000004/default_container_executor.sh]
2015-03-13 10:13:40,554 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000003/default_container_executor.sh]
2015-03-13 10:13:40,555 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000005/default_container_executor.sh]
2015-03-13 10:13:40,700 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742215_1391
2015-03-13 10:13:40,748 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:40,749 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0031 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:13:40,749 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0031
2015-03-13 10:13:40,749 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0031
2015-03-13 10:13:40,749 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0031 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:13:40,749 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0031, with delay of 10800 seconds
2015-03-13 10:13:40,750 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0031
2015-03-13 10:13:40,750 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0031
2015-03-13 10:13:40,750 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0031
2015-03-13 10:13:40,951 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:13:40,964 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:40,964 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:40,965 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:40,965 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:40,965 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0031 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:13:40,965 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0032_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:13:40,965 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0032_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:13:40,965 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0031
2015-03-13 10:13:40,965 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0031
2015-03-13 10:13:40,966 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0031
2015-03-13 10:13:40,966 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0031 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:13:40,966 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0031, with delay of 10800 seconds
2015-03-13 10:13:40,966 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0031
2015-03-13 10:13:40,966 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0031
2015-03-13 10:13:40,965 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0032_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:13:40,966 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0032_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:13:41,046 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:41,046 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0031 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:13:41,046 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0032_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:13:41,047 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0031
2015-03-13 10:13:41,047 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0031
2015-03-13 10:13:41,047 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0031
2015-03-13 10:13:41,047 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0031
2015-03-13 10:13:41,047 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0031 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:13:41,047 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0031, with delay of 10800 seconds
2015-03-13 10:13:41,047 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0031
2015-03-13 10:13:41,379 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:13:41,505 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426266260362_0032_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000005.tokens
2015-03-13 10:13:41,505 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0032 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0032
2015-03-13 10:13:41,602 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:13:41,721 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426266260362_0032_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000003.tokens
2015-03-13 10:13:41,721 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0032 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0032
2015-03-13 10:13:41,750 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:41,815 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:13:41,904 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742215_1391
2015-03-13 10:13:41,928 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1426266260362_0032_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000002.tokens
2015-03-13 10:13:41,929 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0032 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0032
2015-03-13 10:13:41,966 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:41,966 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:41,966 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:41,966 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:42,047 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:42,251 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742215_1391
2015-03-13 10:13:42,453 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742211_1387
2015-03-13 10:13:42,755 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:42,968 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:42,968 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:42,968 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:42,969 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:43,053 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:43,757 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:43,969 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:43,969 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:43,969 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:43,970 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:44,055 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:44,761 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:44,971 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:44,971 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:44,971 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:44,971 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:45,060 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:45,764 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:45,972 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:45,972 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:45,972 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:45,972 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:46,064 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:46,766 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:46,975 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:46,975 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:46,976 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:46,976 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:47,065 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:47,771 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:47,981 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:47,981 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:47,981 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:47,981 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:48,069 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:48,288 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.split	dst=null	perm=null
2015-03-13 10:13:48,296 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.split	dst=null	perm=null
2015-03-13 10:13:48,350 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.split	dst=null	perm=null
2015-03-13 10:13:48,422 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.split	dst=null	perm=null
2015-03-13 10:13:48,488 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63648, bytes: 1823, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0032_m_000000_0_-966470680_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742212_1388, duration: 151000
2015-03-13 10:13:48,529 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63647, bytes: 1823, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0032_m_000001_0_2026127633_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742212_1388, duration: 161000
2015-03-13 10:13:48,540 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63649, bytes: 791, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0032_m_000004_0_-1592466482_1, offset: 1024, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742212_1388, duration: 162000
2015-03-13 10:13:48,545 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.split	dst=null	perm=null
2015-03-13 10:13:48,583 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63651, bytes: 1307, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0032_m_000002_0_-2132934942_1, offset: 512, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742212_1388, duration: 149000
2015-03-13 10:13:48,630 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs-sparse.txt	dst=null	perm=null
2015-03-13 10:13:48,633 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63653, bytes: 87, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0032_m_000001_0_2026127633_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742209_1385, duration: 158000
2015-03-13 10:13:48,648 INFO  namenode.FSEditLog (FSEditLog.java:printStatistics(663)) - Number of transactions: 3300 Total time for transactions(ms): 140 Number of transactions batched in Syncs: 14 Number of syncs: 1881 SyncTimes(ms): 536 435 
2015-03-13 10:13:48,649 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/_temporary/attempt_1426266260362_0032_m_000001_0/part-00001	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:48,649 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs-sparse.txt	dst=null	perm=null
2015-03-13 10:13:48,666 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/_temporary/attempt_1426266260362_0032_m_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:48,666 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63652, bytes: 791, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0032_m_000003_0_-1123006855_1, offset: 1024, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742212_1388, duration: 162000
2015-03-13 10:13:48,679 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs-sparse.txt	dst=null	perm=null
2015-03-13 10:13:48,682 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63649, bytes: 87, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0032_m_000004_0_-1592466482_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742209_1385, duration: 147000
2015-03-13 10:13:48,701 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/_temporary/attempt_1426266260362_0032_m_000004_0/part-00004	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:48,702 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs-sparse.txt	dst=null	perm=null
2015-03-13 10:13:48,707 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63654, bytes: 87, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0032_m_000002_0_-2132934942_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742209_1385, duration: 141000
2015-03-13 10:13:48,724 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/_temporary/attempt_1426266260362_0032_m_000002_0/part-00002	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:48,773 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:48,825 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs-sparse.txt	dst=null	perm=null
2015-03-13 10:13:48,829 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63655, bytes: 87, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0032_m_000003_0_-1123006855_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742209_1385, duration: 172000
2015-03-13 10:13:48,847 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/_temporary/attempt_1426266260362_0032_m_000003_0/part-00003	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:48,987 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:48,987 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:48,987 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:48,987 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:49,070 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:49,084 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs-sparse.txt	dst=null	perm=null
2015-03-13 10:13:49,086 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs-sparse.txt	dst=null	perm=null
2015-03-13 10:13:49,093 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs-sparse.txt	dst=null	perm=null
2015-03-13 10:13:49,094 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs-sparse.txt	dst=null	perm=null
2015-03-13 10:13:49,096 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs-sparse.txt	dst=null	perm=null
2015-03-13 10:13:49,098 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs-sparse.txt	dst=null	perm=null
2015-03-13 10:13:49,103 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63657, bytes: 52, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0032_m_000001_0_2026127633_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742210_1386, duration: 148000
2015-03-13 10:13:49,104 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63656, bytes: 52, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0032_m_000000_0_-966470680_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742210_1386, duration: 128000
2015-03-13 10:13:49,115 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63648, bytes: 87, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0032_m_000000_0_-966470680_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742209_1385, duration: 160000
2015-03-13 10:13:49,146 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/_temporary/attempt_1426266260362_0032_m_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073742216_1392{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:13:49,147 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/_temporary/attempt_1426266260362_0032_m_000001_0/part-00001. BP-1005356445-10.1.1.144-1426266257849 blk_1073742217_1393{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:13:49,156 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs-sparse.txt	dst=null	perm=null
2015-03-13 10:13:49,165 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs-sparse.txt	dst=null	perm=null
2015-03-13 10:13:49,169 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs-sparse.txt	dst=null	perm=null
2015-03-13 10:13:49,205 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs-sparse.txt	dst=null	perm=null
2015-03-13 10:13:49,208 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs-sparse.txt	dst=null	perm=null
2015-03-13 10:13:49,208 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742216_1392 src: /127.0.0.1:63658 dest: /127.0.0.1:60696
2015-03-13 10:13:49,208 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs-sparse.txt	dst=null	perm=null
2015-03-13 10:13:49,209 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742216_1392 src: /127.0.0.1:63660 dest: /127.0.0.1:60689
2015-03-13 10:13:49,211 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742216_1392 src: /127.0.0.1:63661 dest: /127.0.0.1:60693
2015-03-13 10:13:49,212 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742217_1393 src: /127.0.0.1:63659 dest: /127.0.0.1:60686
2015-03-13 10:13:49,213 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742217_1393 src: /127.0.0.1:63662 dest: /127.0.0.1:60696
2015-03-13 10:13:49,215 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742217_1393 src: /127.0.0.1:63663 dest: /127.0.0.1:60689
2015-03-13 10:13:49,218 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63664, bytes: 52, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0032_m_000004_0_-1592466482_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742210_1386, duration: 160000
2015-03-13 10:13:49,218 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63661, dest: /127.0.0.1:60693, bytes: 120, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0032_m_000000_0_-966470680_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742216_1392, duration: 6277000
2015-03-13 10:13:49,218 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742216_1392, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:49,219 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742216_1392{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:49,219 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63660, dest: /127.0.0.1:60689, bytes: 120, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0032_m_000000_0_-966470680_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742216_1392, duration: 7133000
2015-03-13 10:13:49,219 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742216_1392, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:49,220 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742216_1392{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:49,220 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63658, dest: /127.0.0.1:60696, bytes: 120, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0032_m_000000_0_-966470680_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742216_1392, duration: 8076000
2015-03-13 10:13:49,220 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742216_1392, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:49,221 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742216_1392{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:49,222 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63665, bytes: 52, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0032_m_000002_0_-2132934942_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742210_1386, duration: 140000
2015-03-13 10:13:49,225 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63663, dest: /127.0.0.1:60689, bytes: 30, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0032_m_000001_0_2026127633_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742217_1393, duration: 8659000
2015-03-13 10:13:49,225 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742217_1393, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:49,225 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/_temporary/attempt_1426266260362_0032_m_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0032_m_000000_0_-966470680_1
2015-03-13 10:13:49,226 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742217_1393{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:13:49,226 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63662, dest: /127.0.0.1:60696, bytes: 30, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0032_m_000001_0_2026127633_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742217_1393, duration: 9321000
2015-03-13 10:13:49,226 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742217_1393, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:49,226 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63659, dest: /127.0.0.1:60686, bytes: 30, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0032_m_000001_0_2026127633_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742217_1393, duration: 10028000
2015-03-13 10:13:49,227 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742217_1393{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:13:49,227 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742217_1393, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:49,227 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742217_1393{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:13:49,231 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/_temporary/attempt_1426266260362_0032_m_000001_0/part-00001 is closed by DFSClient_attempt_1426266260362_0032_m_000001_0_2026127633_1
2015-03-13 10:13:49,236 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/_temporary/attempt_1426266260362_0032_m_000000_0	dst=null	perm=null
2015-03-13 10:13:49,240 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/_temporary/attempt_1426266260362_0032_m_000001_0	dst=null	perm=null
2015-03-13 10:13:49,242 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/_temporary/attempt_1426266260362_0032_m_000000_0	dst=null	perm=null
2015-03-13 10:13:49,243 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/task_1426266260362_0032_m_000000	dst=null	perm=null
2015-03-13 10:13:49,246 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/_temporary/attempt_1426266260362_0032_m_000004_0/part-00004 is closed by DFSClient_attempt_1426266260362_0032_m_000004_0_-1592466482_1
2015-03-13 10:13:49,246 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/_temporary/attempt_1426266260362_0032_m_000000_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/task_1426266260362_0032_m_000000	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:13:49,246 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/_temporary/attempt_1426266260362_0032_m_000001_0	dst=null	perm=null
2015-03-13 10:13:49,247 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/task_1426266260362_0032_m_000001	dst=null	perm=null
2015-03-13 10:13:49,251 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/_temporary/attempt_1426266260362_0032_m_000001_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/task_1426266260362_0032_m_000001	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:13:49,266 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/_temporary/attempt_1426266260362_0032_m_000004_0	dst=null	perm=null
2015-03-13 10:13:49,270 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0032_01_000003
2015-03-13 10:13:49,270 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0032_01_000002
2015-03-13 10:13:49,271 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:13:49,271 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0032	CONTAINERID=container_1426266260362_0032_01_000002
2015-03-13 10:13:49,271 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0032	CONTAINERID=container_1426266260362_0032_01_000003
2015-03-13 10:13:49,271 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0032_01_000003
2015-03-13 10:13:49,271 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:49,271 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:13:49,272 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:49,272 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:49,284 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0032_01_000003 is : 143
2015-03-13 10:13:49,285 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job_1426266260362_0032_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073742218_1394{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:13:49,287 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742218_1394 src: /127.0.0.1:63666 dest: /127.0.0.1:60686
2015-03-13 10:13:49,289 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742218_1394 src: /127.0.0.1:63667 dest: /127.0.0.1:60689
2015-03-13 10:13:49,290 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742218_1394 src: /127.0.0.1:63668 dest: /127.0.0.1:60693
2015-03-13 10:13:49,295 INFO  hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job_1426266260362_0032_1.jhist for DFSClient_NONMAPREDUCE_-1939842295_1
2015-03-13 10:13:49,297 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/_temporary/attempt_1426266260362_0032_m_000004_0	dst=null	perm=null
2015-03-13 10:13:49,297 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:13:49,297 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:13:49,298 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0032_01_000002
2015-03-13 10:13:49,299 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/task_1426266260362_0032_m_000004	dst=null	perm=null
2015-03-13 10:13:49,304 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/_temporary/attempt_1426266260362_0032_m_000004_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/task_1426266260362_0032_m_000004	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:13:49,305 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/_temporary/attempt_1426266260362_0032_m_000002_0/part-00002 is closed by DFSClient_attempt_1426266260362_0032_m_000002_0_-2132934942_1
2015-03-13 10:13:49,309 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0032_01_000002 is : 143
2015-03-13 10:13:49,317 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/_temporary/attempt_1426266260362_0032_m_000002_0	dst=null	perm=null
2015-03-13 10:13:49,321 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000003
2015-03-13 10:13:49,322 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000003
2015-03-13 10:13:49,322 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000003
2015-03-13 10:13:49,322 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000003
2015-03-13 10:13:49,322 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:13:49,322 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0032	CONTAINERID=container_1426266260362_0032_01_000003
2015-03-13 10:13:49,323 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:13:49,323 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000002
2015-03-13 10:13:49,323 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000002
2015-03-13 10:13:49,323 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000002
2015-03-13 10:13:49,324 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0032_01_000003 from application application_1426266260362_0032
2015-03-13 10:13:49,324 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:49,324 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0032
2015-03-13 10:13:49,324 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0032	CONTAINERID=container_1426266260362_0032_01_000002
2015-03-13 10:13:49,324 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:13:49,324 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0032_01_000002 from application application_1426266260362_0032
2015-03-13 10:13:49,324 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:49,324 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0032
2015-03-13 10:13:49,324 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000002
2015-03-13 10:13:49,328 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0032_01_000006
2015-03-13 10:13:49,328 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0032	CONTAINERID=container_1426266260362_0032_01_000006
2015-03-13 10:13:49,328 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:13:49,328 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0032_01_000006
2015-03-13 10:13:49,328 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:13:49,330 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/_temporary/attempt_1426266260362_0032_m_000002_0	dst=null	perm=null
2015-03-13 10:13:49,331 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/task_1426266260362_0032_m_000002	dst=null	perm=null
2015-03-13 10:13:49,335 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/_temporary/attempt_1426266260362_0032_m_000002_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/task_1426266260362_0032_m_000002	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:13:49,339 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0032_01_000006 is : 143
2015-03-13 10:13:49,347 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0032_01_000004
2015-03-13 10:13:49,347 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0032	CONTAINERID=container_1426266260362_0032_01_000004
2015-03-13 10:13:49,347 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:13:49,347 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0032_01_000004
2015-03-13 10:13:49,347 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:13:49,347 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0032_01_000002
2015-03-13 10:13:49,347 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:13:49,348 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0032_01_000003
2015-03-13 10:13:49,348 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:13:49,348 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:49,348 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0032_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:13:49,348 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0032_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:13:49,349 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0032	CONTAINERID=container_1426266260362_0032_01_000002
2015-03-13 10:13:49,349 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0032_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:13:49,349 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:13:49,349 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0032_01_000002, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:49,349 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:49,349 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:13:49,349 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0032_000001 released container container_1426266260362_0032_01_000002 on node: host: 10.1.1.144:60715 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:13:49,349 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0032_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:13:49,349 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0032_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:13:49,349 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0032	CONTAINERID=container_1426266260362_0032_01_000003
2015-03-13 10:13:49,349 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0032_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:13:49,349 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:13:49,350 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:13:49,350 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0032_01_000003, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:49,350 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:49,350 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:13:49,350 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0032_000001 released container container_1426266260362_0032_01_000003 on node: host: 10.1.1.144:60715 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:13:49,350 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000006
2015-03-13 10:13:49,350 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0032	CONTAINERID=container_1426266260362_0032_01_000006
2015-03-13 10:13:49,350 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:13:49,350 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0032_01_000006 from application application_1426266260362_0032
2015-03-13 10:13:49,350 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:49,350 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0032
2015-03-13 10:13:49,350 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000006
2015-03-13 10:13:49,351 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000006
2015-03-13 10:13:49,351 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000006
2015-03-13 10:13:49,359 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0032_01_000004 is : 143
2015-03-13 10:13:49,369 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs-sparse.txt	dst=null	perm=null
2015-03-13 10:13:49,369 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:13:49,369 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000004
2015-03-13 10:13:49,370 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000004
2015-03-13 10:13:49,370 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000004
2015-03-13 10:13:49,370 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0032	CONTAINERID=container_1426266260362_0032_01_000004
2015-03-13 10:13:49,370 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:13:49,370 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0032_01_000004 from application application_1426266260362_0032
2015-03-13 10:13:49,370 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:49,370 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0032
2015-03-13 10:13:49,370 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000004
2015-03-13 10:13:49,379 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs-sparse.txt	dst=null	perm=null
2015-03-13 10:13:49,382 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs-sparse.txt	dst=null	perm=null
2015-03-13 10:13:49,387 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63669, bytes: 52, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0032_m_000003_0_-1123006855_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742210_1386, duration: 147000
2015-03-13 10:13:49,410 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/_temporary/attempt_1426266260362_0032_m_000003_0/part-00003. BP-1005356445-10.1.1.144-1426266257849 blk_1073742219_1395{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:13:49,448 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742219_1395 src: /127.0.0.1:63670 dest: /127.0.0.1:60686
2015-03-13 10:13:49,449 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742219_1395 src: /127.0.0.1:63671 dest: /127.0.0.1:60696
2015-03-13 10:13:49,450 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742219_1395 src: /127.0.0.1:63672 dest: /127.0.0.1:60689
2015-03-13 10:13:49,456 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63672, dest: /127.0.0.1:60689, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0032_m_000003_0_-1123006855_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742219_1395, duration: 4597000
2015-03-13 10:13:49,456 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742219_1395, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:49,457 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742219_1395{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:13:49,457 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63671, dest: /127.0.0.1:60696, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0032_m_000003_0_-1123006855_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742219_1395, duration: 5251000
2015-03-13 10:13:49,457 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742219_1395, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:49,457 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742219_1395{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:13:49,458 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63670, dest: /127.0.0.1:60686, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0032_m_000003_0_-1123006855_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742219_1395, duration: 6017000
2015-03-13 10:13:49,458 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742219_1395, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:49,458 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742219_1395{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:13:49,463 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/_temporary/attempt_1426266260362_0032_m_000003_0/part-00003 is closed by DFSClient_attempt_1426266260362_0032_m_000003_0_-1123006855_1
2015-03-13 10:13:49,472 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/_temporary/attempt_1426266260362_0032_m_000003_0	dst=null	perm=null
2015-03-13 10:13:49,478 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/_temporary/attempt_1426266260362_0032_m_000003_0	dst=null	perm=null
2015-03-13 10:13:49,479 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/task_1426266260362_0032_m_000003	dst=null	perm=null
2015-03-13 10:13:49,483 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/_temporary/attempt_1426266260362_0032_m_000003_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/task_1426266260362_0032_m_000003	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:13:49,492 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0032_01_000005
2015-03-13 10:13:49,492 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0032	CONTAINERID=container_1426266260362_0032_01_000005
2015-03-13 10:13:49,492 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:13:49,492 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:13:49,493 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0032_01_000004
2015-03-13 10:13:49,493 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:13:49,493 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0032_01_000005
2015-03-13 10:13:49,493 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0032_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:13:49,493 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0032_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:13:49,493 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0032	CONTAINERID=container_1426266260362_0032_01_000004
2015-03-13 10:13:49,493 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0032_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:13:49,494 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:13:49,494 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0032_01_000004, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:49,494 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:49,494 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:13:49,494 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0032_000001 released container container_1426266260362_0032_01_000004 on node: host: 10.1.1.144:60715 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:13:49,496 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:49,498 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-1939842295_1
2015-03-13 10:13:49,502 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1	dst=null	perm=null
2015-03-13 10:13:49,505 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0032_01_000005 is : 143
2015-03-13 10:13:49,508 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner	dst=null	perm=null
2015-03-13 10:13:49,509 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner	dst=null	perm=null
2015-03-13 10:13:49,510 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/task_1426266260362_0032_m_000000	dst=null	perm=null
2015-03-13 10:13:49,511 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/part-00000	dst=null	perm=null
2015-03-13 10:13:49,514 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/task_1426266260362_0032_m_000000/part-00000	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/part-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:49,516 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:13:49,517 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner	dst=null	perm=null
2015-03-13 10:13:49,517 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000005
2015-03-13 10:13:49,518 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000005
2015-03-13 10:13:49,518 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner	dst=null	perm=null
2015-03-13 10:13:49,518 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000005
2015-03-13 10:13:49,518 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000005
2015-03-13 10:13:49,519 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0032	CONTAINERID=container_1426266260362_0032_01_000005
2015-03-13 10:13:49,519 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/task_1426266260362_0032_m_000001	dst=null	perm=null
2015-03-13 10:13:49,519 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:13:49,520 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0032_01_000005 from application application_1426266260362_0032
2015-03-13 10:13:49,520 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:49,520 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0032
2015-03-13 10:13:49,520 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/part-00001	dst=null	perm=null
2015-03-13 10:13:49,522 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/task_1426266260362_0032_m_000001/part-00001	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/part-00001	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:49,523 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner	dst=null	perm=null
2015-03-13 10:13:49,523 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner	dst=null	perm=null
2015-03-13 10:13:49,524 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/task_1426266260362_0032_m_000002	dst=null	perm=null
2015-03-13 10:13:49,526 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/part-00002	dst=null	perm=null
2015-03-13 10:13:49,527 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/task_1426266260362_0032_m_000002/part-00002	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/part-00002	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:49,529 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner	dst=null	perm=null
2015-03-13 10:13:49,530 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner	dst=null	perm=null
2015-03-13 10:13:49,531 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/task_1426266260362_0032_m_000003	dst=null	perm=null
2015-03-13 10:13:49,532 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/part-00003	dst=null	perm=null
2015-03-13 10:13:49,534 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/task_1426266260362_0032_m_000003/part-00003	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/part-00003	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:49,535 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner	dst=null	perm=null
2015-03-13 10:13:49,535 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner	dst=null	perm=null
2015-03-13 10:13:49,536 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/task_1426266260362_0032_m_000004	dst=null	perm=null
2015-03-13 10:13:49,537 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/part-00004	dst=null	perm=null
2015-03-13 10:13:49,539 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/task_1426266260362_0032_m_000004/part-00004	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/part-00004	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:49,544 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary	dst=null	perm=null
2015-03-13 10:13:49,547 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:49,549 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-1939842295_1
2015-03-13 10:13:49,551 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:49,553 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-1939842295_1
2015-03-13 10:13:49,564 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63668, dest: /127.0.0.1:60693, bytes: 52956, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1939842295_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742218_1394, duration: 272669000
2015-03-13 10:13:49,564 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742218_1394, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:49,565 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742218_1394{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:49,566 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63667, dest: /127.0.0.1:60689, bytes: 52956, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1939842295_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742218_1394, duration: 273543000
2015-03-13 10:13:49,566 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742218_1394, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:49,567 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742218_1394{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:49,567 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63666, dest: /127.0.0.1:60686, bytes: 52956, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1939842295_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742218_1394, duration: 275284000
2015-03-13 10:13:49,567 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742218_1394, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:49,568 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742218_1394{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:49,569 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job_1426266260362_0032_1.jhist is closed by DFSClient_NONMAPREDUCE_-1939842295_1
2015-03-13 10:13:49,572 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0032.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:49,574 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0032.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742220_1396{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:13:49,576 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742220_1396 src: /127.0.0.1:63673 dest: /127.0.0.1:60693
2015-03-13 10:13:49,577 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742220_1396 src: /127.0.0.1:63674 dest: /127.0.0.1:60696
2015-03-13 10:13:49,578 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742220_1396 src: /127.0.0.1:63675 dest: /127.0.0.1:60689
2015-03-13 10:13:49,581 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63675, dest: /127.0.0.1:60689, bytes: 440, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1939842295_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742220_1396, duration: 1158000
2015-03-13 10:13:49,581 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742220_1396, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:49,582 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742220_1396{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:13:49,582 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63674, dest: /127.0.0.1:60696, bytes: 440, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1939842295_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742220_1396, duration: 1846000
2015-03-13 10:13:49,582 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742220_1396, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:49,582 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742220_1396{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:13:49,583 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63673, dest: /127.0.0.1:60693, bytes: 440, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1939842295_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742220_1396, duration: 2617000
2015-03-13 10:13:49,583 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742220_1396, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:49,583 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742220_1396{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:13:49,585 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0032.summary_tmp is closed by DFSClient_NONMAPREDUCE_-1939842295_1
2015-03-13 10:13:49,588 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0032.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:49,594 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job_1426266260362_0032_1.jhist	dst=null	perm=null
2015-03-13 10:13:49,596 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0032-1426266814304-soberoi-%5BDBD09B24EEFF42C28C26CEA20C707FBA%2FBEF830D517EA448A-1426266829554-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:13:49,600 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job_1426266260362_0032_1.jhist	dst=null	perm=null
2015-03-13 10:13:49,601 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0032-1426266814304-soberoi-%5BDBD09B24EEFF42C28C26CEA20C707FBA%2FBEF830D517EA448A-1426266829554-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:13:49,602 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job_1426266260362_0032_1.jhist	dst=null	perm=null
2015-03-13 10:13:49,605 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0032-1426266814304-soberoi-%5BDBD09B24EEFF42C28C26CEA20C707FBA%2FBEF830D517EA448A-1426266829554-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:49,608 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63676, bytes: 53372, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1939842295_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742218_1394, duration: 174000
2015-03-13 10:13:49,610 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0032-1426266814304-soberoi-%5BDBD09B24EEFF42C28C26CEA20C707FBA%2FBEF830D517EA448A-1426266829554-5-0-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742221_1397{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:13:49,612 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742221_1397 src: /127.0.0.1:63677 dest: /127.0.0.1:60686
2015-03-13 10:13:49,614 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742221_1397 src: /127.0.0.1:63678 dest: /127.0.0.1:60689
2015-03-13 10:13:49,616 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742221_1397 src: /127.0.0.1:63679 dest: /127.0.0.1:60693
2015-03-13 10:13:49,622 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63679, dest: /127.0.0.1:60693, bytes: 52956, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1939842295_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742221_1397, duration: 3765000
2015-03-13 10:13:49,623 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742221_1397, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:49,624 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742221_1397{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:49,623 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63678, dest: /127.0.0.1:60689, bytes: 52956, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1939842295_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742221_1397, duration: 4374000
2015-03-13 10:13:49,624 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742221_1397, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:49,626 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63677, dest: /127.0.0.1:60686, bytes: 52956, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1939842295_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742221_1397, duration: 7035000
2015-03-13 10:13:49,626 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742221_1397, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:49,626 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742221_1397{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:49,628 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742221_1397 size 52956
2015-03-13 10:13:49,628 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0032-1426266814304-soberoi-%5BDBD09B24EEFF42C28C26CEA20C707FBA%2FBEF830D517EA448A-1426266829554-5-0-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-1939842295_1
2015-03-13 10:13:49,630 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0032-1426266814304-soberoi-%5BDBD09B24EEFF42C28C26CEA20C707FBA%2FBEF830D517EA448A-1426266829554-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:49,631 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job_1426266260362_0032_1_conf.xml	dst=null	perm=null
2015-03-13 10:13:49,632 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0032_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:13:49,633 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job_1426266260362_0032_1_conf.xml	dst=null	perm=null
2015-03-13 10:13:49,634 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0032_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:13:49,635 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job_1426266260362_0032_1_conf.xml	dst=null	perm=null
2015-03-13 10:13:49,637 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0032_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:49,639 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63676, bytes: 91798, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1939842295_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742215_1391, duration: 215000
2015-03-13 10:13:49,640 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0032_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742222_1398{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:13:49,641 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742222_1398 src: /127.0.0.1:63680 dest: /127.0.0.1:60696
2015-03-13 10:13:49,643 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742222_1398 src: /127.0.0.1:63683 dest: /127.0.0.1:60689
2015-03-13 10:13:49,644 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742222_1398 src: /127.0.0.1:63684 dest: /127.0.0.1:60693
2015-03-13 10:13:49,647 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63684, dest: /127.0.0.1:60693, bytes: 91086, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1939842295_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742222_1398, duration: 1778000
2015-03-13 10:13:49,647 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742222_1398, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:49,647 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63683, dest: /127.0.0.1:60689, bytes: 91086, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1939842295_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742222_1398, duration: 2154000
2015-03-13 10:13:49,647 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742222_1398, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:49,647 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742222_1398{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:49,648 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63680, dest: /127.0.0.1:60696, bytes: 91086, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1939842295_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742222_1398, duration: 3239000
2015-03-13 10:13:49,648 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742222_1398, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:49,648 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742222_1398{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:49,650 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742222_1398{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:49,651 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0032_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-1939842295_1
2015-03-13 10:13:49,652 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0032_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:49,654 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0032.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0032.summary	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:49,655 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0032_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0032_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:49,656 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0032-1426266814304-soberoi-%5BDBD09B24EEFF42C28C26CEA20C707FBA%2FBEF830D517EA448A-1426266829554-5-0-SUCCEEDED-default.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0032-1426266814304-soberoi-%5BDBD09B24EEFF42C28C26CEA20C707FBA%2FBEF830D517EA448A-1426266829554-5-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:49,662 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0032_000001 State change from RUNNING to FINISHING
2015-03-13 10:13:49,662 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0032
2015-03-13 10:13:49,662 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0032 State change from RUNNING to REMOVING
2015-03-13 10:13:49,662 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0032
2015-03-13 10:13:49,662 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0032 State change from REMOVING to FINISHING
2015-03-13 10:13:49,779 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:50,329 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:13:50,329 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0032_01_000006
2015-03-13 10:13:50,329 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0032_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:13:50,329 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0032_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:13:50,329 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0032	CONTAINERID=container_1426266260362_0032_01_000006
2015-03-13 10:13:50,330 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0032_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:13:50,330 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:13:50,330 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0032_01_000006, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:50,331 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:50,331 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:13:50,331 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0032_000001 released container container_1426266260362_0032_01_000006 on node: host: 10.1.1.144:60719 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:13:50,498 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:13:50,499 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0032_01_000005
2015-03-13 10:13:50,499 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0032_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:13:50,499 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0032_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:13:50,499 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0032	CONTAINERID=container_1426266260362_0032_01_000005
2015-03-13 10:13:50,500 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0032_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:13:50,500 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:13:50,500 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0032_01_000005, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:50,500 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:50,500 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:13:50,500 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0032_000001 released container container_1426266260362_0032_01_000005 on node: host: 10.1.1.144:60715 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:13:50,670 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742211_1387 127.0.0.1:60693 127.0.0.1:60689 127.0.0.1:60686 127.0.0.1:60696 
2015-03-13 10:13:50,670 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742212_1388 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60689 
2015-03-13 10:13:50,670 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742213_1389 127.0.0.1:60689 127.0.0.1:60696 127.0.0.1:60693 
2015-03-13 10:13:50,671 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742214_1390 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60689 
2015-03-13 10:13:50,671 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742218_1394 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60693 
2015-03-13 10:13:50,671 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742215_1391 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60693 
2015-03-13 10:13:50,671 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032	dst=null	perm=null
2015-03-13 10:13:50,698 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner	dst=null	perm=null
2015-03-13 10:13:50,698 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary
2015-03-13 10:13:50,698 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary	dst=null	perm=null
2015-03-13 10:13:50,705 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:13:50,706 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:13:50,706 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:13:50,707 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner	dst=null	perm=null
2015-03-13 10:13:50,707 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner	dst=null	perm=null
2015-03-13 10:13:50,708 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner	dst=null	perm=null
2015-03-13 10:13:50,709 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:13:50,709 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742222_1398
2015-03-13 10:13:50,709 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742220_1396
2015-03-13 10:13:50,709 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742216_1392
2015-03-13 10:13:50,709 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/part-00000	dst=null	perm=null
2015-03-13 10:13:50,710 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742217_1393
2015-03-13 10:13:50,710 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742218_1394
2015-03-13 10:13:50,710 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742221_1397
2015-03-13 10:13:50,710 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742219_1395
2015-03-13 10:13:50,712 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63686, bytes: 124, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742216_1392, duration: 133000
2015-03-13 10:13:50,713 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/part-00001	dst=null	perm=null
2015-03-13 10:13:50,714 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63686, bytes: 34, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742217_1393, duration: 128000
2015-03-13 10:13:50,715 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/part-00002	dst=null	perm=null
2015-03-13 10:13:50,715 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/part-00003	dst=null	perm=null
2015-03-13 10:13:50,717 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63687, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742219_1395, duration: 167000
2015-03-13 10:13:50,718 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/part-00004	dst=null	perm=null
2015-03-13 10:13:50,725 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:13:50,725 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:13:50,725 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:13:50,726 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner	dst=null	perm=null
2015-03-13 10:13:50,727 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner	dst=null	perm=null
2015-03-13 10:13:50,727 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner	dst=null	perm=null
2015-03-13 10:13:50,728 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:13:50,729 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/part-00000	dst=null	perm=null
2015-03-13 10:13:50,730 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63686, bytes: 124, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742216_1392, duration: 139000
2015-03-13 10:13:50,731 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/part-00001	dst=null	perm=null
2015-03-13 10:13:50,733 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63688, bytes: 34, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742217_1393, duration: 168000
2015-03-13 10:13:50,733 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/part-00002	dst=null	perm=null
2015-03-13 10:13:50,734 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/part-00003	dst=null	perm=null
2015-03-13 10:13:50,735 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63688, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742219_1395, duration: 167000
2015-03-13 10:13:50,736 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/part-00004	dst=null	perm=null
2015-03-13 10:13:50,736 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/joininner
2015-03-13 10:13:50,736 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner	dst=null	perm=null
2015-03-13 10:13:50,737 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner	dst=null	perm=null
2015-03-13 10:13:50,737 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner	dst=null	perm=null
2015-03-13 10:13:50,738 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner	dst=null	perm=null
2015-03-13 10:13:50,738 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/part-00000	dst=null	perm=null
2015-03-13 10:13:50,739 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/part-00000	dst=null	perm=null
2015-03-13 10:13:50,740 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63686, bytes: 124, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742216_1392, duration: 175000
2015-03-13 10:13:50,740 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/part-00001	dst=null	perm=null
2015-03-13 10:13:50,741 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/part-00001	dst=null	perm=null
2015-03-13 10:13:50,742 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63688, bytes: 34, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742217_1393, duration: 161000
2015-03-13 10:13:50,742 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/part-00002	dst=null	perm=null
2015-03-13 10:13:50,743 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/part-00002	dst=null	perm=null
2015-03-13 10:13:50,744 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/part-00003	dst=null	perm=null
2015-03-13 10:13:50,744 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/part-00003	dst=null	perm=null
2015-03-13 10:13:50,745 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63688, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742219_1395, duration: 138000
2015-03-13 10:13:50,746 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/part-00004	dst=null	perm=null
2015-03-13 10:13:50,746 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/part-00004	dst=null	perm=null
2015-03-13 10:13:50,747 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:13:50,755 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:13:50,756 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:13:50,756 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:13:50,775 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby	dst=null	perm=null
2015-03-13 10:13:50,777 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lhs*rhs] starting
2015-03-13 10:13:50,777 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lhs*rhs]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-03-13 10:13:50,777 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lhs*rhs]  sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby"]
2015-03-13 10:13:50,777 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lhs*rhs]  parallel execution is enabled: true
2015-03-13 10:13:50,777 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lhs*rhs]  starting jobs: 2
2015-03-13 10:13:50,777 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lhs*rhs]  allocating threads: 2
2015-03-13 10:13:50,778 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lhs*rhs] starting step: (2/2)
2015-03-13 10:13:50,784 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:50,786 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:13:50,793 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:13:50,794 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D	dst=null	perm=null
2015-03-13 10:13:50,794 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:13:50,795 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:13:50,797 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 33
2015-03-13 10:13:50,797 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033	dst=null	perm=null
2015-03-13 10:13:50,798 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033	dst=null	perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:13:50,799 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033	dst=null	perm=soberoi:supergroup:rwx------
2015-03-13 10:13:50,800 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.jar	dst=null	perm=null
2015-03-13 10:13:50,801 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:13:50,802 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073742223_1399{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:13:50,803 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742223_1399 src: /127.0.0.1:63690 dest: /127.0.0.1:60696
2015-03-13 10:13:50,804 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742223_1399 src: /127.0.0.1:63691 dest: /127.0.0.1:60689
2015-03-13 10:13:50,805 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742223_1399 src: /127.0.0.1:63692 dest: /127.0.0.1:60686
2015-03-13 10:13:50,809 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63692, dest: /127.0.0.1:60686, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742223_1399, duration: 1881000
2015-03-13 10:13:50,809 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742223_1399, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:50,809 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742223_1399{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:50,809 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63691, dest: /127.0.0.1:60689, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742223_1399, duration: 2424000
2015-03-13 10:13:50,809 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742223_1399, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:50,810 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742223_1399{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:50,810 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63690, dest: /127.0.0.1:60696, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742223_1399, duration: 3332000
2015-03-13 10:13:50,810 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742223_1399, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:50,811 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742223_1399{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:50,812 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:13:50,812 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.jar
2015-03-13 10:13:50,813 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.jar	dst=null	perm=null
2015-03-13 10:13:50,813 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:13:50,814 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:13:50,815 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:13:50,815 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:13:50,816 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:13:50,816 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:13:50,817 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:13:50,817 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:13:50,818 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:13:50,818 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:13:50,819 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:13:50,820 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:13:50,820 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:13:50,821 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:13:50,823 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:13:50,823 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.split
2015-03-13 10:13:50,823 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.split	dst=null	perm=null
2015-03-13 10:13:50,824 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073742224_1400{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:13:50,826 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742224_1400 src: /127.0.0.1:63693 dest: /127.0.0.1:60693
2015-03-13 10:13:50,827 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742224_1400 src: /127.0.0.1:63694 dest: /127.0.0.1:60686
2015-03-13 10:13:50,828 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742224_1400 src: /127.0.0.1:63695 dest: /127.0.0.1:60689
2015-03-13 10:13:50,829 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742224_1400 src: /127.0.0.1:63696 dest: /127.0.0.1:60696
2015-03-13 10:13:50,831 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63696, dest: /127.0.0.1:60696, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742224_1400, duration: 1550000
2015-03-13 10:13:50,832 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742224_1400, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:50,832 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742224_1400{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:13:50,832 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63695, dest: /127.0.0.1:60689, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742224_1400, duration: 1789000
2015-03-13 10:13:50,832 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742224_1400, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:50,833 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742224_1400{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:13:50,833 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63694, dest: /127.0.0.1:60686, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742224_1400, duration: 2865000
2015-03-13 10:13:50,833 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742224_1400, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:50,833 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742224_1400{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:13:50,834 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63693, dest: /127.0.0.1:60693, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742224_1400, duration: 3263000
2015-03-13 10:13:50,834 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742224_1400, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:50,834 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742224_1400{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:13:50,835 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:13:50,836 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:13:50,838 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:13:50,838 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073742225_1401{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:13:50,839 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742225_1401 src: /127.0.0.1:63697 dest: /127.0.0.1:60689
2015-03-13 10:13:50,841 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742225_1401 src: /127.0.0.1:63698 dest: /127.0.0.1:60686
2015-03-13 10:13:50,841 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742225_1401 src: /127.0.0.1:63699 dest: /127.0.0.1:60696
2015-03-13 10:13:50,844 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63699, dest: /127.0.0.1:60696, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742225_1401, duration: 1222000
2015-03-13 10:13:50,844 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742225_1401, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:50,844 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742225_1401{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:13:50,844 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63698, dest: /127.0.0.1:60686, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742225_1401, duration: 1641000
2015-03-13 10:13:50,844 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742225_1401, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:50,845 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742225_1401{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:13:50,845 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63697, dest: /127.0.0.1:60689, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742225_1401, duration: 2313000
2015-03-13 10:13:50,845 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742225_1401, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:50,846 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742225_1401{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:13:50,846 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:13:50,847 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:13:50,847 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:13:50,849 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:13:50,850 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:13:50,850 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:13:50,850 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:13:50,853 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742226_1402{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:13:50,854 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742226_1402 src: /127.0.0.1:63700 dest: /127.0.0.1:60693
2015-03-13 10:13:50,855 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742226_1402 src: /127.0.0.1:63701 dest: /127.0.0.1:60686
2015-03-13 10:13:50,856 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742226_1402 src: /127.0.0.1:63702 dest: /127.0.0.1:60696
2015-03-13 10:13:50,858 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63702, dest: /127.0.0.1:60696, bytes: 98010, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742226_1402, duration: 1269000
2015-03-13 10:13:50,859 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742226_1402, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:50,859 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742226_1402{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:13:50,859 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63701, dest: /127.0.0.1:60686, bytes: 98010, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742226_1402, duration: 1688000
2015-03-13 10:13:50,859 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742226_1402, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:50,860 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742226_1402{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:13:50,860 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63700, dest: /127.0.0.1:60693, bytes: 98010, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742226_1402, duration: 2518000
2015-03-13 10:13:50,860 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742226_1402, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:50,860 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742226_1402{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:13:50,861 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:13:50,861 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0033
2015-03-13 10:13:50,862 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033	dst=null	perm=null
2015-03-13 10:13:50,863 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.xml	dst=null	perm=null
2015-03-13 10:13:50,863 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.xml	dst=null	perm=null
2015-03-13 10:13:50,864 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.jar	dst=null	perm=null
2015-03-13 10:13:50,864 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.jar	dst=null	perm=null
2015-03-13 10:13:50,865 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.split	dst=null	perm=null
2015-03-13 10:13:50,865 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.split	dst=null	perm=null
2015-03-13 10:13:50,866 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:13:50,866 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:13:50,867 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:13:50,868 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:13:50,868 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:13:50,869 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:13:50,870 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:13:50,870 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:13:50,871 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 33 submitted by user soberoi
2015-03-13 10:13:50,871 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0033
2015-03-13 10:13:50,871 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	IP=10.1.1.144	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1426266260362_0033
2015-03-13 10:13:50,871 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0033
2015-03-13 10:13:50,871 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0033 State change from NEW to NEW_SAVING
2015-03-13 10:13:50,872 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0033 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:13:50,872 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0033_000001
2015-03-13 10:13:50,872 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0033_000001 State change from NEW to SUBMITTED
2015-03-13 10:13:50,872 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0033 from user: soberoi activated in queue: default
2015-03-13 10:13:50,872 INFO  capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0033 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:13:50,872 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0033 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:13:50,872 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0033 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:13:50,873 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0033_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:13:50,873 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0033_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:13:50,874 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0033 State change from SUBMITTED to ACCEPTED
2015-03-13 10:13:50,875 INFO  mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0033/
2015-03-13 10:13:50,875 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lhs*rhs] submitted hadoop job: job_1426266260362_0033
2015-03-13 10:13:50,875 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lhs*rhs] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0033/
2015-03-13 10:13:51,259 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0033_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:13:51,259 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0033	CONTAINERID=container_1426266260362_0033_01_000001
2015-03-13 10:13:51,259 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0033_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:13:51,259 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0033 container=Container: [ContainerId: container_1426266260362_0033_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0033_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:51,259 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:13:51,259 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0033_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:13:51,260 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:51,260 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0033 AttemptId: appattempt_1426266260362_0033_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0033_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ]
2015-03-13 10:13:51,261 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0033_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:13:51,261 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0033_000001
2015-03-13 10:13:51,261 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0033_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:13:51,261 INFO  amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0033_000001
2015-03-13 10:13:51,262 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0033_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] for AM appattempt_1426266260362_0033_000001
2015-03-13 10:13:51,262 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0033_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-03-13 10:13:51,264 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0033_000001 (auth:SIMPLE)
2015-03-13 10:13:51,265 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0033_01_000001 by user soberoi
2015-03-13 10:13:51,265 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0033
2015-03-13 10:13:51,265 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0033	CONTAINERID=container_1426266260362_0033_01_000001
2015-03-13 10:13:51,265 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0033 transitioned from NEW to INITING
2015-03-13 10:13:51,266 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0033_01_000001 to application application_1426266260362_0033
2015-03-13 10:13:51,266 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0033 transitioned from INITING to RUNNING
2015-03-13 10:13:51,266 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0033_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] for AM appattempt_1426266260362_0033_000001
2015-03-13 10:13:51,266 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0033_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:13:51,266 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:13:51,266 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0033
2015-03-13 10:13:51,266 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:13:51,266 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:13:51,266 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:13:51,267 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:13:51,267 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0033_01_000001
2015-03-13 10:13:51,276 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426266260362_0033_01_000001.tokens. Credentials list: 
2015-03-13 10:13:51,290 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:13:51,359 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426266260362_0033_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000001.tokens
2015-03-13 10:13:51,359 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0033 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0033
2015-03-13 10:13:51,418 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.jar	dst=null	perm=null
2015-03-13 10:13:51,419 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.jar	dst=null	perm=null
2015-03-13 10:13:51,420 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.jar	dst=null	perm=null
2015-03-13 10:13:51,425 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63687, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1742906083_17658, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742223_1399, duration: 327000
2015-03-13 10:13:51,443 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:13:51,458 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:13:51,458 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:13:51,459 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:13:51,464 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63687, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1742906083_17658, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742225_1401, duration: 173000
2015-03-13 10:13:51,476 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:13:51,492 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.split	dst=null	perm=null
2015-03-13 10:13:51,493 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.split	dst=null	perm=null
2015-03-13 10:13:51,493 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.split	dst=null	perm=null
2015-03-13 10:13:51,499 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63686, bytes: 1798, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1742906083_17658, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742224_1400, duration: 178000
2015-03-13 10:13:51,511 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:13:51,527 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.xml	dst=null	perm=null
2015-03-13 10:13:51,527 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.xml	dst=null	perm=null
2015-03-13 10:13:51,528 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.xml	dst=null	perm=null
2015-03-13 10:13:51,533 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63686, bytes: 98778, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1742906083_17658, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742226_1402, duration: 292000
2015-03-13 10:13:51,545 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:13:51,546 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:13:51,570 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:13:51,570 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:51,634 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000001/default_container_executor.sh]
2015-03-13 10:13:51,787 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:51,865 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742221_1397
2015-03-13 10:13:51,866 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742219_1395
2015-03-13 10:13:51,866 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742218_1394
2015-03-13 10:13:51,866 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742225_1401
2015-03-13 10:13:51,867 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742226_1402
2015-03-13 10:13:51,867 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742224_1400
2015-03-13 10:13:51,912 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742224_1400
2015-03-13 10:13:51,912 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742220_1396
2015-03-13 10:13:51,913 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742226_1402
2015-03-13 10:13:51,913 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742218_1394
2015-03-13 10:13:51,914 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742216_1392
2015-03-13 10:13:51,914 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742222_1398
2015-03-13 10:13:52,117 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742221_1397
2015-03-13 10:13:52,165 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60696 to replicate blk_1073742223_1399 to datanode(s) 127.0.0.1:60693
2015-03-13 10:13:52,165 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073742211_1387, blk_1073742212_1388, blk_1073742213_1389, blk_1073742214_1390, blk_1073742215_1391]
2015-03-13 10:13:52,165 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073742211_1387, blk_1073742212_1388, blk_1073742213_1389, blk_1073742214_1390, blk_1073742215_1391, blk_1073742218_1394]
2015-03-13 10:13:52,262 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:52,262 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0033_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:13:52,267 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742223_1399
2015-03-13 10:13:52,268 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742217_1393
2015-03-13 10:13:52,464 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742217_1393
2015-03-13 10:13:52,465 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742225_1401
2015-03-13 10:13:52,466 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742223_1399
2015-03-13 10:13:52,467 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742222_1398
2015-03-13 10:13:52,467 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742216_1392
2015-03-13 10:13:52,467 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742219_1395
2015-03-13 10:13:52,468 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742220_1396
2015-03-13 10:13:52,468 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742224_1400
2015-03-13 10:13:52,667 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742226_1402
2015-03-13 10:13:52,696 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742211_1387 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742211 for deletion
2015-03-13 10:13:52,696 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742212_1388 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742212 for deletion
2015-03-13 10:13:52,696 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742213_1389 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742213 for deletion
2015-03-13 10:13:52,696 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742214_1390 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742214 for deletion
2015-03-13 10:13:52,696 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742215_1391 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742215 for deletion
2015-03-13 10:13:52,696 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742211_1387 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742211
2015-03-13 10:13:52,697 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742213_1389 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742213
2015-03-13 10:13:52,697 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742215_1391 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742215
2015-03-13 10:13:52,696 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742218_1394 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742218 for deletion
2015-03-13 10:13:52,697 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742212_1388 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742212
2015-03-13 10:13:52,697 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742214_1390 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742214
2015-03-13 10:13:52,697 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742218_1394 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742218
2015-03-13 10:13:52,793 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:53,117 INFO  datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-318492837-10.1.1.144-60696-1426266259571, infoPort=60697, ipcPort=60698, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073742223_1399 to 127.0.0.1:60693 
2015-03-13 10:13:53,117 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742211_1387 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742211 for deletion
2015-03-13 10:13:53,117 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742212_1388 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742212 for deletion
2015-03-13 10:13:53,117 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742213_1389 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742213 for deletion
2015-03-13 10:13:53,117 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742214_1390 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742214 for deletion
2015-03-13 10:13:53,118 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742215_1391 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742215 for deletion
2015-03-13 10:13:53,118 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742212_1388 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742212
2015-03-13 10:13:53,117 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742211_1387 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742211
2015-03-13 10:13:53,118 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742214_1390 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742214
2015-03-13 10:13:53,118 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742213_1389 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742213
2015-03-13 10:13:53,119 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742215_1391 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742215
2015-03-13 10:13:53,118 INFO  datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073742223_1399 (numBytes=254067) to /127.0.0.1:60693
2015-03-13 10:13:53,119 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742223_1399 src: /127.0.0.1:63706 dest: /127.0.0.1:60693
2015-03-13 10:13:53,120 INFO  datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073742223_1399 src: /127.0.0.1:63706 dest: /127.0.0.1:60693 of size 254067
2015-03-13 10:13:53,121 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742223_1399 size 254067
2015-03-13 10:13:53,200 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:13:53,221 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/COMMIT_STARTED	dst=null	perm=null
2015-03-13 10:13:53,222 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/COMMIT_SUCCESS	dst=null	perm=null
2015-03-13 10:13:53,223 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/COMMIT_FAIL	dst=null	perm=null
2015-03-13 10:13:53,266 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:53,275 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033	dst=null	perm=null
2015-03-13 10:13:53,276 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:13:53,277 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:13:53,557 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:13:53,564 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:13:53,619 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63708, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1509750256_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742225_1401, duration: 189000
2015-03-13 10:13:53,795 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:54,266 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:54,374 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0033_000001 (auth:SIMPLE)
2015-03-13 10:13:54,375 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0033_000001
2015-03-13 10:13:54,375 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi	IP=10.1.1.144	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1426266260362_0033	APPATTEMPTID=appattempt_1426266260362_0033_000001
2015-03-13 10:13:54,376 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0033_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:13:54,376 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0033 State change from ACCEPTED to RUNNING
2015-03-13 10:13:54,396 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job_1426266260362_0033_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:54,398 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:13:54,461 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job_1426266260362_0033_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:54,586 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job_1426266260362_0033_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742227_1403{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:13:54,625 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742227_1403 src: /127.0.0.1:63714 dest: /127.0.0.1:60686
2015-03-13 10:13:54,729 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742227_1403 src: /127.0.0.1:63715 dest: /127.0.0.1:60696
2015-03-13 10:13:54,731 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742227_1403 src: /127.0.0.1:63716 dest: /127.0.0.1:60689
2015-03-13 10:13:54,737 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63716, dest: /127.0.0.1:60689, bytes: 90728, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1509750256_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742227_1403, duration: 4657000
2015-03-13 10:13:54,737 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742227_1403, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:54,737 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742227_1403{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:13:54,737 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63715, dest: /127.0.0.1:60696, bytes: 90728, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1509750256_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742227_1403, duration: 5199000
2015-03-13 10:13:54,738 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742227_1403, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:54,738 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63714, dest: /127.0.0.1:60686, bytes: 90728, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1509750256_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742227_1403, duration: 6015000
2015-03-13 10:13:54,738 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742227_1403{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:13:54,738 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742227_1403, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:54,739 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742227_1403{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:13:54,742 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job_1426266260362_0033_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-1509750256_1
2015-03-13 10:13:54,801 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:55,166 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073742211_1387, blk_1073742212_1388, blk_1073742213_1389, blk_1073742215_1391, blk_1073742218_1394]
2015-03-13 10:13:55,166 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073742211_1387, blk_1073742212_1388, blk_1073742214_1390, blk_1073742218_1394]
2015-03-13 10:13:55,268 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:55,516 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0033_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:13:55,516 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0033	CONTAINERID=container_1426266260362_0033_01_000002
2015-03-13 10:13:55,516 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0033_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:13:55,516 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0033 container=Container: [ContainerId: container_1426266260362_0033_01_000002, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0033_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:55,517 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:13:55,517 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:55,517 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0033_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:13:55,517 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0033	CONTAINERID=container_1426266260362_0033_01_000003
2015-03-13 10:13:55,517 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0033_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:13:55,518 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0033 container=Container: [ContainerId: container_1426266260362_0033_01_000003, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0033_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:55,518 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:13:55,518 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:55,518 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0033_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:13:55,519 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0033	CONTAINERID=container_1426266260362_0033_01_000004
2015-03-13 10:13:55,519 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0033_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:13:55,519 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0033 container=Container: [ContainerId: container_1426266260362_0033_01_000004, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0033_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:55,519 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:13:55,519 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:55,519 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0033_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:13:55,520 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0033	CONTAINERID=container_1426266260362_0033_01_000005
2015-03-13 10:13:55,520 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0033_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:13:55,520 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0033 container=Container: [ContainerId: container_1426266260362_0033_01_000005, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0033_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:55,520 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:13:55,520 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:55,701 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0032_01_000001 succeeded 
2015-03-13 10:13:55,701 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:13:55,701 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0032_01_000001
2015-03-13 10:13:55,709 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000001
2015-03-13 10:13:55,709 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000001
2015-03-13 10:13:55,710 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000001
2015-03-13 10:13:55,710 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0032	CONTAINERID=container_1426266260362_0032_01_000001
2015-03-13 10:13:55,710 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000001
2015-03-13 10:13:55,710 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:13:55,710 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0032_01_000001 from application application_1426266260362_0032
2015-03-13 10:13:55,710 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:55,710 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0032
2015-03-13 10:13:55,717 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742223_1399
2015-03-13 10:13:55,718 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742211_1387 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742211 for deletion
2015-03-13 10:13:55,719 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742212_1388 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742212 for deletion
2015-03-13 10:13:55,719 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742214_1390 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742214 for deletion
2015-03-13 10:13:55,719 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742218_1394 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742218 for deletion
2015-03-13 10:13:55,719 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742211_1387 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742211
2015-03-13 10:13:55,719 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742212_1388 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742212
2015-03-13 10:13:55,719 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742214_1390 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742214
2015-03-13 10:13:55,719 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742218_1394 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742218
2015-03-13 10:13:55,801 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:13:55,802 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0032_01_000001
2015-03-13 10:13:55,802 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0032_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:13:55,802 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0032_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:13:55,802 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0032_000001
2015-03-13 10:13:55,802 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0032	CONTAINERID=container_1426266260362_0032_01_000001
2015-03-13 10:13:55,803 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0032_000001 State change from FINISHING to FINISHED
2015-03-13 10:13:55,803 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0032_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60711, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:13:55,803 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0032 State change from FINISHING to FINISHED
2015-03-13 10:13:55,803 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:13:55,803 INFO  amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0032_000001
2015-03-13 10:13:55,803 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1426266260362_0032
2015-03-13 10:13:55,803 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0032,name=[DBD09B24EEFF42C28C26CEA20C707FBA/BEF830D517EA448A98DAE15B6614864B] lower*upper/(1/1) ...edpipesplatform/joininner,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0032/jobhistory/job/job_1426266260362_0032,appMasterHost=Edinburgh.local,startTime=1426266814304,finishTime=1426266829662,finalStatus=SUCCEEDED
2015-03-13 10:13:55,803 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0032_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:55,804 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:55,804 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=5
2015-03-13 10:13:55,804 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0032_000001 released container container_1426266260362_0032_01_000001 on node: host: 10.1.1.144:60711 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:13:55,804 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0033_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:13:55,804 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0033	CONTAINERID=container_1426266260362_0033_01_000006
2015-03-13 10:13:55,804 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0033_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:13:55,804 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0033 container=Container: [ContainerId: container_1426266260362_0033_01_000006, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0033_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:55,805 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6
2015-03-13 10:13:55,805 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:55,805 INFO  capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0032_000001 is done. finalState=FINISHED
2015-03-13 10:13:55,805 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0032 requests cleared
2015-03-13 10:13:55,805 INFO  capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0032 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:13:55,805 INFO  capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0032 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:13:55,806 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0032_000001 (auth:SIMPLE)
2015-03-13 10:13:55,806 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0032_01_000001
2015-03-13 10:13:55,923 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742227_1403
2015-03-13 10:13:55,923 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742224_1400
2015-03-13 10:13:55,924 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742225_1401
2015-03-13 10:13:55,924 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742211_1387 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742211 for deletion
2015-03-13 10:13:55,924 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742212_1388 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742212 for deletion
2015-03-13 10:13:55,924 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742213_1389 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742213 for deletion
2015-03-13 10:13:55,924 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742215_1391 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742215 for deletion
2015-03-13 10:13:55,925 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742218_1394 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742218 for deletion
2015-03-13 10:13:55,925 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742212_1388 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742212
2015-03-13 10:13:55,924 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742211_1387 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742211
2015-03-13 10:13:55,925 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742215_1391 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742215
2015-03-13 10:13:55,925 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742213_1389 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742213
2015-03-13 10:13:55,926 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742218_1394 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742218
2015-03-13 10:13:56,274 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:56,340 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0032 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:13:56,340 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0032
2015-03-13 10:13:56,340 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0032
2015-03-13 10:13:56,340 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0032
2015-03-13 10:13:56,340 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0032 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:13:56,340 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0032, with delay of 10800 seconds
2015-03-13 10:13:56,340 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0032
2015-03-13 10:13:56,341 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0032
2015-03-13 10:13:56,413 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0033_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:13:56,413 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0033_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:13:56,414 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0033_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:13:56,414 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0033_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:13:56,414 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0033_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:13:56,442 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.jar	dst=null	perm=null
2015-03-13 10:13:56,443 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.jar	dst=null	perm=null
2015-03-13 10:13:56,452 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.xml	dst=null	perm=null
2015-03-13 10:13:56,453 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.xml	dst=null	perm=null
2015-03-13 10:13:56,455 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:13:56,456 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:13:56,461 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:13:56,463 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:13:56,464 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:13:56,465 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:13:56,520 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0032 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:13:56,520 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0032
2015-03-13 10:13:56,520 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0032
2015-03-13 10:13:56,521 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0032 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:13:56,521 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0032, with delay of 10800 seconds
2015-03-13 10:13:56,521 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0032
2015-03-13 10:13:56,521 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0032
2015-03-13 10:13:56,522 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0032
2015-03-13 10:13:56,542 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0033_000001 (auth:SIMPLE)
2015-03-13 10:13:56,542 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0033_000001 (auth:SIMPLE)
2015-03-13 10:13:56,545 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0033_01_000005 by user soberoi
2015-03-13 10:13:56,545 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0033_01_000002 by user soberoi
2015-03-13 10:13:56,545 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0033
2015-03-13 10:13:56,545 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0033	CONTAINERID=container_1426266260362_0033_01_000002
2015-03-13 10:13:56,546 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0033_01_000002 to application application_1426266260362_0033
2015-03-13 10:13:56,545 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0033	CONTAINERID=container_1426266260362_0033_01_000005
2015-03-13 10:13:56,546 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0033 transitioned from NEW to INITING
2015-03-13 10:13:56,546 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0033_01_000005 to application application_1426266260362_0033
2015-03-13 10:13:56,546 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0033 transitioned from INITING to RUNNING
2015-03-13 10:13:56,546 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:13:56,546 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:13:56,547 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0033
2015-03-13 10:13:56,547 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0033
2015-03-13 10:13:56,547 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:13:56,547 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0033
2015-03-13 10:13:56,547 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:13:56,547 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:13:56,547 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0033
2015-03-13 10:13:56,547 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0033
2015-03-13 10:13:56,547 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:13:56,547 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0033
2015-03-13 10:13:56,547 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0033_01_000005
2015-03-13 10:13:56,548 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0033_01_000002
2015-03-13 10:13:56,548 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0033_01_000003 by user soberoi
2015-03-13 10:13:56,548 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0033	CONTAINERID=container_1426266260362_0033_01_000003
2015-03-13 10:13:56,548 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0033_01_000006 by user soberoi
2015-03-13 10:13:56,549 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0033
2015-03-13 10:13:56,549 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0033	CONTAINERID=container_1426266260362_0033_01_000006
2015-03-13 10:13:56,550 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0033_01_000003 to application application_1426266260362_0033
2015-03-13 10:13:56,550 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:13:56,550 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0033
2015-03-13 10:13:56,550 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0033
2015-03-13 10:13:56,550 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:13:56,550 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0033 transitioned from NEW to INITING
2015-03-13 10:13:56,550 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0033_01_000006 to application application_1426266260362_0033
2015-03-13 10:13:56,550 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0033 transitioned from INITING to RUNNING
2015-03-13 10:13:56,551 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:13:56,551 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0033
2015-03-13 10:13:56,551 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0033
2015-03-13 10:13:56,551 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:13:56,551 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0033
2015-03-13 10:13:56,551 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:13:56,551 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:13:56,551 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0033_01_000006
2015-03-13 10:13:56,550 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0033_01_000004 by user soberoi
2015-03-13 10:13:56,552 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0033	CONTAINERID=container_1426266260362_0033_01_000004
2015-03-13 10:13:56,550 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0033
2015-03-13 10:13:56,553 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0033_01_000004 to application application_1426266260362_0033
2015-03-13 10:13:56,553 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0033_01_000003
2015-03-13 10:13:56,554 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:13:56,554 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0033
2015-03-13 10:13:56,554 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0033
2015-03-13 10:13:56,554 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:13:56,555 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0033
2015-03-13 10:13:56,555 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0033_01_000004
2015-03-13 10:13:56,575 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426266260362_0033_01_000005.tokens. Credentials list: 
2015-03-13 10:13:56,575 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0033_01_000002.tokens. Credentials list: 
2015-03-13 10:13:56,575 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0033_01_000006.tokens. Credentials list: 
2015-03-13 10:13:56,576 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1426266260362_0033_01_000003.tokens. Credentials list: 
2015-03-13 10:13:56,576 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0033_01_000004.tokens. Credentials list: 
2015-03-13 10:13:56,593 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:13:56,594 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:13:56,669 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0033_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000006.tokens
2015-03-13 10:13:56,669 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426266260362_0033_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000005.tokens
2015-03-13 10:13:56,669 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0033 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0033
2015-03-13 10:13:56,669 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0033 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0033
2015-03-13 10:13:56,731 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.jar	dst=null	perm=null
2015-03-13 10:13:56,731 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.jar	dst=null	perm=null
2015-03-13 10:13:56,731 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.jar	dst=null	perm=null
2015-03-13 10:13:56,731 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.jar	dst=null	perm=null
2015-03-13 10:13:56,732 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.jar	dst=null	perm=null
2015-03-13 10:13:56,732 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.jar	dst=null	perm=null
2015-03-13 10:13:56,739 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63725, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1160147824_17804, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742223_1399, duration: 409000
2015-03-13 10:13:56,739 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63724, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1236516046_17803, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742223_1399, duration: 504000
2015-03-13 10:13:56,759 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:13:56,760 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:13:56,779 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.xml	dst=null	perm=null
2015-03-13 10:13:56,779 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.xml	dst=null	perm=null
2015-03-13 10:13:56,779 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.xml	dst=null	perm=null
2015-03-13 10:13:56,779 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.xml	dst=null	perm=null
2015-03-13 10:13:56,780 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.xml	dst=null	perm=null
2015-03-13 10:13:56,780 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.xml	dst=null	perm=null
2015-03-13 10:13:56,787 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63726, bytes: 98778, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1160147824_17804, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742226_1402, duration: 309000
2015-03-13 10:13:56,787 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63727, bytes: 98778, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1236516046_17803, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742226_1402, duration: 312000
2015-03-13 10:13:56,801 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:13:56,801 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:13:56,801 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:13:56,801 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:13:56,802 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:13:56,802 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:13:56,802 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:13:56,802 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:56,802 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0032 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:13:56,803 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0033_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:13:56,803 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0032
2015-03-13 10:13:56,803 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0032
2015-03-13 10:13:56,803 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0032
2015-03-13 10:13:56,803 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0032 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:13:56,803 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0032, with delay of 10800 seconds
2015-03-13 10:13:56,803 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0032
2015-03-13 10:13:56,804 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0032
2015-03-13 10:13:56,860 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:13:56,860 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:56,863 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:13:56,863 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:56,864 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:13:56,864 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:56,865 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:13:56,865 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:56,866 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:13:56,866 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:57,004 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000005/default_container_executor.sh]
2015-03-13 10:13:57,011 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000006/default_container_executor.sh]
2015-03-13 10:13:57,012 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000004/default_container_executor.sh]
2015-03-13 10:13:57,012 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000002/default_container_executor.sh]
2015-03-13 10:13:57,034 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000003/default_container_executor.sh]
2015-03-13 10:13:57,126 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742223_1399
2015-03-13 10:13:57,273 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742227_1403
2015-03-13 10:13:57,275 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:57,427 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:13:57,525 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:57,525 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:57,525 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:57,525 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:57,526 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0033_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:13:57,526 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0033_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:13:57,526 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0033_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:13:57,526 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0033_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:13:57,671 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742227_1403
2015-03-13 10:13:57,806 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:57,837 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:13:57,950 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0033_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000004.tokens
2015-03-13 10:13:57,950 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0033 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0033
2015-03-13 10:13:58,074 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:13:58,207 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1426266260362_0033_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000003.tokens
2015-03-13 10:13:58,207 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0033 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0033
2015-03-13 10:13:58,278 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:58,307 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:13:58,436 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0033_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000002.tokens
2015-03-13 10:13:58,437 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0033 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0033
2015-03-13 10:13:58,529 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:58,529 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:58,529 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:58,529 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:58,806 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:59,279 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:59,530 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:59,530 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:59,530 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:59,531 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:59,812 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:00,284 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:00,535 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:00,535 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:00,535 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:00,535 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:00,815 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:01,289 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:01,538 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:01,538 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:01,538 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:01,538 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:01,816 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:02,292 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:02,541 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:02,541 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:02,541 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:02,541 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:02,820 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:03,293 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:03,546 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:03,546 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:03,546 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:03,547 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:03,825 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:04,298 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:04,551 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:04,552 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:04,552 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:04,552 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:04,831 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:05,175 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.split	dst=null	perm=null
2015-03-13 10:14:05,264 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.split	dst=null	perm=null
2015-03-13 10:14:05,274 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.split	dst=null	perm=null
2015-03-13 10:14:05,291 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.split	dst=null	perm=null
2015-03-13 10:14:05,302 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:05,317 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.split	dst=null	perm=null
2015-03-13 10:14:05,349 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63740, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0033_m_000001_0_976062286_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742224_1400, duration: 155000
2015-03-13 10:14:05,435 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63742, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0033_m_000004_0_-1416122943_1, offset: 1024, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742224_1400, duration: 150000
2015-03-13 10:14:05,438 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63743, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0033_m_000003_0_1689206587_1, offset: 1024, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742224_1400, duration: 154000
2015-03-13 10:14:05,471 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63745, bytes: 1282, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0033_m_000002_0_-2116056898_1, offset: 512, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742224_1400, duration: 149000
2015-03-13 10:14:05,471 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63744, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0033_m_000000_0_884156281_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742224_1400, duration: 118000
2015-03-13 10:14:05,502 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:14:05,505 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63746, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0033_m_000001_0_976062286_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 161000
2015-03-13 10:14:05,550 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:14:05,554 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:05,554 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63747, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0033_m_000004_0_-1416122943_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 180000
2015-03-13 10:14:05,554 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:05,554 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:05,554 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:05,556 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:14:05,562 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63748, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0033_m_000003_0_1689206587_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 143000
2015-03-13 10:14:05,583 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:14:05,587 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63749, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0033_m_000002_0_-2116056898_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 168000
2015-03-13 10:14:05,591 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:14:05,832 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:05,989 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D/_temporary/1/_temporary/attempt_1426266260362_0033_m_000001_0	dst=null	perm=null
2015-03-13 10:14:06,017 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0033_01_000003
2015-03-13 10:14:06,017 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0033	CONTAINERID=container_1426266260362_0033_01_000003
2015-03-13 10:14:06,017 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:14:06,017 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0033_01_000003
2015-03-13 10:14:06,017 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:06,017 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:14:06,017 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:06,018 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:06,030 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0033_01_000003 is : 143
2015-03-13 10:14:06,032 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job_1426266260362_0033_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073742228_1404{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:14:06,034 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742228_1404 src: /127.0.0.1:63750 dest: /127.0.0.1:60686
2015-03-13 10:14:06,035 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742228_1404 src: /127.0.0.1:63751 dest: /127.0.0.1:60693
2015-03-13 10:14:06,037 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742228_1404 src: /127.0.0.1:63752 dest: /127.0.0.1:60689
2015-03-13 10:14:06,041 INFO  hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job_1426266260362_0033_1.jhist for DFSClient_NONMAPREDUCE_-1509750256_1
2015-03-13 10:14:06,042 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:14:06,042 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000003
2015-03-13 10:14:06,042 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0033	CONTAINERID=container_1426266260362_0033_01_000003
2015-03-13 10:14:06,042 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:14:06,042 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000003
2015-03-13 10:14:06,043 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000003
2015-03-13 10:14:06,043 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000003
2015-03-13 10:14:06,042 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0033_01_000003 from application application_1426266260362_0033
2015-03-13 10:14:06,043 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:14:06,043 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0033
2015-03-13 10:14:06,075 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D/_temporary/1/_temporary/attempt_1426266260362_0033_m_000004_0	dst=null	perm=null
2015-03-13 10:14:06,091 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0033_01_000006
2015-03-13 10:14:06,091 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0033	CONTAINERID=container_1426266260362_0033_01_000006
2015-03-13 10:14:06,091 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:14:06,091 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0033_01_000006
2015-03-13 10:14:06,092 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:14:06,102 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63744, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0033_m_000000_0_884156281_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 140000
2015-03-13 10:14:06,104 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0033_01_000006 is : 143
2015-03-13 10:14:06,105 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D/_temporary/1/_temporary/attempt_1426266260362_0033_m_000003_0	dst=null	perm=null
2015-03-13 10:14:06,116 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:14:06,116 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000006
2015-03-13 10:14:06,116 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000006
2015-03-13 10:14:06,116 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000006
2015-03-13 10:14:06,117 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000006
2015-03-13 10:14:06,117 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0033	CONTAINERID=container_1426266260362_0033_01_000006
2015-03-13 10:14:06,117 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:14:06,117 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0033_01_000006 from application application_1426266260362_0033
2015-03-13 10:14:06,117 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:14:06,118 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0033
2015-03-13 10:14:06,129 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0033_01_000005
2015-03-13 10:14:06,129 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0033	CONTAINERID=container_1426266260362_0033_01_000005
2015-03-13 10:14:06,129 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:14:06,129 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0033_01_000005
2015-03-13 10:14:06,129 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:06,130 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:14:06,130 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0033_01_000003
2015-03-13 10:14:06,130 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:06,130 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:14:06,130 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0033_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:14:06,130 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0033_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:14:06,130 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0033	CONTAINERID=container_1426266260362_0033_01_000003
2015-03-13 10:14:06,131 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0033_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:14:06,131 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:14:06,131 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0033_01_000003, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:06,131 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:06,131 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:14:06,131 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0033_000001 released container container_1426266260362_0033_01_000003 on node: host: 10.1.1.144:60715 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:14:06,143 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0033_01_000005 is : 143
2015-03-13 10:14:06,154 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D/_temporary/1/_temporary/attempt_1426266260362_0033_m_000000_0	dst=null	perm=null
2015-03-13 10:14:06,155 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:14:06,155 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000005
2015-03-13 10:14:06,155 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000005
2015-03-13 10:14:06,156 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000005
2015-03-13 10:14:06,156 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000005
2015-03-13 10:14:06,157 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0033	CONTAINERID=container_1426266260362_0033_01_000005
2015-03-13 10:14:06,157 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:14:06,157 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0033_01_000005 from application application_1426266260362_0033
2015-03-13 10:14:06,158 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:14:06,158 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0033
2015-03-13 10:14:06,160 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D/_temporary/1/_temporary/attempt_1426266260362_0033_m_000002_0	dst=null	perm=null
2015-03-13 10:14:06,172 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0033_01_000002
2015-03-13 10:14:06,172 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0033	CONTAINERID=container_1426266260362_0033_01_000002
2015-03-13 10:14:06,172 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:06,173 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:14:06,173 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:06,173 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0033_01_000002
2015-03-13 10:14:06,173 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:14:06,173 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0033_01_000005
2015-03-13 10:14:06,174 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0033_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:14:06,174 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0033_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:14:06,174 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0033	CONTAINERID=container_1426266260362_0033_01_000005
2015-03-13 10:14:06,174 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0033_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:14:06,174 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:14:06,174 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0033_01_000005, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:06,174 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:06,174 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:14:06,174 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0033_000001 released container container_1426266260362_0033_01_000005 on node: host: 10.1.1.144:60715 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:14:06,176 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0033_01_000004
2015-03-13 10:14:06,176 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0033	CONTAINERID=container_1426266260362_0033_01_000004
2015-03-13 10:14:06,177 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:14:06,177 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:06,186 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0033_01_000002 is : 143
2015-03-13 10:14:06,200 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:14:06,200 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:14:06,200 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0033_01_000004
2015-03-13 10:14:06,207 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0033_01_000004 is : 143
2015-03-13 10:14:06,214 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000002
2015-03-13 10:14:06,214 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000002
2015-03-13 10:14:06,214 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000002
2015-03-13 10:14:06,215 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000002
2015-03-13 10:14:06,215 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:14:06,215 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0033	CONTAINERID=container_1426266260362_0033_01_000002
2015-03-13 10:14:06,215 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:14:06,215 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000004
2015-03-13 10:14:06,215 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000004
2015-03-13 10:14:06,216 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000004
2015-03-13 10:14:06,217 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000004
2015-03-13 10:14:06,217 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0033_01_000002 from application application_1426266260362_0033
2015-03-13 10:14:06,217 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:14:06,217 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0033
2015-03-13 10:14:06,218 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0033	CONTAINERID=container_1426266260362_0033_01_000004
2015-03-13 10:14:06,218 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:14:06,218 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0033_01_000004 from application application_1426266260362_0033
2015-03-13 10:14:06,218 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:14:06,218 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0033
2015-03-13 10:14:06,307 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:07,095 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:14:07,095 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0033_01_000006
2015-03-13 10:14:07,096 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0033_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:14:07,096 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0033_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:14:07,096 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0033	CONTAINERID=container_1426266260362_0033_01_000006
2015-03-13 10:14:07,096 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0033_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:14:07,096 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:14:07,096 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0033_01_000006, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:07,096 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:07,097 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:14:07,097 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0033_000001 released container container_1426266260362_0033_01_000006 on node: host: 10.1.1.144:60711 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:14:07,180 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:14:07,180 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0033_01_000002
2015-03-13 10:14:07,181 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:14:07,181 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0033_01_000004
2015-03-13 10:14:07,181 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0033_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:14:07,182 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0033_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:14:07,182 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0033	CONTAINERID=container_1426266260362_0033_01_000002
2015-03-13 10:14:07,182 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0033_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:14:07,182 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:14:07,182 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0033_01_000002, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:07,182 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:07,183 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:14:07,183 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0033_000001 released container container_1426266260362_0033_01_000002 on node: host: 10.1.1.144:60715 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:14:07,183 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0033_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:14:07,183 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0033_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:14:07,183 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0033	CONTAINERID=container_1426266260362_0033_01_000004
2015-03-13 10:14:07,183 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0033_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:14:07,183 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:14:07,183 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0033_01_000004, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:07,184 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:07,184 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:14:07,184 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0033_000001 released container container_1426266260362_0033_01_000004 on node: host: 10.1.1.144:60715 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:14:07,311 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:08,101 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0033_01_000007 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:14:08,101 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0033	CONTAINERID=container_1426266260362_0033_01_000007
2015-03-13 10:14:08,102 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0033_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:14:08,102 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0033 container=Container: [ContainerId: container_1426266260362_0033_01_000007, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0033_01_000007 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:08,102 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:14:08,102 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:08,314 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:08,475 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0033_01_000007 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:14:08,483 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0033_01_000007 by user soberoi
2015-03-13 10:14:08,483 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0033	CONTAINERID=container_1426266260362_0033_01_000007
2015-03-13 10:14:08,483 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0033_01_000007 to application application_1426266260362_0033
2015-03-13 10:14:08,484 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000007 transitioned from NEW to LOCALIZING
2015-03-13 10:14:08,484 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0033
2015-03-13 10:14:08,484 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0033
2015-03-13 10:14:08,484 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:14:08,484 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0033
2015-03-13 10:14:08,485 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000007 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:14:08,510 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000007 transitioned from LOCALIZED to RUNNING
2015-03-13 10:14:08,510 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:14:08,573 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000007/default_container_executor.sh]
2015-03-13 10:14:09,102 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:09,103 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0033_01_000007 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:14:09,320 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:09,481 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:14:10,104 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:10,325 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:10,855 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D/_temporary/1/_temporary/attempt_1426266260362_0033_r_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:14:10,895 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D/_temporary/1/_temporary/attempt_1426266260362_0033_r_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073742229_1405{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:14:10,952 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742229_1405 src: /127.0.0.1:63760 dest: /127.0.0.1:60686
2015-03-13 10:14:10,953 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742229_1405 src: /127.0.0.1:63763 dest: /127.0.0.1:60693
2015-03-13 10:14:10,954 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742229_1405 src: /127.0.0.1:63764 dest: /127.0.0.1:60689
2015-03-13 10:14:10,963 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63764, dest: /127.0.0.1:60689, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0033_r_000000_0_-21688833_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742229_1405, duration: 8365000
2015-03-13 10:14:10,963 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742229_1405, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:14:10,964 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742229_1405{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:14:10,964 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63763, dest: /127.0.0.1:60693, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0033_r_000000_0_-21688833_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742229_1405, duration: 8676000
2015-03-13 10:14:10,964 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742229_1405, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:10,964 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742229_1405{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:14:10,965 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63760, dest: /127.0.0.1:60686, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0033_r_000000_0_-21688833_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742229_1405, duration: 9417000
2015-03-13 10:14:10,965 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742229_1405, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:10,965 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742229_1405{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:14:10,968 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D/_temporary/1/_temporary/attempt_1426266260362_0033_r_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0033_r_000000_0_-21688833_1
2015-03-13 10:14:10,977 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D/_temporary/1/_temporary/attempt_1426266260362_0033_r_000000_0	dst=null	perm=null
2015-03-13 10:14:10,983 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D/_temporary/1/_temporary/attempt_1426266260362_0033_r_000000_0	dst=null	perm=null
2015-03-13 10:14:10,984 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D/_temporary/1/task_1426266260362_0033_r_000000	dst=null	perm=null
2015-03-13 10:14:10,986 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D/_temporary/1/_temporary/attempt_1426266260362_0033_r_000000_0	dst=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D/_temporary/1/task_1426266260362_0033_r_000000	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:14:10,993 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0033_01_000007
2015-03-13 10:14:10,993 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000007 transitioned from RUNNING to KILLING
2015-03-13 10:14:10,993 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0033	CONTAINERID=container_1426266260362_0033_01_000007
2015-03-13 10:14:10,993 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0033_01_000007
2015-03-13 10:14:10,994 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:14:10,998 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:14:11,000 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-1509750256_1
2015-03-13 10:14:11,003 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0033_01_000007 is : 143
2015-03-13 10:14:11,004 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D/_temporary/1	dst=null	perm=null
2015-03-13 10:14:11,008 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D	dst=null	perm=null
2015-03-13 10:14:11,008 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D	dst=null	perm=null
2015-03-13 10:14:11,009 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D/_temporary/1/task_1426266260362_0033_r_000000	dst=null	perm=null
2015-03-13 10:14:11,010 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D/part-00000	dst=null	perm=null
2015-03-13 10:14:11,011 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000007 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:14:11,012 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000007
2015-03-13 10:14:11,012 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000007
2015-03-13 10:14:11,012 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000007
2015-03-13 10:14:11,013 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000007
2015-03-13 10:14:11,013 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0033	CONTAINERID=container_1426266260362_0033_01_000007
2015-03-13 10:14:11,013 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000007 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:14:11,013 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0033_01_000007 from application application_1426266260362_0033
2015-03-13 10:14:11,013 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:14:11,013 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0033
2015-03-13 10:14:11,014 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D/_temporary/1/task_1426266260362_0033_r_000000/part-00000	dst=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D/part-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:14:11,018 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D/_temporary	dst=null	perm=null
2015-03-13 10:14:11,021 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:14:11,022 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-1509750256_1
2015-03-13 10:14:11,024 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:14:11,025 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-1509750256_1
2015-03-13 10:14:11,038 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63752, dest: /127.0.0.1:60689, bytes: 66891, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1509750256_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742228_1404, duration: 4999470000
2015-03-13 10:14:11,038 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742228_1404, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:14:11,039 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742228_1404{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:14:11,039 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63751, dest: /127.0.0.1:60693, bytes: 66891, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1509750256_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742228_1404, duration: 5000560000
2015-03-13 10:14:11,039 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742228_1404, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:11,040 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742228_1404{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:14:11,040 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63750, dest: /127.0.0.1:60686, bytes: 66891, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1509750256_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742228_1404, duration: 5001744000
2015-03-13 10:14:11,040 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742228_1404, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:11,040 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742228_1404{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:14:11,042 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job_1426266260362_0033_1.jhist is closed by DFSClient_NONMAPREDUCE_-1509750256_1
2015-03-13 10:14:11,043 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0033.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:14:11,045 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0033.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742230_1406{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:14:11,046 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742230_1406 src: /127.0.0.1:63765 dest: /127.0.0.1:60686
2015-03-13 10:14:11,048 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742230_1406 src: /127.0.0.1:63766 dest: /127.0.0.1:60689
2015-03-13 10:14:11,049 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742230_1406 src: /127.0.0.1:63767 dest: /127.0.0.1:60696
2015-03-13 10:14:11,052 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63767, dest: /127.0.0.1:60696, bytes: 422, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1509750256_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742230_1406, duration: 1192000
2015-03-13 10:14:11,052 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742230_1406, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:14:11,052 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742230_1406{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:14:11,052 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63766, dest: /127.0.0.1:60689, bytes: 422, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1509750256_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742230_1406, duration: 1616000
2015-03-13 10:14:11,052 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742230_1406, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:11,053 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742230_1406{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:14:11,053 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63765, dest: /127.0.0.1:60686, bytes: 422, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1509750256_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742230_1406, duration: 2289000
2015-03-13 10:14:11,053 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742230_1406, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:11,053 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742230_1406{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:14:11,054 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0033.summary_tmp is closed by DFSClient_NONMAPREDUCE_-1509750256_1
2015-03-13 10:14:11,057 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0033.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:14:11,061 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job_1426266260362_0033_1.jhist	dst=null	perm=null
2015-03-13 10:14:11,062 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0033-1426266830871-soberoi-%5B2C202E1F11CB4F72A241D80B1FC5F547%2F2FBAD5263615431A-1426266851026-5-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:14:11,065 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job_1426266260362_0033_1.jhist	dst=null	perm=null
2015-03-13 10:14:11,066 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0033-1426266830871-soberoi-%5B2C202E1F11CB4F72A241D80B1FC5F547%2F2FBAD5263615431A-1426266851026-5-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:14:11,067 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job_1426266260362_0033_1.jhist	dst=null	perm=null
2015-03-13 10:14:11,069 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0033-1426266830871-soberoi-%5B2C202E1F11CB4F72A241D80B1FC5F547%2F2FBAD5263615431A-1426266851026-5-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:14:11,074 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63768, bytes: 67415, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1509750256_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742228_1404, duration: 225000
2015-03-13 10:14:11,076 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0033-1426266830871-soberoi-%5B2C202E1F11CB4F72A241D80B1FC5F547%2F2FBAD5263615431A-1426266851026-5-1-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742231_1407{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:14:11,077 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742231_1407 src: /127.0.0.1:63769 dest: /127.0.0.1:60686
2015-03-13 10:14:11,078 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742231_1407 src: /127.0.0.1:63770 dest: /127.0.0.1:60689
2015-03-13 10:14:11,079 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742231_1407 src: /127.0.0.1:63771 dest: /127.0.0.1:60696
2015-03-13 10:14:11,082 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63771, dest: /127.0.0.1:60696, bytes: 66891, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1509750256_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742231_1407, duration: 1681000
2015-03-13 10:14:11,082 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742231_1407, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:14:11,083 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742231_1407{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:14:11,083 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63770, dest: /127.0.0.1:60689, bytes: 66891, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1509750256_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742231_1407, duration: 2322000
2015-03-13 10:14:11,083 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742231_1407, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:11,083 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742231_1407{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:14:11,084 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63769, dest: /127.0.0.1:60686, bytes: 66891, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1509750256_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742231_1407, duration: 3100000
2015-03-13 10:14:11,084 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742231_1407, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:11,084 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742231_1407{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:14:11,085 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0033-1426266830871-soberoi-%5B2C202E1F11CB4F72A241D80B1FC5F547%2F2FBAD5263615431A-1426266851026-5-1-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-1509750256_1
2015-03-13 10:14:11,087 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0033-1426266830871-soberoi-%5B2C202E1F11CB4F72A241D80B1FC5F547%2F2FBAD5263615431A-1426266851026-5-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:14:11,088 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job_1426266260362_0033_1_conf.xml	dst=null	perm=null
2015-03-13 10:14:11,089 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0033_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:14:11,090 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job_1426266260362_0033_1_conf.xml	dst=null	perm=null
2015-03-13 10:14:11,091 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0033_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:14:11,091 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job_1426266260362_0033_1_conf.xml	dst=null	perm=null
2015-03-13 10:14:11,093 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0033_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:14:11,095 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63772, bytes: 91440, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1509750256_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742227_1403, duration: 267000
2015-03-13 10:14:11,097 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0033_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742232_1408{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:14:11,098 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742232_1408 src: /127.0.0.1:63773 dest: /127.0.0.1:60696
2015-03-13 10:14:11,099 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742232_1408 src: /127.0.0.1:63774 dest: /127.0.0.1:60686
2015-03-13 10:14:11,101 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742232_1408 src: /127.0.0.1:63775 dest: /127.0.0.1:60693
2015-03-13 10:14:11,103 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63775, dest: /127.0.0.1:60693, bytes: 90728, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1509750256_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742232_1408, duration: 1754000
2015-03-13 10:14:11,103 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742232_1408, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:14:11,104 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742232_1408{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:14:11,104 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63774, dest: /127.0.0.1:60686, bytes: 90728, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1509750256_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742232_1408, duration: 2253000
2015-03-13 10:14:11,104 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742232_1408, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:11,105 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742232_1408{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:14:11,105 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63773, dest: /127.0.0.1:60696, bytes: 90728, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1509750256_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742232_1408, duration: 2922000
2015-03-13 10:14:11,105 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742232_1408, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:11,105 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742232_1408{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:14:11,107 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0033_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-1509750256_1
2015-03-13 10:14:11,108 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0033_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:14:11,109 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0033.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0033.summary	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:14:11,111 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0033_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0033_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:14:11,113 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0033-1426266830871-soberoi-%5B2C202E1F11CB4F72A241D80B1FC5F547%2F2FBAD5263615431A-1426266851026-5-1-SUCCEEDED-default.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0033-1426266830871-soberoi-%5B2C202E1F11CB4F72A241D80B1FC5F547%2F2FBAD5263615431A-1426266851026-5-1-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:14:11,119 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0033_000001 State change from RUNNING to FINISHING
2015-03-13 10:14:11,119 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0033
2015-03-13 10:14:11,119 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0033 State change from RUNNING to REMOVING
2015-03-13 10:14:11,119 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0033
2015-03-13 10:14:11,120 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0033 State change from REMOVING to FINISHING
2015-03-13 10:14:11,329 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:11,994 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:14:11,994 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0033_01_000007
2015-03-13 10:14:11,995 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0033_01_000007 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:14:11,995 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0033_01_000007 in state: COMPLETED event:FINISHED
2015-03-13 10:14:11,995 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0033	CONTAINERID=container_1426266260362_0033_01_000007
2015-03-13 10:14:11,995 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0033_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:14:11,996 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:14:11,996 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0033_01_000007, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:11,996 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:11,996 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:14:11,996 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0033_000001 released container container_1426266260362_0033_01_000007 on node: host: 10.1.1.144:60711 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:14:12,131 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742223_1399 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60686 127.0.0.1:60693 
2015-03-13 10:14:12,131 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742224_1400 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60696 
2015-03-13 10:14:12,131 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742225_1401 127.0.0.1:60689 127.0.0.1:60686 127.0.0.1:60696 
2015-03-13 10:14:12,131 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742226_1402 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60696 
2015-03-13 10:14:12,132 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742228_1404 127.0.0.1:60686 127.0.0.1:60693 127.0.0.1:60689 
2015-03-13 10:14:12,132 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742227_1403 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60689 
2015-03-13 10:14:12,132 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033	dst=null	perm=null
2015-03-13 10:14:12,142 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742228_1404
2015-03-13 10:14:12,143 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742232_1408
2015-03-13 10:14:12,143 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742229_1405
2015-03-13 10:14:12,165 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lhs*rhs] starting step: (1/2) ...orm/samepipearoundgroupby
2015-03-13 10:14:12,173 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:14:12,182 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:14:12,185 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby	dst=null	perm=null
2015-03-13 10:14:12,186 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:14:12,186 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:14:12,188 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 34
2015-03-13 10:14:12,189 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034	dst=null	perm=null
2015-03-13 10:14:12,190 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034	dst=null	perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:14:12,190 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034	dst=null	perm=soberoi:supergroup:rwx------
2015-03-13 10:14:12,191 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.jar	dst=null	perm=null
2015-03-13 10:14:12,192 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:14:12,194 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073742233_1409{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:14:12,195 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742233_1409 src: /127.0.0.1:63778 dest: /127.0.0.1:60689
2015-03-13 10:14:12,196 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742233_1409 src: /127.0.0.1:63779 dest: /127.0.0.1:60693
2015-03-13 10:14:12,197 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742233_1409 src: /127.0.0.1:63780 dest: /127.0.0.1:60686
2015-03-13 10:14:12,201 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63780, dest: /127.0.0.1:60686, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742233_1409, duration: 2769000
2015-03-13 10:14:12,201 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742233_1409, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:14:12,201 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742233_1409{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:14:12,202 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63779, dest: /127.0.0.1:60693, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742233_1409, duration: 2619000
2015-03-13 10:14:12,202 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742233_1409, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:12,202 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742233_1409{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:14:12,202 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63778, dest: /127.0.0.1:60689, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742233_1409, duration: 3560000
2015-03-13 10:14:12,202 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742233_1409, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:12,203 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742233_1409{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:14:12,204 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:14:12,204 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.jar
2015-03-13 10:14:12,205 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.jar	dst=null	perm=null
2015-03-13 10:14:12,205 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:14:12,206 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:14:12,207 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:14:12,207 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:14:12,208 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:14:12,208 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:14:12,209 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:14:12,209 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:14:12,209 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:14:12,210 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:14:12,212 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:14:12,212 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:14:12,212 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:14:12,214 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:14:12,215 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:14:12,216 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.split
2015-03-13 10:14:12,216 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.split	dst=null	perm=null
2015-03-13 10:14:12,217 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073742234_1410{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:14:12,219 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742234_1410 src: /127.0.0.1:63781 dest: /127.0.0.1:60696
2015-03-13 10:14:12,220 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742234_1410 src: /127.0.0.1:63782 dest: /127.0.0.1:60693
2015-03-13 10:14:12,221 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742234_1410 src: /127.0.0.1:63783 dest: /127.0.0.1:60689
2015-03-13 10:14:12,223 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742234_1410 src: /127.0.0.1:63784 dest: /127.0.0.1:60686
2015-03-13 10:14:12,226 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63784, dest: /127.0.0.1:60686, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742234_1410, duration: 1395000
2015-03-13 10:14:12,226 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742234_1410, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:14:12,226 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742234_1410{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:14:12,226 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63783, dest: /127.0.0.1:60689, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742234_1410, duration: 1699000
2015-03-13 10:14:12,227 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742234_1410, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:12,227 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742234_1410{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:14:12,227 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63782, dest: /127.0.0.1:60693, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742234_1410, duration: 2676000
2015-03-13 10:14:12,227 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742234_1410, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:12,228 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742234_1410{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:14:12,228 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63781, dest: /127.0.0.1:60696, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742234_1410, duration: 3417000
2015-03-13 10:14:12,228 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742234_1410, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:12,229 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742234_1410{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:14:12,230 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:14:12,231 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:14:12,232 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:14:12,233 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073742235_1411{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:14:12,235 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742235_1411 src: /127.0.0.1:63785 dest: /127.0.0.1:60693
2015-03-13 10:14:12,236 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742235_1411 src: /127.0.0.1:63786 dest: /127.0.0.1:60689
2015-03-13 10:14:12,237 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742235_1411 src: /127.0.0.1:63787 dest: /127.0.0.1:60696
2015-03-13 10:14:12,239 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63787, dest: /127.0.0.1:60696, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742235_1411, duration: 1119000
2015-03-13 10:14:12,239 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742235_1411, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:14:12,240 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742235_1411{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:14:12,240 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63786, dest: /127.0.0.1:60689, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742235_1411, duration: 1286000
2015-03-13 10:14:12,240 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742235_1411, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:12,240 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742235_1411{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:14:12,241 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63785, dest: /127.0.0.1:60693, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742235_1411, duration: 1953000
2015-03-13 10:14:12,241 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742235_1411, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:12,242 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742235_1411{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:14:12,243 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:14:12,243 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:14:12,244 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:14:12,245 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:14:12,246 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:14:12,246 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:14:12,247 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:14:12,250 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742236_1412{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:14:12,251 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742236_1412 src: /127.0.0.1:63788 dest: /127.0.0.1:60693
2015-03-13 10:14:12,252 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742236_1412 src: /127.0.0.1:63789 dest: /127.0.0.1:60696
2015-03-13 10:14:12,253 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742236_1412 src: /127.0.0.1:63790 dest: /127.0.0.1:60689
2015-03-13 10:14:12,256 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63790, dest: /127.0.0.1:60689, bytes: 98242, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742236_1412, duration: 1607000
2015-03-13 10:14:12,256 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742236_1412, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:14:12,256 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742236_1412{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:14:12,256 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63789, dest: /127.0.0.1:60696, bytes: 98242, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742236_1412, duration: 1901000
2015-03-13 10:14:12,257 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742236_1412, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:12,257 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742236_1412{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:14:12,257 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63788, dest: /127.0.0.1:60693, bytes: 98242, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742236_1412, duration: 2734000
2015-03-13 10:14:12,257 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742236_1412, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:12,260 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742236_1412{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:14:12,261 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:14:12,261 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0034
2015-03-13 10:14:12,262 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034	dst=null	perm=null
2015-03-13 10:14:12,263 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.xml	dst=null	perm=null
2015-03-13 10:14:12,263 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.xml	dst=null	perm=null
2015-03-13 10:14:12,264 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.jar	dst=null	perm=null
2015-03-13 10:14:12,264 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.jar	dst=null	perm=null
2015-03-13 10:14:12,265 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.split	dst=null	perm=null
2015-03-13 10:14:12,265 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.split	dst=null	perm=null
2015-03-13 10:14:12,266 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:14:12,266 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:14:12,268 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:14:12,269 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:14:12,270 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:14:12,270 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:14:12,271 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:14:12,272 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:14:12,273 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 34 submitted by user soberoi
2015-03-13 10:14:12,273 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0034
2015-03-13 10:14:12,273 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	IP=10.1.1.144	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1426266260362_0034
2015-03-13 10:14:12,274 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0034
2015-03-13 10:14:12,273 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0034 State change from NEW to NEW_SAVING
2015-03-13 10:14:12,274 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0034 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:14:12,274 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0034_000001
2015-03-13 10:14:12,274 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0034_000001 State change from NEW to SUBMITTED
2015-03-13 10:14:12,274 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0034 from user: soberoi activated in queue: default
2015-03-13 10:14:12,274 INFO  capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0034 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:14:12,275 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0034 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:14:12,275 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0034 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:14:12,275 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0034_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:14:12,275 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0034_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:14:12,276 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0034 State change from SUBMITTED to ACCEPTED
2015-03-13 10:14:12,277 INFO  mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0034/
2015-03-13 10:14:12,277 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lhs*rhs] submitted hadoop job: job_1426266260362_0034
2015-03-13 10:14:12,277 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lhs*rhs] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0034/
2015-03-13 10:14:12,279 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742233_1409
2015-03-13 10:14:12,279 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742234_1410
2015-03-13 10:14:12,334 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:12,335 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0034_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:14:12,335 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0034	CONTAINERID=container_1426266260362_0034_01_000001
2015-03-13 10:14:12,335 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0034_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60723, which currently has 2 containers, <memory:4096, vCores:2> used and <memory:0, vCores:6> available
2015-03-13 10:14:12,335 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0034 container=Container: [ContainerId: container_1426266260362_0034_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0034_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:12,335 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:14:12,335 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0034_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:14:12,335 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:12,336 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0034 AttemptId: appattempt_1426266260362_0034_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0034_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ]
2015-03-13 10:14:12,336 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0034_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:14:12,336 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0034_000001
2015-03-13 10:14:12,336 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0034_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:14:12,337 INFO  amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0034_000001
2015-03-13 10:14:12,337 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0034_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] for AM appattempt_1426266260362_0034_000001
2015-03-13 10:14:12,337 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0034_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-03-13 10:14:12,347 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0034_000001 (auth:SIMPLE)
2015-03-13 10:14:12,348 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0034_01_000001 by user soberoi
2015-03-13 10:14:12,348 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0034
2015-03-13 10:14:12,348 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0034	CONTAINERID=container_1426266260362_0034_01_000001
2015-03-13 10:14:12,348 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0034 transitioned from NEW to INITING
2015-03-13 10:14:12,348 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0034_01_000001 to application application_1426266260362_0034
2015-03-13 10:14:12,348 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0034 transitioned from INITING to RUNNING
2015-03-13 10:14:12,348 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0034_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] for AM appattempt_1426266260362_0034_000001
2015-03-13 10:14:12,349 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0034_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:14:12,349 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0034_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:14:12,349 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0034
2015-03-13 10:14:12,349 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:14:12,349 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:14:12,349 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:14:12,349 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:14:12,349 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0034_01_000001
2015-03-13 10:14:12,358 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426266260362_0034_01_000001.tokens. Credentials list: 
2015-03-13 10:14:12,376 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:14:12,447 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426266260362_0034_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0034/container_1426266260362_0034_01_000001.tokens
2015-03-13 10:14:12,447 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0034 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0034
2015-03-13 10:14:12,480 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742228_1404
2015-03-13 10:14:12,481 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742229_1405
2015-03-13 10:14:12,481 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742232_1408
2015-03-13 10:14:12,482 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742231_1407
2015-03-13 10:14:12,482 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742230_1406
2015-03-13 10:14:12,505 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.jar	dst=null	perm=null
2015-03-13 10:14:12,506 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.jar	dst=null	perm=null
2015-03-13 10:14:12,507 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.jar	dst=null	perm=null
2015-03-13 10:14:12,513 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63794, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_65866444_18206, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742233_1409, duration: 509000
2015-03-13 10:14:12,532 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:14:12,547 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:14:12,548 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:14:12,548 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:14:12,554 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63795, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_65866444_18206, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742235_1411, duration: 163000
2015-03-13 10:14:12,567 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:14:12,584 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.split	dst=null	perm=null
2015-03-13 10:14:12,584 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.split	dst=null	perm=null
2015-03-13 10:14:12,585 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.split	dst=null	perm=null
2015-03-13 10:14:12,590 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63794, bytes: 1798, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_65866444_18206, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742234_1410, duration: 169000
2015-03-13 10:14:12,603 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:14:12,620 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.xml	dst=null	perm=null
2015-03-13 10:14:12,621 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.xml	dst=null	perm=null
2015-03-13 10:14:12,622 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.xml	dst=null	perm=null
2015-03-13 10:14:12,628 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63794, bytes: 99010, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_65866444_18206, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742236_1412, duration: 271000
2015-03-13 10:14:12,640 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:14:12,640 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0034_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:14:12,665 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0034_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:14:12,665 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:14:12,685 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742235_1411
2015-03-13 10:14:12,685 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742231_1407
2015-03-13 10:14:12,686 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742236_1412
2015-03-13 10:14:12,686 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742230_1406
2015-03-13 10:14:12,686 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742234_1410
2015-03-13 10:14:12,687 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742232_1408
2015-03-13 10:14:12,730 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0034/container_1426266260362_0034_01_000001/default_container_executor.sh]
2015-03-13 10:14:13,186 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60686 to replicate blk_1073742233_1409 to datanode(s) 127.0.0.1:60696
2015-03-13 10:14:13,186 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073742224_1400, blk_1073742225_1401, blk_1073742226_1402, blk_1073742227_1403, blk_1073742223_1399]
2015-03-13 10:14:13,186 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073742224_1400, blk_1073742225_1401, blk_1073742227_1403, blk_1073742228_1404, blk_1073742223_1399]
2015-03-13 10:14:13,338 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:13,339 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:13,339 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0034_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:14:13,715 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742224_1400 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742224 for deletion
2015-03-13 10:14:13,715 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742225_1401 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742225 for deletion
2015-03-13 10:14:13,716 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742227_1403 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742227 for deletion
2015-03-13 10:14:13,716 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742228_1404 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742228 for deletion
2015-03-13 10:14:13,716 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742223_1399 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742223 for deletion
2015-03-13 10:14:13,716 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742224_1400 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742224
2015-03-13 10:14:13,716 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742227_1403 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742227
2015-03-13 10:14:13,717 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742225_1401 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742225
2015-03-13 10:14:13,717 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742228_1404 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742228
2015-03-13 10:14:13,717 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742223_1399 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742223
2015-03-13 10:14:13,739 INFO  datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-1907321454-10.1.1.144-60686-1426266259166, infoPort=60687, ipcPort=60688, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073742233_1409 to 127.0.0.1:60696 
2015-03-13 10:14:13,741 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742233_1409 src: /127.0.0.1:63796 dest: /127.0.0.1:60696
2015-03-13 10:14:13,741 INFO  datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073742233_1409 (numBytes=254067) to /127.0.0.1:60696
2015-03-13 10:14:13,742 INFO  datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073742233_1409 src: /127.0.0.1:63796 dest: /127.0.0.1:60696 of size 254067
2015-03-13 10:14:13,743 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742233_1409 size 254067
2015-03-13 10:14:14,135 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742224_1400 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742224 for deletion
2015-03-13 10:14:14,135 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742225_1401 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742225 for deletion
2015-03-13 10:14:14,135 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742226_1402 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742226 for deletion
2015-03-13 10:14:14,135 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742227_1403 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742227 for deletion
2015-03-13 10:14:14,135 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742223_1399 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742223 for deletion
2015-03-13 10:14:14,136 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742224_1400 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742224
2015-03-13 10:14:14,136 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742226_1402 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742226
2015-03-13 10:14:14,136 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742225_1401 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742225
2015-03-13 10:14:14,137 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742227_1403 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742227
2015-03-13 10:14:14,137 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742223_1399 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742223
2015-03-13 10:14:14,267 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:14:14,289 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/COMMIT_STARTED	dst=null	perm=null
2015-03-13 10:14:14,290 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/COMMIT_SUCCESS	dst=null	perm=null
2015-03-13 10:14:14,291 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/COMMIT_FAIL	dst=null	perm=null
2015-03-13 10:14:14,343 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:14,343 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034	dst=null	perm=null
2015-03-13 10:14:14,344 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:14,345 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:14:14,346 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:14:14,623 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:14:14,630 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:14:14,686 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63798, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_772751086_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742235_1411, duration: 194000
2015-03-13 10:14:15,349 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:15,349 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:15,481 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0034_000001 (auth:SIMPLE)
2015-03-13 10:14:15,482 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0034_000001
2015-03-13 10:14:15,483 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi	IP=10.1.1.144	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1426266260362_0034	APPATTEMPTID=appattempt_1426266260362_0034_000001
2015-03-13 10:14:15,483 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0034_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:14:15,483 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0034 State change from ACCEPTED to RUNNING
2015-03-13 10:14:15,506 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job_1426266260362_0034_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:14:15,508 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:14:15,573 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job_1426266260362_0034_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:14:15,712 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job_1426266260362_0034_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742237_1413{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:14:15,750 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742237_1413 src: /127.0.0.1:63804 dest: /127.0.0.1:60693
2015-03-13 10:14:15,752 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742237_1413 src: /127.0.0.1:63805 dest: /127.0.0.1:60696
2015-03-13 10:14:15,753 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742237_1413 src: /127.0.0.1:63806 dest: /127.0.0.1:60686
2015-03-13 10:14:15,760 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63806, dest: /127.0.0.1:60686, bytes: 91045, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_772751086_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742237_1413, duration: 5029000
2015-03-13 10:14:15,760 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742237_1413, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:14:15,760 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742237_1413{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:14:15,760 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63805, dest: /127.0.0.1:60696, bytes: 91045, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_772751086_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742237_1413, duration: 5571000
2015-03-13 10:14:15,761 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742237_1413, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:15,761 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742237_1413{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:14:15,761 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63804, dest: /127.0.0.1:60693, bytes: 91045, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_772751086_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742237_1413, duration: 6437000
2015-03-13 10:14:15,761 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742237_1413, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:15,762 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742237_1413{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:14:15,765 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job_1426266260362_0034_1_conf.xml is closed by DFSClient_NONMAPREDUCE_772751086_1
2015-03-13 10:14:15,936 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742233_1409
2015-03-13 10:14:15,936 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742229_1405
2015-03-13 10:14:15,937 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742231_1407
2015-03-13 10:14:16,138 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742236_1412
2015-03-13 10:14:16,139 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742234_1410
2015-03-13 10:14:16,139 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742230_1406
2015-03-13 10:14:16,139 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742235_1411
2015-03-13 10:14:16,189 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073742224_1400, blk_1073742225_1401, blk_1073742226_1402, blk_1073742227_1403, blk_1073742228_1404, blk_1073742223_1399]
2015-03-13 10:14:16,189 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073742224_1400, blk_1073742226_1402, blk_1073742228_1404, blk_1073742223_1399]
2015-03-13 10:14:16,350 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:16,350 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:16,740 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742224_1400 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742224 for deletion
2015-03-13 10:14:16,740 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742225_1401 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742225 for deletion
2015-03-13 10:14:16,740 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742226_1402 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742226 for deletion
2015-03-13 10:14:16,740 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742227_1403 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742227 for deletion
2015-03-13 10:14:16,740 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742224_1400 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742224
2015-03-13 10:14:16,741 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742225_1401 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742225
2015-03-13 10:14:16,741 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742228_1404 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742228 for deletion
2015-03-13 10:14:16,741 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742223_1399 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742223 for deletion
2015-03-13 10:14:16,741 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742226_1402 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742226
2015-03-13 10:14:16,741 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742227_1403 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742227
2015-03-13 10:14:16,742 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742228_1404 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742228
2015-03-13 10:14:16,742 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742223_1399 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742223
2015-03-13 10:14:16,949 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742224_1400 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742224 for deletion
2015-03-13 10:14:16,949 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742226_1402 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742226 for deletion
2015-03-13 10:14:16,950 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742228_1404 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742228 for deletion
2015-03-13 10:14:16,950 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742224_1400 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742224
2015-03-13 10:14:16,950 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742223_1399 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742223 for deletion
2015-03-13 10:14:16,950 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742226_1402 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742226
2015-03-13 10:14:16,950 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742223_1399 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742223
2015-03-13 10:14:16,950 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742228_1404 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742228
2015-03-13 10:14:17,003 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0034_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:14:17,003 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0034	CONTAINERID=container_1426266260362_0034_01_000002
2015-03-13 10:14:17,003 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0034_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:14:17,004 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0034 container=Container: [ContainerId: container_1426266260362_0034_01_000002, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0034_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:17,004 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:14:17,004 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:17,004 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0034_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:14:17,004 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0034	CONTAINERID=container_1426266260362_0034_01_000003
2015-03-13 10:14:17,004 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0034_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:14:17,005 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0034 container=Container: [ContainerId: container_1426266260362_0034_01_000003, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0034_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:17,005 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:14:17,005 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:17,005 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0034_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:14:17,005 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0034	CONTAINERID=container_1426266260362_0034_01_000004
2015-03-13 10:14:17,005 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0034_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:14:17,006 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0034 container=Container: [ContainerId: container_1426266260362_0034_01_000004, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0034_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:17,006 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:14:17,006 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:17,006 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0034_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:14:17,006 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0034	CONTAINERID=container_1426266260362_0034_01_000005
2015-03-13 10:14:17,007 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0034_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:14:17,007 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0034 container=Container: [ContainerId: container_1426266260362_0034_01_000005, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0034_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:17,007 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:14:17,007 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:17,152 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742237_1413
2015-03-13 10:14:17,153 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742236_1412
2015-03-13 10:14:17,195 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0034_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:14:17,195 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0034	CONTAINERID=container_1426266260362_0034_01_000006
2015-03-13 10:14:17,196 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0034_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:14:17,196 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0034 container=Container: [ContainerId: container_1426266260362_0034_01_000006, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0034_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:17,196 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7
2015-03-13 10:14:17,196 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:17,269 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0033_01_000001 succeeded 
2015-03-13 10:14:17,269 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:14:17,269 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0033_01_000001
2015-03-13 10:14:17,278 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000001
2015-03-13 10:14:17,278 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000001
2015-03-13 10:14:17,278 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0033	CONTAINERID=container_1426266260362_0033_01_000001
2015-03-13 10:14:17,278 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:14:17,278 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0033_01_000001 from application application_1426266260362_0033
2015-03-13 10:14:17,278 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:14:17,278 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0033
2015-03-13 10:14:17,278 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000001
2015-03-13 10:14:17,278 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000001
2015-03-13 10:14:17,354 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:14:17,354 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0033_01_000001
2015-03-13 10:14:17,354 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:17,354 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0033_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:14:17,354 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0033_000001
2015-03-13 10:14:17,354 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0033_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:14:17,355 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0033_000001 State change from FINISHING to FINISHED
2015-03-13 10:14:17,355 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0033	CONTAINERID=container_1426266260362_0033_01_000001
2015-03-13 10:14:17,355 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0033 State change from FINISHING to FINISHED
2015-03-13 10:14:17,355 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0033_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:14:17,355 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:7168, vCores:6> numContainers=6 user=soberoi user-resources=<memory:7168, vCores:6>
2015-03-13 10:14:17,355 INFO  amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0033_000001
2015-03-13 10:14:17,355 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1426266260362_0033
2015-03-13 10:14:17,355 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0033_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:17,355 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0033,name=[2C202E1F11CB4F72A241D80B1FC5F547/2FBAD5263615431A999A5D504C8EA30E] lhs*rhs/(2/2),user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0033/jobhistory/job/job_1426266260362_0033,appMasterHost=Edinburgh.local,startTime=1426266830871,finishTime=1426266851120,finalStatus=SUCCEEDED
2015-03-13 10:14:17,355 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:17,355 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6
2015-03-13 10:14:17,355 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0033_000001 released container container_1426266260362_0033_01_000001 on node: host: 10.1.1.144:60723 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:14:17,356 INFO  capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0033_000001 is done. finalState=FINISHED
2015-03-13 10:14:17,356 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0033 requests cleared
2015-03-13 10:14:17,356 INFO  capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0033 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:14:17,356 INFO  capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0033 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:14:17,356 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742233_1409
2015-03-13 10:14:17,356 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742234_1410
2015-03-13 10:14:17,357 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742235_1411
2015-03-13 10:14:17,357 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0033_000001 (auth:SIMPLE)
2015-03-13 10:14:17,358 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0033_01_000001
2015-03-13 10:14:17,488 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742237_1413
2015-03-13 10:14:17,517 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0034_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:14:17,517 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0034_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:14:17,517 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0034_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:14:17,517 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0034_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:14:17,518 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0034_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:14:17,553 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.jar	dst=null	perm=null
2015-03-13 10:14:17,554 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.jar	dst=null	perm=null
2015-03-13 10:14:17,563 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.xml	dst=null	perm=null
2015-03-13 10:14:17,564 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.xml	dst=null	perm=null
2015-03-13 10:14:17,566 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:14:17,567 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:14:17,573 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:14:17,574 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:14:17,575 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:14:17,576 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:14:17,650 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0034_000001 (auth:SIMPLE)
2015-03-13 10:14:17,650 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0034_000001 (auth:SIMPLE)
2015-03-13 10:14:17,653 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0034_01_000006 by user soberoi
2015-03-13 10:14:17,653 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0034_01_000003 by user soberoi
2015-03-13 10:14:17,654 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0034
2015-03-13 10:14:17,654 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0034_01_000005 by user soberoi
2015-03-13 10:14:17,654 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0034	CONTAINERID=container_1426266260362_0034_01_000003
2015-03-13 10:14:17,653 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0034
2015-03-13 10:14:17,654 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0034 transitioned from NEW to INITING
2015-03-13 10:14:17,654 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0034	CONTAINERID=container_1426266260362_0034_01_000005
2015-03-13 10:14:17,654 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0034_01_000004 by user soberoi
2015-03-13 10:14:17,654 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0034 transitioned from NEW to INITING
2015-03-13 10:14:17,655 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0034	CONTAINERID=container_1426266260362_0034_01_000004
2015-03-13 10:14:17,654 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0034_01_000002 by user soberoi
2015-03-13 10:14:17,655 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0034	CONTAINERID=container_1426266260362_0034_01_000002
2015-03-13 10:14:17,655 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0034_01_000006 to application application_1426266260362_0034
2015-03-13 10:14:17,655 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0034 transitioned from INITING to RUNNING
2015-03-13 10:14:17,656 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0034_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:14:17,656 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0034
2015-03-13 10:14:17,656 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0034
2015-03-13 10:14:17,656 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:14:17,656 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0034
2015-03-13 10:14:17,654 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0034_01_000003 to application application_1426266260362_0034
2015-03-13 10:14:17,656 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:14:17,656 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:14:17,654 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0034	CONTAINERID=container_1426266260362_0034_01_000006
2015-03-13 10:14:17,656 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0034_01_000006
2015-03-13 10:14:17,656 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0034_01_000005 to application application_1426266260362_0034
2015-03-13 10:14:17,657 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0034_01_000004 to application application_1426266260362_0034
2015-03-13 10:14:17,657 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0034_01_000002 to application application_1426266260362_0034
2015-03-13 10:14:17,657 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0034 transitioned from INITING to RUNNING
2015-03-13 10:14:17,657 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0034_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:14:17,657 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0034_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:14:17,657 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0034_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:14:17,658 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0034_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:14:17,658 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0034
2015-03-13 10:14:17,658 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0034
2015-03-13 10:14:17,658 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:14:17,658 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0034
2015-03-13 10:14:17,658 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:14:17,658 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:14:17,658 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0034
2015-03-13 10:14:17,658 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0034
2015-03-13 10:14:17,658 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:14:17,658 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0034
2015-03-13 10:14:17,659 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0034
2015-03-13 10:14:17,659 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0034
2015-03-13 10:14:17,659 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:14:17,659 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0034
2015-03-13 10:14:17,659 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0034
2015-03-13 10:14:17,659 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0034
2015-03-13 10:14:17,659 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:14:17,659 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0034
2015-03-13 10:14:17,659 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0034_01_000003
2015-03-13 10:14:17,660 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0034_01_000005
2015-03-13 10:14:17,660 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0034_01_000002
2015-03-13 10:14:17,661 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0034_01_000004
2015-03-13 10:14:17,683 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426266260362_0034_01_000006.tokens. Credentials list: 
2015-03-13 10:14:17,683 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1426266260362_0034_01_000003.tokens. Credentials list: 
2015-03-13 10:14:17,684 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0034_01_000002.tokens. Credentials list: 
2015-03-13 10:14:17,690 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0034_01_000004.tokens. Credentials list: 
2015-03-13 10:14:17,690 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0034_01_000005.tokens. Credentials list: 
2015-03-13 10:14:17,702 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:14:17,703 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:14:17,776 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426266260362_0034_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0034/container_1426266260362_0034_01_000006.tokens
2015-03-13 10:14:17,776 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1426266260362_0034_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0034/container_1426266260362_0034_01_000003.tokens
2015-03-13 10:14:17,776 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0034 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0034
2015-03-13 10:14:17,776 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0034 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0034
2015-03-13 10:14:17,844 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.jar	dst=null	perm=null
2015-03-13 10:14:17,845 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.jar	dst=null	perm=null
2015-03-13 10:14:17,846 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.jar	dst=null	perm=null
2015-03-13 10:14:17,846 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.jar	dst=null	perm=null
2015-03-13 10:14:17,846 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.jar	dst=null	perm=null
2015-03-13 10:14:17,847 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.jar	dst=null	perm=null
2015-03-13 10:14:17,854 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63815, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1314223018_18354, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742233_1409, duration: 512000
2015-03-13 10:14:17,854 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63814, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_583988668_18355, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742233_1409, duration: 516000
2015-03-13 10:14:17,873 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:14:17,873 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:14:17,891 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.xml	dst=null	perm=null
2015-03-13 10:14:17,891 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.xml	dst=null	perm=null
2015-03-13 10:14:17,892 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.xml	dst=null	perm=null
2015-03-13 10:14:17,892 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.xml	dst=null	perm=null
2015-03-13 10:14:17,893 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.xml	dst=null	perm=null
2015-03-13 10:14:17,893 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.xml	dst=null	perm=null
2015-03-13 10:14:17,895 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742233_1409
2015-03-13 10:14:17,895 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742237_1413
2015-03-13 10:14:17,899 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63816, bytes: 99010, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1314223018_18354, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742236_1412, duration: 292000
2015-03-13 10:14:17,899 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63817, bytes: 99010, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_583988668_18355, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742236_1412, duration: 250000
2015-03-13 10:14:17,913 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:14:17,913 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0034_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:14:17,913 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0034_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:14:17,913 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0034_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:14:17,913 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:14:17,914 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0034_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:14:17,914 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0034_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:14:17,965 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0034_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:14:17,965 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:14:17,972 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0034_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:14:17,972 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:14:17,972 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0034_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:14:17,972 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:14:17,973 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0034_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:14:17,973 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:14:17,973 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0034_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:14:17,973 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:14:18,004 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:18,004 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:18,004 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:18,004 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:18,005 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0034_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:14:18,005 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0034_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:14:18,005 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0034_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:14:18,005 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0033 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:14:18,005 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0034_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:14:18,005 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0033
2015-03-13 10:14:18,005 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0033
2015-03-13 10:14:18,006 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0033
2015-03-13 10:14:18,006 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0033
2015-03-13 10:14:18,006 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0033 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:14:18,006 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0033, with delay of 10800 seconds
2015-03-13 10:14:18,006 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0033
2015-03-13 10:14:18,102 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0034/container_1426266260362_0034_01_000003/default_container_executor.sh]
2015-03-13 10:14:18,110 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0034/container_1426266260362_0034_01_000004/default_container_executor.sh]
2015-03-13 10:14:18,110 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0034/container_1426266260362_0034_01_000002/default_container_executor.sh]
2015-03-13 10:14:18,110 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0034/container_1426266260362_0034_01_000005/default_container_executor.sh]
2015-03-13 10:14:18,138 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0034/container_1426266260362_0034_01_000006/default_container_executor.sh]
2015-03-13 10:14:18,195 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:18,196 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0033 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:14:18,196 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0034_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:14:18,196 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0033
2015-03-13 10:14:18,196 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0033
2015-03-13 10:14:18,196 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0033
2015-03-13 10:14:18,196 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0033 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:14:18,196 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0033
2015-03-13 10:14:18,196 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0033
2015-03-13 10:14:18,196 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0033, with delay of 10800 seconds
2015-03-13 10:14:18,355 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:18,355 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0033 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:14:18,355 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0033
2015-03-13 10:14:18,356 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0033 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:14:18,356 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0033, with delay of 10800 seconds
2015-03-13 10:14:18,356 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0033
2015-03-13 10:14:18,357 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0033
2015-03-13 10:14:18,357 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0033
2015-03-13 10:14:18,357 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0033
2015-03-13 10:14:18,532 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:14:18,944 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:14:19,007 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:19,007 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:19,007 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:19,007 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:19,060 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0034_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0034/container_1426266260362_0034_01_000005.tokens
2015-03-13 10:14:19,060 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0034 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0034
2015-03-13 10:14:19,163 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:14:19,200 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:19,278 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0034_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0034/container_1426266260362_0034_01_000004.tokens
2015-03-13 10:14:19,278 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0034 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0034
2015-03-13 10:14:19,357 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:19,375 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:14:19,501 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0034_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0034/container_1426266260362_0034_01_000002.tokens
2015-03-13 10:14:19,501 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0034 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0034
2015-03-13 10:14:20,011 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:20,011 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:20,011 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:20,012 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:20,201 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:20,361 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:21,016 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:21,017 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:21,017 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:21,017 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:21,202 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:21,365 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:22,020 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:22,021 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:22,021 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:22,021 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:22,206 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:22,366 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:23,021 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:23,022 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:23,022 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:23,022 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:23,211 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:23,367 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:24,027 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:24,028 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:24,028 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:24,028 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:24,215 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:24,367 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:25,029 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:25,030 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:25,030 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:25,030 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:25,216 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:25,368 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:25,805 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.split	dst=null	perm=null
2015-03-13 10:14:25,932 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63827, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0034_m_000003_0_-652180790_1, offset: 1024, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742234_1410, duration: 147000
2015-03-13 10:14:26,005 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.split	dst=null	perm=null
2015-03-13 10:14:26,031 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:26,032 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:26,032 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:26,032 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:26,172 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:14:26,176 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.split	dst=null	perm=null
2015-03-13 10:14:26,176 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63832, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0034_m_000003_0_-652180790_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 153000
2015-03-13 10:14:26,185 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.split	dst=null	perm=null
2015-03-13 10:14:26,222 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:26,225 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.split	dst=null	perm=null
2015-03-13 10:14:26,240 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63830, bytes: 1282, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0034_m_000002_0_-1166764790_1, offset: 512, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742234_1410, duration: 158000
2015-03-13 10:14:26,242 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/1/_temporary/attempt_1426266260362_0034_m_000003_0/part-00003	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:14:26,356 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63834, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0034_m_000000_0_1961189984_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742234_1410, duration: 139000
2015-03-13 10:14:26,369 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63835, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0034_m_000001_0_1596725360_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742234_1410, duration: 147000
2015-03-13 10:14:26,369 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:26,411 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63836, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0034_m_000004_0_-333030190_1, offset: 1024, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742234_1410, duration: 154000
2015-03-13 10:14:26,414 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:14:26,417 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63830, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0034_m_000002_0_-1166764790_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 149000
2015-03-13 10:14:26,439 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/1/_temporary/attempt_1426266260362_0034_m_000002_0/part-00002	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:14:26,489 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:14:26,491 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:14:26,502 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63837, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0034_m_000001_0_1596725360_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 157000
2015-03-13 10:14:26,509 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/1/_temporary/attempt_1426266260362_0034_m_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:14:26,519 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:14:26,523 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63838, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0034_m_000004_0_-333030190_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 153000
2015-03-13 10:14:26,525 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/1/_temporary/attempt_1426266260362_0034_m_000001_0/part-00001	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:14:26,561 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/1/_temporary/attempt_1426266260362_0034_m_000004_0/part-00004	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:14:26,667 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D	dst=null	perm=null
2015-03-13 10:14:26,672 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D	dst=null	perm=null
2015-03-13 10:14:26,674 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D	dst=null	perm=null
2015-03-13 10:14:26,710 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D/part-00000	dst=null	perm=null
2015-03-13 10:14:26,711 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D/part-00000	dst=null	perm=null
2015-03-13 10:14:26,714 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63839, bytes: 184, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0034_m_000003_0_-652180790_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742229_1405, duration: 153000
2015-03-13 10:14:26,754 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/1/_temporary/attempt_1426266260362_0034_m_000003_0/part-00003. BP-1005356445-10.1.1.144-1426266257849 blk_1073742238_1414{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:14:26,795 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742238_1414 src: /127.0.0.1:63840 dest: /127.0.0.1:60689
2015-03-13 10:14:26,796 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742238_1414 src: /127.0.0.1:63841 dest: /127.0.0.1:60693
2015-03-13 10:14:26,797 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742238_1414 src: /127.0.0.1:63842 dest: /127.0.0.1:60686
2015-03-13 10:14:26,805 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63842, dest: /127.0.0.1:60686, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0034_m_000003_0_-652180790_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742238_1414, duration: 6431000
2015-03-13 10:14:26,805 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742238_1414, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:14:26,806 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742238_1414{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:14:26,806 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63841, dest: /127.0.0.1:60693, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0034_m_000003_0_-652180790_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742238_1414, duration: 7246000
2015-03-13 10:14:26,806 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742238_1414, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:26,807 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63840, dest: /127.0.0.1:60689, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0034_m_000003_0_-652180790_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742238_1414, duration: 8000000
2015-03-13 10:14:26,807 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742238_1414{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:14:26,807 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742238_1414, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:26,807 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742238_1414{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:14:26,811 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/1/_temporary/attempt_1426266260362_0034_m_000003_0/part-00003 is closed by DFSClient_attempt_1426266260362_0034_m_000003_0_-652180790_1
2015-03-13 10:14:26,820 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/1/_temporary/attempt_1426266260362_0034_m_000003_0	dst=null	perm=null
2015-03-13 10:14:26,826 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/1/_temporary/attempt_1426266260362_0034_m_000003_0	dst=null	perm=null
2015-03-13 10:14:26,827 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/1/task_1426266260362_0034_m_000003	dst=null	perm=null
2015-03-13 10:14:26,831 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/1/_temporary/attempt_1426266260362_0034_m_000003_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/1/task_1426266260362_0034_m_000003	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:14:26,852 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0034_01_000005
2015-03-13 10:14:26,852 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0034	CONTAINERID=container_1426266260362_0034_01_000005
2015-03-13 10:14:26,852 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0034_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:14:26,853 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0034_01_000005
2015-03-13 10:14:26,853 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:26,853 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:26,853 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:26,853 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:14:26,865 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0034_01_000005 is : 143
2015-03-13 10:14:26,867 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job_1426266260362_0034_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073742239_1415{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:14:26,869 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742239_1415 src: /127.0.0.1:63843 dest: /127.0.0.1:60689
2015-03-13 10:14:26,870 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742239_1415 src: /127.0.0.1:63844 dest: /127.0.0.1:60686
2015-03-13 10:14:26,871 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742239_1415 src: /127.0.0.1:63845 dest: /127.0.0.1:60696
2015-03-13 10:14:26,875 INFO  hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job_1426266260362_0034_1.jhist for DFSClient_NONMAPREDUCE_772751086_1
2015-03-13 10:14:26,877 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0034_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:14:26,878 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0034/container_1426266260362_0034_01_000005
2015-03-13 10:14:26,878 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0034/container_1426266260362_0034_01_000005
2015-03-13 10:14:26,878 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0034	CONTAINERID=container_1426266260362_0034_01_000005
2015-03-13 10:14:26,878 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0034_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:14:26,878 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0034_01_000005 from application application_1426266260362_0034
2015-03-13 10:14:26,878 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0034/container_1426266260362_0034_01_000005
2015-03-13 10:14:26,878 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0034/container_1426266260362_0034_01_000005
2015-03-13 10:14:26,878 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:14:26,880 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0034
2015-03-13 10:14:26,898 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D	dst=null	perm=null
2015-03-13 10:14:26,903 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D	dst=null	perm=null
2015-03-13 10:14:26,906 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D	dst=null	perm=null
2015-03-13 10:14:26,943 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D/part-00000	dst=null	perm=null
2015-03-13 10:14:26,944 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D/part-00000	dst=null	perm=null
2015-03-13 10:14:26,947 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63846, bytes: 184, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0034_m_000002_0_-1166764790_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742229_1405, duration: 160000
2015-03-13 10:14:26,981 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D	dst=null	perm=null
2015-03-13 10:14:26,983 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D	dst=null	perm=null
2015-03-13 10:14:26,987 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D	dst=null	perm=null
2015-03-13 10:14:26,988 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D	dst=null	perm=null
2015-03-13 10:14:26,988 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D	dst=null	perm=null
2015-03-13 10:14:26,990 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D	dst=null	perm=null
2015-03-13 10:14:26,991 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D	dst=null	perm=null
2015-03-13 10:14:26,994 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D	dst=null	perm=null
2015-03-13 10:14:26,996 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D	dst=null	perm=null
2015-03-13 10:14:27,006 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/1/_temporary/attempt_1426266260362_0034_m_000002_0/part-00002. BP-1005356445-10.1.1.144-1426266257849 blk_1073742240_1416{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:14:27,018 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D/part-00000	dst=null	perm=null
2015-03-13 10:14:27,019 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D/part-00000	dst=null	perm=null
2015-03-13 10:14:27,022 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63848, bytes: 184, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0034_m_000001_0_1596725360_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742229_1405, duration: 149000
2015-03-13 10:14:27,030 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D/part-00000	dst=null	perm=null
2015-03-13 10:14:27,031 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D/part-00000	dst=null	perm=null
2015-03-13 10:14:27,034 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63836, bytes: 184, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0034_m_000004_0_-333030190_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742229_1405, duration: 149000
2015-03-13 10:14:27,034 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D/part-00000	dst=null	perm=null
2015-03-13 10:14:27,035 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D/part-00000	dst=null	perm=null
2015-03-13 10:14:27,038 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63834, bytes: 184, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0034_m_000000_0_1961189984_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742229_1405, duration: 152000
2015-03-13 10:14:27,047 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742240_1416 src: /127.0.0.1:63847 dest: /127.0.0.1:60686
2015-03-13 10:14:27,049 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742240_1416 src: /127.0.0.1:63849 dest: /127.0.0.1:60689
2015-03-13 10:14:27,050 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742240_1416 src: /127.0.0.1:63850 dest: /127.0.0.1:60693
2015-03-13 10:14:27,057 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63850, dest: /127.0.0.1:60693, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0034_m_000002_0_-1166764790_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742240_1416, duration: 5923000
2015-03-13 10:14:27,058 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742240_1416, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:14:27,058 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63849, dest: /127.0.0.1:60689, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0034_m_000002_0_-1166764790_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742240_1416, duration: 6687000
2015-03-13 10:14:27,059 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742240_1416, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:27,058 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742240_1416{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:14:27,059 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63847, dest: /127.0.0.1:60686, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0034_m_000002_0_-1166764790_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742240_1416, duration: 7728000
2015-03-13 10:14:27,059 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742240_1416, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:27,060 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742240_1416{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:14:27,061 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742240_1416{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:14:27,064 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/1/_temporary/attempt_1426266260362_0034_m_000001_0/part-00001. BP-1005356445-10.1.1.144-1426266257849 blk_1073742241_1417{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:14:27,067 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/1/_temporary/attempt_1426266260362_0034_m_000002_0/part-00002 is closed by DFSClient_attempt_1426266260362_0034_m_000002_0_-1166764790_1
2015-03-13 10:14:27,076 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/1/_temporary/attempt_1426266260362_0034_m_000002_0	dst=null	perm=null
2015-03-13 10:14:27,083 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/1/_temporary/attempt_1426266260362_0034_m_000002_0	dst=null	perm=null
2015-03-13 10:14:27,083 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/1/_temporary/attempt_1426266260362_0034_m_000004_0/part-00004 is closed by DFSClient_attempt_1426266260362_0034_m_000004_0_-333030190_1
2015-03-13 10:14:27,084 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/1/task_1426266260362_0034_m_000002	dst=null	perm=null
2015-03-13 10:14:27,090 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/1/_temporary/attempt_1426266260362_0034_m_000002_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/1/task_1426266260362_0034_m_000002	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:14:27,093 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/1/_temporary/attempt_1426266260362_0034_m_000004_0	dst=null	perm=null
2015-03-13 10:14:27,100 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63852, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0034_m_000000_0_1961189984_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 153000
2015-03-13 10:14:27,105 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742241_1417 src: /127.0.0.1:63851 dest: /127.0.0.1:60689
2015-03-13 10:14:27,106 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742241_1417 src: /127.0.0.1:63853 dest: /127.0.0.1:60693
2015-03-13 10:14:27,107 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742241_1417 src: /127.0.0.1:63854 dest: /127.0.0.1:60696
2015-03-13 10:14:27,109 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0034_01_000004
2015-03-13 10:14:27,109 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0034	CONTAINERID=container_1426266260362_0034_01_000004
2015-03-13 10:14:27,109 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0034_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:14:27,109 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0034_01_000004
2015-03-13 10:14:27,109 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:27,110 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:27,110 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:14:27,110 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:14:27,110 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0034_01_000005
2015-03-13 10:14:27,110 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0034_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:14:27,110 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0034_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:14:27,111 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0034	CONTAINERID=container_1426266260362_0034_01_000005
2015-03-13 10:14:27,111 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0034_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:14:27,111 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:14:27,111 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0034_01_000005, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:27,111 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:27,111 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:14:27,111 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0034_000001 released container container_1426266260362_0034_01_000005 on node: host: 10.1.1.144:60711 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:14:27,123 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0034_01_000004 is : 143
2015-03-13 10:14:27,127 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/1/_temporary/attempt_1426266260362_0034_m_000004_0	dst=null	perm=null
2015-03-13 10:14:27,128 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63854, dest: /127.0.0.1:60696, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0034_m_000001_0_1596725360_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742241_1417, duration: 18661000
2015-03-13 10:14:27,128 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742241_1417, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:14:27,128 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742241_1417{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:14:27,128 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63853, dest: /127.0.0.1:60693, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0034_m_000001_0_1596725360_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742241_1417, duration: 19282000
2015-03-13 10:14:27,128 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742241_1417, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:27,129 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742241_1417{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:14:27,129 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63851, dest: /127.0.0.1:60689, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0034_m_000001_0_1596725360_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742241_1417, duration: 20055000
2015-03-13 10:14:27,129 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742241_1417, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:27,129 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742241_1417{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:14:27,130 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/1/task_1426266260362_0034_m_000004	dst=null	perm=null
2015-03-13 10:14:27,134 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/1/_temporary/attempt_1426266260362_0034_m_000001_0/part-00001 is closed by DFSClient_attempt_1426266260362_0034_m_000001_0_1596725360_1
2015-03-13 10:14:27,134 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/1/_temporary/attempt_1426266260362_0034_m_000004_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/1/task_1426266260362_0034_m_000004	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:14:27,137 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0034_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:14:27,137 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0034/container_1426266260362_0034_01_000004
2015-03-13 10:14:27,137 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0034/container_1426266260362_0034_01_000004
2015-03-13 10:14:27,138 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0034/container_1426266260362_0034_01_000004
2015-03-13 10:14:27,138 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0034/container_1426266260362_0034_01_000004
2015-03-13 10:14:27,138 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0034	CONTAINERID=container_1426266260362_0034_01_000004
2015-03-13 10:14:27,138 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0034_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:14:27,139 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0034_01_000004 from application application_1426266260362_0034
2015-03-13 10:14:27,140 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:14:27,140 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0034
2015-03-13 10:14:27,145 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/1/_temporary/attempt_1426266260362_0034_m_000001_0	dst=null	perm=null
2015-03-13 10:14:27,147 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/1/_temporary/attempt_1426266260362_0034_m_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073742242_1418{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:14:27,149 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0034_01_000006
2015-03-13 10:14:27,149 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0034	CONTAINERID=container_1426266260362_0034_01_000006
2015-03-13 10:14:27,149 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0034_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:14:27,149 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0034_01_000006
2015-03-13 10:14:27,149 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:14:27,153 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/1/_temporary/attempt_1426266260362_0034_m_000001_0	dst=null	perm=null
2015-03-13 10:14:27,155 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/1/task_1426266260362_0034_m_000001	dst=null	perm=null
2015-03-13 10:14:27,161 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/1/_temporary/attempt_1426266260362_0034_m_000001_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/1/task_1426266260362_0034_m_000001	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:14:27,161 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0034_01_000006 is : 143
2015-03-13 10:14:27,172 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0034_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:14:27,173 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0034/container_1426266260362_0034_01_000006
2015-03-13 10:14:27,173 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0034/container_1426266260362_0034_01_000006
2015-03-13 10:14:27,173 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0034	CONTAINERID=container_1426266260362_0034_01_000006
2015-03-13 10:14:27,173 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0034_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:14:27,173 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0034_01_000006 from application application_1426266260362_0034
2015-03-13 10:14:27,173 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:14:27,174 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0034
2015-03-13 10:14:27,173 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0034/container_1426266260362_0034_01_000006
2015-03-13 10:14:27,173 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0034/container_1426266260362_0034_01_000006
2015-03-13 10:14:27,179 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0034_01_000003
2015-03-13 10:14:27,179 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0034	CONTAINERID=container_1426266260362_0034_01_000003
2015-03-13 10:14:27,179 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0034_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:14:27,179 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:27,179 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0034_01_000003
2015-03-13 10:14:27,179 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:14:27,179 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:14:27,180 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0034_01_000004
2015-03-13 10:14:27,180 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0034_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:14:27,180 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0034_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:14:27,180 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0034	CONTAINERID=container_1426266260362_0034_01_000004
2015-03-13 10:14:27,180 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0034_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:14:27,180 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:14:27,180 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0034_01_000004, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:27,180 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:27,181 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:14:27,181 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0034_000001 released container container_1426266260362_0034_01_000004 on node: host: 10.1.1.144:60711 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:14:27,192 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0034_01_000003 is : 143
2015-03-13 10:14:27,203 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0034_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:14:27,203 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742242_1418 src: /127.0.0.1:63855 dest: /127.0.0.1:60696
2015-03-13 10:14:27,203 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0034/container_1426266260362_0034_01_000003
2015-03-13 10:14:27,203 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0034/container_1426266260362_0034_01_000003
2015-03-13 10:14:27,204 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0034	CONTAINERID=container_1426266260362_0034_01_000003
2015-03-13 10:14:27,204 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0034/container_1426266260362_0034_01_000003
2015-03-13 10:14:27,204 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0034/container_1426266260362_0034_01_000003
2015-03-13 10:14:27,204 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0034_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:14:27,204 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742242_1418 src: /127.0.0.1:63856 dest: /127.0.0.1:60686
2015-03-13 10:14:27,205 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0034_01_000003 from application application_1426266260362_0034
2015-03-13 10:14:27,205 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:14:27,206 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0034
2015-03-13 10:14:27,206 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742242_1418 src: /127.0.0.1:63857 dest: /127.0.0.1:60689
2015-03-13 10:14:27,212 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63857, dest: /127.0.0.1:60689, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0034_m_000000_0_1961189984_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742242_1418, duration: 4959000
2015-03-13 10:14:27,212 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742242_1418, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:14:27,213 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742242_1418{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:14:27,213 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63856, dest: /127.0.0.1:60686, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0034_m_000000_0_1961189984_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742242_1418, duration: 5488000
2015-03-13 10:14:27,213 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742242_1418, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:27,213 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742242_1418{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:14:27,214 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63855, dest: /127.0.0.1:60696, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0034_m_000000_0_1961189984_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742242_1418, duration: 6293000
2015-03-13 10:14:27,214 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742242_1418, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:27,214 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742242_1418{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:14:27,218 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/1/_temporary/attempt_1426266260362_0034_m_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0034_m_000000_0_1961189984_1
2015-03-13 10:14:27,226 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/1/_temporary/attempt_1426266260362_0034_m_000000_0	dst=null	perm=null
2015-03-13 10:14:27,232 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/1/_temporary/attempt_1426266260362_0034_m_000000_0	dst=null	perm=null
2015-03-13 10:14:27,233 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/1/task_1426266260362_0034_m_000000	dst=null	perm=null
2015-03-13 10:14:27,236 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/1/_temporary/attempt_1426266260362_0034_m_000000_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/1/task_1426266260362_0034_m_000000	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:14:27,247 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0034_01_000002
2015-03-13 10:14:27,247 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0034	CONTAINERID=container_1426266260362_0034_01_000002
2015-03-13 10:14:27,248 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:27,248 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:14:27,248 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0034_01_000003
2015-03-13 10:14:27,248 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0034_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:14:27,248 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0034_01_000002
2015-03-13 10:14:27,249 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0034_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:14:27,249 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0034_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:14:27,249 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0034	CONTAINERID=container_1426266260362_0034_01_000003
2015-03-13 10:14:27,249 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0034_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:14:27,249 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:14:27,249 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0034_01_000003, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:27,249 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:27,249 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:14:27,249 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0034_000001 released container container_1426266260362_0034_01_000003 on node: host: 10.1.1.144:60711 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:14:27,252 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:14:27,255 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_772751086_1
2015-03-13 10:14:27,259 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/1	dst=null	perm=null
2015-03-13 10:14:27,261 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0034_01_000002 is : 143
2015-03-13 10:14:27,265 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby	dst=null	perm=null
2015-03-13 10:14:27,266 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby	dst=null	perm=null
2015-03-13 10:14:27,268 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/1/task_1426266260362_0034_m_000000	dst=null	perm=null
2015-03-13 10:14:27,270 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/part-00000	dst=null	perm=null
2015-03-13 10:14:27,272 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0034_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:14:27,273 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0034/container_1426266260362_0034_01_000002
2015-03-13 10:14:27,273 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0034	CONTAINERID=container_1426266260362_0034_01_000002
2015-03-13 10:14:27,273 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0034_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:14:27,273 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0034_01_000002 from application application_1426266260362_0034
2015-03-13 10:14:27,273 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:14:27,273 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/1/task_1426266260362_0034_m_000000/part-00000	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/part-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:14:27,273 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0034/container_1426266260362_0034_01_000002
2015-03-13 10:14:27,273 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0034/container_1426266260362_0034_01_000002
2015-03-13 10:14:27,273 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0034/container_1426266260362_0034_01_000002
2015-03-13 10:14:27,273 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0034
2015-03-13 10:14:27,277 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby	dst=null	perm=null
2015-03-13 10:14:27,278 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby	dst=null	perm=null
2015-03-13 10:14:27,279 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/1/task_1426266260362_0034_m_000001	dst=null	perm=null
2015-03-13 10:14:27,281 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/part-00001	dst=null	perm=null
2015-03-13 10:14:27,282 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/1/task_1426266260362_0034_m_000001/part-00001	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/part-00001	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:14:27,284 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby	dst=null	perm=null
2015-03-13 10:14:27,285 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby	dst=null	perm=null
2015-03-13 10:14:27,287 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/1/task_1426266260362_0034_m_000002	dst=null	perm=null
2015-03-13 10:14:27,288 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/part-00002	dst=null	perm=null
2015-03-13 10:14:27,290 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/1/task_1426266260362_0034_m_000002/part-00002	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/part-00002	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:14:27,291 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby	dst=null	perm=null
2015-03-13 10:14:27,292 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby	dst=null	perm=null
2015-03-13 10:14:27,293 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/1/task_1426266260362_0034_m_000003	dst=null	perm=null
2015-03-13 10:14:27,295 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/part-00003	dst=null	perm=null
2015-03-13 10:14:27,296 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/1/task_1426266260362_0034_m_000003/part-00003	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/part-00003	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:14:27,297 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby	dst=null	perm=null
2015-03-13 10:14:27,299 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby	dst=null	perm=null
2015-03-13 10:14:27,300 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/1/task_1426266260362_0034_m_000004	dst=null	perm=null
2015-03-13 10:14:27,301 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/part-00004	dst=null	perm=null
2015-03-13 10:14:27,303 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/1/task_1426266260362_0034_m_000004/part-00004	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/part-00004	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:14:27,307 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/_temporary	dst=null	perm=null
2015-03-13 10:14:27,310 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:14:27,312 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/_SUCCESS is closed by DFSClient_NONMAPREDUCE_772751086_1
2015-03-13 10:14:27,314 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:14:27,315 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_772751086_1
2015-03-13 10:14:27,330 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63845, dest: /127.0.0.1:60696, bytes: 53304, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_772751086_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742239_1415, duration: 456595000
2015-03-13 10:14:27,330 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742239_1415, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:14:27,331 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742239_1415{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:14:27,331 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63844, dest: /127.0.0.1:60686, bytes: 53304, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_772751086_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742239_1415, duration: 457769000
2015-03-13 10:14:27,331 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742239_1415, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:27,332 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742239_1415{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:14:27,332 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63843, dest: /127.0.0.1:60689, bytes: 53304, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_772751086_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742239_1415, duration: 459255000
2015-03-13 10:14:27,332 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742239_1415, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:27,333 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742239_1415{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:14:27,334 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job_1426266260362_0034_1.jhist is closed by DFSClient_NONMAPREDUCE_772751086_1
2015-03-13 10:14:27,336 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0034.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:14:27,339 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0034.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742243_1419{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:14:27,340 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742243_1419 src: /127.0.0.1:63858 dest: /127.0.0.1:60693
2015-03-13 10:14:27,341 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742243_1419 src: /127.0.0.1:63859 dest: /127.0.0.1:60686
2015-03-13 10:14:27,343 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742243_1419 src: /127.0.0.1:63860 dest: /127.0.0.1:60689
2015-03-13 10:14:27,345 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63860, dest: /127.0.0.1:60689, bytes: 436, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_772751086_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742243_1419, duration: 1017000
2015-03-13 10:14:27,345 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742243_1419, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:14:27,345 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742243_1419{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:14:27,345 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63859, dest: /127.0.0.1:60686, bytes: 436, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_772751086_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742243_1419, duration: 1497000
2015-03-13 10:14:27,345 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742243_1419, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:27,346 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742243_1419{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:14:27,346 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63858, dest: /127.0.0.1:60693, bytes: 436, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_772751086_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742243_1419, duration: 2151000
2015-03-13 10:14:27,346 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742243_1419, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:27,347 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742243_1419{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:14:27,348 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0034.summary_tmp is closed by DFSClient_NONMAPREDUCE_772751086_1
2015-03-13 10:14:27,350 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0034.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:14:27,354 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job_1426266260362_0034_1.jhist	dst=null	perm=null
2015-03-13 10:14:27,355 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0034-1426266852273-soberoi-%5B2C202E1F11CB4F72A241D80B1FC5F547%2FEE2F3C2ED5D34A1D-1426266867317-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:14:27,358 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job_1426266260362_0034_1.jhist	dst=null	perm=null
2015-03-13 10:14:27,359 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0034-1426266852273-soberoi-%5B2C202E1F11CB4F72A241D80B1FC5F547%2FEE2F3C2ED5D34A1D-1426266867317-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:14:27,359 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job_1426266260362_0034_1.jhist	dst=null	perm=null
2015-03-13 10:14:27,361 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0034-1426266852273-soberoi-%5B2C202E1F11CB4F72A241D80B1FC5F547%2FEE2F3C2ED5D34A1D-1426266867317-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:14:27,363 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63861, bytes: 53724, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_772751086_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742239_1415, duration: 161000
2015-03-13 10:14:27,365 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0034-1426266852273-soberoi-%5B2C202E1F11CB4F72A241D80B1FC5F547%2FEE2F3C2ED5D34A1D-1426266867317-5-0-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742244_1420{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:14:27,366 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742244_1420 src: /127.0.0.1:63862 dest: /127.0.0.1:60689
2015-03-13 10:14:27,367 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742244_1420 src: /127.0.0.1:63863 dest: /127.0.0.1:60696
2015-03-13 10:14:27,368 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742241_1417
2015-03-13 10:14:27,368 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742243_1419
2015-03-13 10:14:27,368 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742240_1416
2015-03-13 10:14:27,369 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742238_1414
2015-03-13 10:14:27,369 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742244_1420 src: /127.0.0.1:63864 dest: /127.0.0.1:60693
2015-03-13 10:14:27,370 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:27,372 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63864, dest: /127.0.0.1:60693, bytes: 53304, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_772751086_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742244_1420, duration: 1824000
2015-03-13 10:14:27,372 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742244_1420, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:14:27,373 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742244_1420{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:14:27,373 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63863, dest: /127.0.0.1:60696, bytes: 53304, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_772751086_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742244_1420, duration: 2437000
2015-03-13 10:14:27,373 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742244_1420, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:27,374 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63862, dest: /127.0.0.1:60689, bytes: 53304, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_772751086_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742244_1420, duration: 3483000
2015-03-13 10:14:27,374 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742244_1420, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:27,374 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742244_1420{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:14:27,375 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742244_1420{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:14:27,376 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0034-1426266852273-soberoi-%5B2C202E1F11CB4F72A241D80B1FC5F547%2FEE2F3C2ED5D34A1D-1426266867317-5-0-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_772751086_1
2015-03-13 10:14:27,378 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0034-1426266852273-soberoi-%5B2C202E1F11CB4F72A241D80B1FC5F547%2FEE2F3C2ED5D34A1D-1426266867317-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:14:27,379 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job_1426266260362_0034_1_conf.xml	dst=null	perm=null
2015-03-13 10:14:27,380 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0034_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:14:27,381 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job_1426266260362_0034_1_conf.xml	dst=null	perm=null
2015-03-13 10:14:27,382 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0034_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:14:27,383 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job_1426266260362_0034_1_conf.xml	dst=null	perm=null
2015-03-13 10:14:27,385 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0034_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:14:27,387 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63865, bytes: 91757, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_772751086_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742237_1413, duration: 225000
2015-03-13 10:14:27,389 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0034_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742245_1421{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:14:27,391 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742245_1421 src: /127.0.0.1:63866 dest: /127.0.0.1:60689
2015-03-13 10:14:27,393 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742245_1421 src: /127.0.0.1:63867 dest: /127.0.0.1:60686
2015-03-13 10:14:27,394 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742245_1421 src: /127.0.0.1:63868 dest: /127.0.0.1:60696
2015-03-13 10:14:27,397 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63868, dest: /127.0.0.1:60696, bytes: 91045, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_772751086_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742245_1421, duration: 1601000
2015-03-13 10:14:27,397 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742245_1421, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:14:27,398 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742245_1421{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:14:27,398 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63867, dest: /127.0.0.1:60686, bytes: 91045, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_772751086_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742245_1421, duration: 2187000
2015-03-13 10:14:27,398 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742245_1421, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:27,398 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742245_1421{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:14:27,398 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63866, dest: /127.0.0.1:60689, bytes: 91045, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_772751086_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742245_1421, duration: 2914000
2015-03-13 10:14:27,399 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742245_1421, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:27,399 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742245_1421{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:14:27,400 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0034_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_772751086_1
2015-03-13 10:14:27,402 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0034_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:14:27,403 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0034.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0034.summary	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:14:27,404 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0034_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0034_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:14:27,406 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0034-1426266852273-soberoi-%5B2C202E1F11CB4F72A241D80B1FC5F547%2FEE2F3C2ED5D34A1D-1426266867317-5-0-SUCCEEDED-default.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0034-1426266852273-soberoi-%5B2C202E1F11CB4F72A241D80B1FC5F547%2FEE2F3C2ED5D34A1D-1426266867317-5-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:14:27,411 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0034_000001 State change from RUNNING to FINISHING
2015-03-13 10:14:27,411 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0034
2015-03-13 10:14:27,412 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0034 State change from RUNNING to REMOVING
2015-03-13 10:14:27,412 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0034
2015-03-13 10:14:27,412 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0034 State change from REMOVING to FINISHING
2015-03-13 10:14:27,499 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742242_1418
2015-03-13 10:14:27,500 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742239_1415
2015-03-13 10:14:27,500 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742245_1421
2015-03-13 10:14:27,501 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742243_1419
2015-03-13 10:14:27,501 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742238_1414
2015-03-13 10:14:27,501 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742240_1416
2015-03-13 10:14:27,912 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742241_1417
2015-03-13 10:14:27,913 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742244_1420
2015-03-13 10:14:27,913 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742239_1415
2015-03-13 10:14:27,914 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742245_1421
2015-03-13 10:14:27,914 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742242_1418
2015-03-13 10:14:28,153 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:14:28,153 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0034_01_000006
2015-03-13 10:14:28,154 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0034_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:14:28,154 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0034_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:14:28,154 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0034	CONTAINERID=container_1426266260362_0034_01_000006
2015-03-13 10:14:28,154 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0034_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:14:28,155 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:14:28,155 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0034_01_000006, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:28,155 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:28,155 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:14:28,155 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0034_000001 released container container_1426266260362_0034_01_000006 on node: host: 10.1.1.144:60715 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:14:28,249 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:14:28,249 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0034_01_000002
2015-03-13 10:14:28,250 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0034_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:14:28,250 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0034_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:14:28,250 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0034	CONTAINERID=container_1426266260362_0034_01_000002
2015-03-13 10:14:28,250 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0034_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:14:28,250 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:14:28,251 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0034_01_000002, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:28,251 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:28,251 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:14:28,251 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0034_000001 released container container_1426266260362_0034_01_000002 on node: host: 10.1.1.144:60711 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:14:28,371 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:28,419 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742233_1409 127.0.0.1:60689 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60696 
2015-03-13 10:14:28,420 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742234_1410 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60689 127.0.0.1:60686 
2015-03-13 10:14:28,420 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742235_1411 127.0.0.1:60693 127.0.0.1:60689 127.0.0.1:60696 
2015-03-13 10:14:28,420 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742236_1412 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60689 
2015-03-13 10:14:28,420 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742239_1415 127.0.0.1:60689 127.0.0.1:60686 127.0.0.1:60696 
2015-03-13 10:14:28,420 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742237_1413 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60686 
2015-03-13 10:14:28,420 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034	dst=null	perm=null
2015-03-13 10:14:28,449 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742229_1405 127.0.0.1:60686 127.0.0.1:60693 127.0.0.1:60689 
2015-03-13 10:14:28,449 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D	dst=null	perm=null
2015-03-13 10:14:28,450 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby	dst=null	perm=null
2015-03-13 10:14:28,450 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/_temporary
2015-03-13 10:14:28,450 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/_temporary	dst=null	perm=null
2015-03-13 10:14:28,457 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:14:28,457 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:14:28,458 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:14:28,459 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby	dst=null	perm=null
2015-03-13 10:14:28,459 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby	dst=null	perm=null
2015-03-13 10:14:28,460 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby	dst=null	perm=null
2015-03-13 10:14:28,461 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:14:28,461 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/part-00000	dst=null	perm=null
2015-03-13 10:14:28,463 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63870, bytes: 20, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742242_1418, duration: 163000
2015-03-13 10:14:28,464 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/part-00001	dst=null	perm=null
2015-03-13 10:14:28,465 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63870, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742241_1417, duration: 142000
2015-03-13 10:14:28,465 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/part-00002	dst=null	perm=null
2015-03-13 10:14:28,467 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63871, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742240_1416, duration: 133000
2015-03-13 10:14:28,468 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/part-00003	dst=null	perm=null
2015-03-13 10:14:28,469 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63871, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742238_1414, duration: 111000
2015-03-13 10:14:28,469 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/part-00004	dst=null	perm=null
2015-03-13 10:14:28,475 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:14:28,475 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:14:28,476 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:14:28,477 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby	dst=null	perm=null
2015-03-13 10:14:28,477 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby	dst=null	perm=null
2015-03-13 10:14:28,478 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby	dst=null	perm=null
2015-03-13 10:14:28,479 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:14:28,479 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/part-00000	dst=null	perm=null
2015-03-13 10:14:28,481 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63872, bytes: 20, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742242_1418, duration: 178000
2015-03-13 10:14:28,482 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/part-00001	dst=null	perm=null
2015-03-13 10:14:28,483 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63871, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742241_1417, duration: 145000
2015-03-13 10:14:28,483 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/part-00002	dst=null	perm=null
2015-03-13 10:14:28,485 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63873, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742240_1416, duration: 156000
2015-03-13 10:14:28,485 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/part-00003	dst=null	perm=null
2015-03-13 10:14:28,486 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63872, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742238_1414, duration: 151000
2015-03-13 10:14:28,487 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/part-00004	dst=null	perm=null
2015-03-13 10:14:28,487 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby
2015-03-13 10:14:28,488 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby	dst=null	perm=null
2015-03-13 10:14:28,488 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby	dst=null	perm=null
2015-03-13 10:14:28,488 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby	dst=null	perm=null
2015-03-13 10:14:28,489 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby	dst=null	perm=null
2015-03-13 10:14:28,490 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/part-00000	dst=null	perm=null
2015-03-13 10:14:28,490 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/part-00000	dst=null	perm=null
2015-03-13 10:14:28,491 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63872, bytes: 20, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742242_1418, duration: 174000
2015-03-13 10:14:28,492 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/part-00001	dst=null	perm=null
2015-03-13 10:14:28,492 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/part-00001	dst=null	perm=null
2015-03-13 10:14:28,493 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63872, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742241_1417, duration: 171000
2015-03-13 10:14:28,494 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/part-00002	dst=null	perm=null
2015-03-13 10:14:28,494 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/part-00002	dst=null	perm=null
2015-03-13 10:14:28,495 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63873, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742240_1416, duration: 131000
2015-03-13 10:14:28,496 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/part-00003	dst=null	perm=null
2015-03-13 10:14:28,496 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/part-00003	dst=null	perm=null
2015-03-13 10:14:28,497 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63871, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742238_1414, duration: 150000
2015-03-13 10:14:28,498 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/part-00004	dst=null	perm=null
2015-03-13 10:14:28,498 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/part-00004	dst=null	perm=null
2015-03-13 10:14:28,499 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:14:28,500 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:14:28,501 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:14:28,502 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt. BP-1005356445-10.1.1.144-1426266257849 blk_1073742246_1422{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:14:28,503 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742246_1422 src: /127.0.0.1:63874 dest: /127.0.0.1:60686
2015-03-13 10:14:28,504 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742246_1422 src: /127.0.0.1:63875 dest: /127.0.0.1:60693
2015-03-13 10:14:28,505 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742246_1422 src: /127.0.0.1:63876 dest: /127.0.0.1:60689
2015-03-13 10:14:28,507 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63876, dest: /127.0.0.1:60689, bytes: 20, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742246_1422, duration: 902000
2015-03-13 10:14:28,507 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742246_1422, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:14:28,507 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742246_1422{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:14:28,507 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63875, dest: /127.0.0.1:60693, bytes: 20, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742246_1422, duration: 1218000
2015-03-13 10:14:28,507 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742246_1422, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:28,508 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742246_1422{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:14:28,508 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63874, dest: /127.0.0.1:60686, bytes: 20, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742246_1422, duration: 1827000
2015-03-13 10:14:28,508 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742246_1422, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:28,509 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742246_1422{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:14:28,510 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:14:28,510 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.20.txt	dst=null	perm=null
2015-03-13 10:14:28,511 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.20.txt	dst=null	perm=null
2015-03-13 10:14:28,512 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.20.txt	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:14:28,513 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.20.txt. BP-1005356445-10.1.1.144-1426266257849 blk_1073742247_1423{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:14:28,514 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742247_1423 src: /127.0.0.1:63877 dest: /127.0.0.1:60693
2015-03-13 10:14:28,516 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742247_1423 src: /127.0.0.1:63878 dest: /127.0.0.1:60696
2015-03-13 10:14:28,517 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742247_1423 src: /127.0.0.1:63879 dest: /127.0.0.1:60689
2015-03-13 10:14:28,519 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63879, dest: /127.0.0.1:60689, bytes: 51, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742247_1423, duration: 1117000
2015-03-13 10:14:28,520 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742247_1423, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:14:28,520 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742247_1423{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:14:28,520 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63878, dest: /127.0.0.1:60696, bytes: 51, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742247_1423, duration: 1586000
2015-03-13 10:14:28,520 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742247_1423, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:28,520 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742247_1423{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:14:28,521 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63877, dest: /127.0.0.1:60693, bytes: 51, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742247_1423, duration: 2126000
2015-03-13 10:14:28,521 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742247_1423, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:28,522 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742247_1423{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:14:28,523 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.20.txt is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:14:28,538 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:14:28,539 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:14:28,540 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:14:28,556 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinMergeGroupBy/hashjoin	dst=null	perm=null
2015-03-13 10:14:28,557 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [] starting
2015-03-13 10:14:28,557 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - []  source: Hfs["TextLine[['id2']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.20.txt"]
2015-03-13 10:14:28,558 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - []  source: Hfs["TextLine[['id']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt"]
2015-03-13 10:14:28,558 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - []  sink: Hfs["TextDelimited[['id2', 'count']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinMergeGroupBy/hashjoin"]
2015-03-13 10:14:28,558 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - []  parallel execution is enabled: true
2015-03-13 10:14:28,558 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - []  starting jobs: 2
2015-03-13 10:14:28,558 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - []  allocating threads: 2
2015-03-13 10:14:28,559 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [] starting step: (2/2)
2015-03-13 10:14:28,567 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:14:28,579 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:14:28,580 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA	dst=null	perm=null
2015-03-13 10:14:28,580 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:14:28,581 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:14:28,583 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 35
2015-03-13 10:14:28,583 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035	dst=null	perm=null
2015-03-13 10:14:28,584 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035	dst=null	perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:14:28,585 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035	dst=null	perm=soberoi:supergroup:rwx------
2015-03-13 10:14:28,586 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.jar	dst=null	perm=null
2015-03-13 10:14:28,587 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:14:28,589 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073742248_1424{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:14:28,590 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742248_1424 src: /127.0.0.1:63881 dest: /127.0.0.1:60686
2015-03-13 10:14:28,591 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742248_1424 src: /127.0.0.1:63882 dest: /127.0.0.1:60693
2015-03-13 10:14:28,592 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742248_1424 src: /127.0.0.1:63883 dest: /127.0.0.1:60696
2015-03-13 10:14:28,596 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63883, dest: /127.0.0.1:60696, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742248_1424, duration: 2609000
2015-03-13 10:14:28,596 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742248_1424, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:14:28,596 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742248_1424{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:14:28,596 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63882, dest: /127.0.0.1:60693, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742248_1424, duration: 2311000
2015-03-13 10:14:28,597 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742248_1424, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:28,597 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742248_1424{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:14:28,597 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63881, dest: /127.0.0.1:60686, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742248_1424, duration: 3112000
2015-03-13 10:14:28,597 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742248_1424, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:28,598 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742248_1424{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:14:28,599 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:14:28,599 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.jar
2015-03-13 10:14:28,599 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.jar	dst=null	perm=null
2015-03-13 10:14:28,600 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:14:28,601 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:14:28,601 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:14:28,602 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:14:28,602 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:14:28,603 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:14:28,603 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:14:28,604 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:14:28,604 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:14:28,604 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:14:28,606 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:14:28,606 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:14:28,606 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:14:28,608 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:14:28,609 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:14:28,610 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.split
2015-03-13 10:14:28,610 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.split	dst=null	perm=null
2015-03-13 10:14:28,611 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073742249_1425{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:14:28,612 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742249_1425 src: /127.0.0.1:63884 dest: /127.0.0.1:60689
2015-03-13 10:14:28,613 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742249_1425 src: /127.0.0.1:63885 dest: /127.0.0.1:60686
2015-03-13 10:14:28,614 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742249_1425 src: /127.0.0.1:63886 dest: /127.0.0.1:60696
2015-03-13 10:14:28,615 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742249_1425 src: /127.0.0.1:63887 dest: /127.0.0.1:60693
2015-03-13 10:14:28,618 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63887, dest: /127.0.0.1:60693, bytes: 1435, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742249_1425, duration: 1616000
2015-03-13 10:14:28,619 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742249_1425, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:14:28,619 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742249_1425{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:14:28,619 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63886, dest: /127.0.0.1:60696, bytes: 1435, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742249_1425, duration: 2048000
2015-03-13 10:14:28,619 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742249_1425, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:28,620 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742249_1425{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:14:28,620 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63885, dest: /127.0.0.1:60686, bytes: 1435, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742249_1425, duration: 2925000
2015-03-13 10:14:28,620 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742249_1425, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:28,620 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742249_1425{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:14:28,621 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63884, dest: /127.0.0.1:60689, bytes: 1435, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742249_1425, duration: 3768000
2015-03-13 10:14:28,621 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742249_1425, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:28,621 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742249_1425{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:14:28,622 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:14:28,623 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:14:28,625 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:14:28,626 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073742250_1426{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:14:28,627 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742250_1426 src: /127.0.0.1:63888 dest: /127.0.0.1:60696
2015-03-13 10:14:28,628 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742250_1426 src: /127.0.0.1:63889 dest: /127.0.0.1:60689
2015-03-13 10:14:28,630 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742250_1426 src: /127.0.0.1:63890 dest: /127.0.0.1:60693
2015-03-13 10:14:28,636 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63890, dest: /127.0.0.1:60693, bytes: 148, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742250_1426, duration: 1065000
2015-03-13 10:14:28,636 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742250_1426, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:14:28,637 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742250_1426{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:14:28,641 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63889, dest: /127.0.0.1:60689, bytes: 148, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742250_1426, duration: 5472000
2015-03-13 10:14:28,641 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742250_1426, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:28,641 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63888, dest: /127.0.0.1:60696, bytes: 148, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742250_1426, duration: 10164000
2015-03-13 10:14:28,642 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742250_1426, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:28,642 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742250_1426{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:14:28,642 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742250_1426{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:14:28,643 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:14:28,643 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:4
2015-03-13 10:14:28,644 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:14:28,645 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:14:28,646 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:14:28,646 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:14:28,646 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:14:28,649 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742251_1427{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:14:28,650 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742251_1427 src: /127.0.0.1:63891 dest: /127.0.0.1:60696
2015-03-13 10:14:28,651 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742251_1427 src: /127.0.0.1:63892 dest: /127.0.0.1:60693
2015-03-13 10:14:28,652 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742251_1427 src: /127.0.0.1:63893 dest: /127.0.0.1:60686
2015-03-13 10:14:28,655 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63893, dest: /127.0.0.1:60686, bytes: 97446, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742251_1427, duration: 1228000
2015-03-13 10:14:28,655 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742251_1427, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:14:28,655 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742251_1427{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:14:28,655 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63892, dest: /127.0.0.1:60693, bytes: 97446, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742251_1427, duration: 1527000
2015-03-13 10:14:28,655 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742251_1427, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:28,656 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742251_1427{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:14:28,656 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63891, dest: /127.0.0.1:60696, bytes: 97446, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742251_1427, duration: 2138000
2015-03-13 10:14:28,656 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742251_1427, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:28,657 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742251_1427{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:14:28,658 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:14:28,658 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0035
2015-03-13 10:14:28,659 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035	dst=null	perm=null
2015-03-13 10:14:28,659 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.xml	dst=null	perm=null
2015-03-13 10:14:28,660 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.xml	dst=null	perm=null
2015-03-13 10:14:28,660 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.jar	dst=null	perm=null
2015-03-13 10:14:28,661 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.jar	dst=null	perm=null
2015-03-13 10:14:28,661 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.split	dst=null	perm=null
2015-03-13 10:14:28,662 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.split	dst=null	perm=null
2015-03-13 10:14:28,662 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:14:28,662 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:14:28,664 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:14:28,665 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:14:28,665 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:14:28,666 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:14:28,666 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:14:28,667 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:14:28,668 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 35 submitted by user soberoi
2015-03-13 10:14:28,668 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0035
2015-03-13 10:14:28,669 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0035 State change from NEW to NEW_SAVING
2015-03-13 10:14:28,669 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0035
2015-03-13 10:14:28,669 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	IP=10.1.1.144	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1426266260362_0035
2015-03-13 10:14:28,669 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0035 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:14:28,677 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0035_000001
2015-03-13 10:14:28,677 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0035_000001 State change from NEW to SUBMITTED
2015-03-13 10:14:28,677 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0035 from user: soberoi activated in queue: default
2015-03-13 10:14:28,677 INFO  capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0035 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:14:28,677 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0035 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:14:28,677 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0035_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:14:28,677 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0035 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:14:28,678 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0035_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:14:28,678 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0035 State change from SUBMITTED to ACCEPTED
2015-03-13 10:14:28,680 INFO  mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0035/
2015-03-13 10:14:28,680 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [] submitted hadoop job: job_1426266260362_0035
2015-03-13 10:14:28,680 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0035/
2015-03-13 10:14:29,160 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0035_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:14:29,160 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0035	CONTAINERID=container_1426266260362_0035_01_000001
2015-03-13 10:14:29,160 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0035_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:14:29,160 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0035 container=Container: [ContainerId: container_1426266260362_0035_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0035_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:29,161 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:14:29,161 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0035_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:14:29,161 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:29,162 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0035 AttemptId: appattempt_1426266260362_0035_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0035_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ]
2015-03-13 10:14:29,162 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0035_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:14:29,162 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0035_000001
2015-03-13 10:14:29,162 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0035_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:14:29,162 INFO  amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0035_000001
2015-03-13 10:14:29,163 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0035_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] for AM appattempt_1426266260362_0035_000001
2015-03-13 10:14:29,163 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0035_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-03-13 10:14:29,165 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0035_000001 (auth:SIMPLE)
2015-03-13 10:14:29,166 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0035_01_000001 by user soberoi
2015-03-13 10:14:29,166 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0035
2015-03-13 10:14:29,166 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0035	CONTAINERID=container_1426266260362_0035_01_000001
2015-03-13 10:14:29,166 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0035 transitioned from NEW to INITING
2015-03-13 10:14:29,167 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0035_01_000001 to application application_1426266260362_0035
2015-03-13 10:14:29,167 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0035 transitioned from INITING to RUNNING
2015-03-13 10:14:29,167 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0035_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] for AM appattempt_1426266260362_0035_000001
2015-03-13 10:14:29,167 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0035_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:14:29,167 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0035_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:14:29,167 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0035
2015-03-13 10:14:29,167 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:14:29,168 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:14:29,168 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:14:29,168 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:14:29,168 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0035_01_000001
2015-03-13 10:14:29,177 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426266260362_0035_01_000001.tokens. Credentials list: 
2015-03-13 10:14:29,192 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:14:29,258 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426266260362_0035_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0035/container_1426266260362_0035_01_000001.tokens
2015-03-13 10:14:29,258 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0035 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0035
2015-03-13 10:14:29,321 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.jar	dst=null	perm=null
2015-03-13 10:14:29,322 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.jar	dst=null	perm=null
2015-03-13 10:14:29,323 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.jar	dst=null	perm=null
2015-03-13 10:14:29,329 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63871, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1309543797_18784, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742248_1424, duration: 492000
2015-03-13 10:14:29,347 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:14:29,363 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:14:29,363 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:14:29,364 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:14:29,370 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63870, bytes: 152, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1309543797_18784, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742250_1426, duration: 160000
2015-03-13 10:14:29,371 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:29,382 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:14:29,398 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.split	dst=null	perm=null
2015-03-13 10:14:29,398 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.split	dst=null	perm=null
2015-03-13 10:14:29,399 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.split	dst=null	perm=null
2015-03-13 10:14:29,404 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63872, bytes: 1447, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1309543797_18784, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742249_1425, duration: 173000
2015-03-13 10:14:29,416 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:14:29,432 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.xml	dst=null	perm=null
2015-03-13 10:14:29,433 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.xml	dst=null	perm=null
2015-03-13 10:14:29,434 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.xml	dst=null	perm=null
2015-03-13 10:14:29,439 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63873, bytes: 98210, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1309543797_18784, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742251_1427, duration: 290000
2015-03-13 10:14:29,452 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:14:29,452 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0035_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:14:29,477 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0035_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:14:29,477 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:14:29,543 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0035/container_1426266260362_0035_01_000001/default_container_executor.sh]
2015-03-13 10:14:30,161 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 35 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:30,162 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0035_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:14:30,372 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:31,106 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:14:31,128 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/COMMIT_STARTED	dst=null	perm=null
2015-03-13 10:14:31,129 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/COMMIT_SUCCESS	dst=null	perm=null
2015-03-13 10:14:31,130 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/COMMIT_FAIL	dst=null	perm=null
2015-03-13 10:14:31,148 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742240_1416
2015-03-13 10:14:31,149 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742244_1420
2015-03-13 10:14:31,149 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742247_1423
2015-03-13 10:14:31,149 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742245_1421
2015-03-13 10:14:31,149 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742238_1414
2015-03-13 10:14:31,150 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742239_1415
2015-03-13 10:14:31,150 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742242_1418
2015-03-13 10:14:31,150 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742250_1426
2015-03-13 10:14:31,150 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742241_1417
2015-03-13 10:14:31,151 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742249_1425
2015-03-13 10:14:31,151 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742243_1419
2015-03-13 10:14:31,151 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742246_1422
2015-03-13 10:14:31,166 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 35 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:31,187 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035	dst=null	perm=null
2015-03-13 10:14:31,189 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:14:31,190 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:14:31,200 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60686 to replicate blk_1073742248_1424 to datanode(s) 127.0.0.1:60689
2015-03-13 10:14:31,201 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073742229_1405, blk_1073742233_1409, blk_1073742234_1410, blk_1073742235_1411, blk_1073742236_1412, blk_1073742239_1415]
2015-03-13 10:14:31,201 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073742233_1409, blk_1073742234_1410, blk_1073742235_1411, blk_1073742236_1412, blk_1073742237_1413, blk_1073742239_1415]
2015-03-13 10:14:31,375 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:31,473 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:14:31,480 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:14:31,533 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63898, bytes: 152, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-682223200_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742250_1426, duration: 176000
2015-03-13 10:14:31,721 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742229_1405 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742229 for deletion
2015-03-13 10:14:31,721 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742233_1409 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742233 for deletion
2015-03-13 10:14:31,721 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742234_1410 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742234 for deletion
2015-03-13 10:14:31,722 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742235_1411 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir2/blk_1073742235 for deletion
2015-03-13 10:14:31,722 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742236_1412 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742236 for deletion
2015-03-13 10:14:31,722 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742239_1415 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742239 for deletion
2015-03-13 10:14:31,722 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742229_1405 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742229
2015-03-13 10:14:31,722 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742233_1409 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742233
2015-03-13 10:14:31,722 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742234_1410 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742234
2015-03-13 10:14:31,722 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742235_1411 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir2/blk_1073742235
2015-03-13 10:14:31,722 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742236_1412 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742236
2015-03-13 10:14:31,723 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742239_1415 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742239
2015-03-13 10:14:31,754 INFO  datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-1907321454-10.1.1.144-60686-1426266259166, infoPort=60687, ipcPort=60688, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073742248_1424 to 127.0.0.1:60689 
2015-03-13 10:14:31,756 INFO  datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073742248_1424 (numBytes=254067) to /127.0.0.1:60689
2015-03-13 10:14:31,757 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742248_1424 src: /127.0.0.1:63901 dest: /127.0.0.1:60689
2015-03-13 10:14:31,759 INFO  datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073742248_1424 src: /127.0.0.1:63901 dest: /127.0.0.1:60689 of size 254067
2015-03-13 10:14:31,760 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742248_1424 size 254067
2015-03-13 10:14:32,153 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742233_1409 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir39/blk_1073742233 for deletion
2015-03-13 10:14:32,154 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742234_1410 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742234 for deletion
2015-03-13 10:14:32,154 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742235_1411 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir39/blk_1073742235 for deletion
2015-03-13 10:14:32,154 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742236_1412 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742236 for deletion
2015-03-13 10:14:32,154 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742237_1413 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742237 for deletion
2015-03-13 10:14:32,154 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742233_1409 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir39/blk_1073742233
2015-03-13 10:14:32,154 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742235_1411 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir39/blk_1073742235
2015-03-13 10:14:32,154 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742234_1410 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742234
2015-03-13 10:14:32,154 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742236_1412 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742236
2015-03-13 10:14:32,154 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742239_1415 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742239 for deletion
2015-03-13 10:14:32,155 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742237_1413 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742237
2015-03-13 10:14:32,155 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742239_1415 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742239
2015-03-13 10:14:32,170 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 35 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:32,289 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0035_000001 (auth:SIMPLE)
2015-03-13 10:14:32,290 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0035_000001
2015-03-13 10:14:32,290 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi	IP=10.1.1.144	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1426266260362_0035	APPATTEMPTID=appattempt_1426266260362_0035_000001
2015-03-13 10:14:32,290 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0035_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:14:32,290 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0035 State change from ACCEPTED to RUNNING
2015-03-13 10:14:32,310 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job_1426266260362_0035_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:14:32,313 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:14:32,373 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742247_1423
2015-03-13 10:14:32,373 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742250_1426
2015-03-13 10:14:32,374 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742248_1424
2015-03-13 10:14:32,375 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742244_1420
2015-03-13 10:14:32,379 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:32,383 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job_1426266260362_0035_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:14:32,504 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742246_1422
2015-03-13 10:14:32,505 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742251_1427
2015-03-13 10:14:32,507 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742248_1424
2015-03-13 10:14:32,507 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742249_1425
2015-03-13 10:14:32,510 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job_1426266260362_0035_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742252_1428{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:14:32,554 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742252_1428 src: /127.0.0.1:63905 dest: /127.0.0.1:60686
2015-03-13 10:14:32,556 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742252_1428 src: /127.0.0.1:63906 dest: /127.0.0.1:60696
2015-03-13 10:14:32,557 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742252_1428 src: /127.0.0.1:63907 dest: /127.0.0.1:60693
2015-03-13 10:14:32,565 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63907, dest: /127.0.0.1:60693, bytes: 90386, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-682223200_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742252_1428, duration: 6093000
2015-03-13 10:14:32,565 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742252_1428, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:14:32,566 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63906, dest: /127.0.0.1:60696, bytes: 90386, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-682223200_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742252_1428, duration: 6696000
2015-03-13 10:14:32,566 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742252_1428, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:32,566 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742252_1428{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:14:32,567 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63905, dest: /127.0.0.1:60686, bytes: 90386, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-682223200_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742252_1428, duration: 8166000
2015-03-13 10:14:32,567 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742252_1428, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:32,567 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742252_1428{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:14:32,568 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742252_1428{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:14:32,573 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job_1426266260362_0035_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-682223200_1
2015-03-13 10:14:32,577 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742251_1427
2015-03-13 10:14:32,577 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742249_1425
2015-03-13 10:14:32,578 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742246_1422
2015-03-13 10:14:32,578 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742252_1428
2015-03-13 10:14:32,917 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742250_1426
2015-03-13 10:14:32,918 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742251_1427
2015-03-13 10:14:32,918 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742247_1423
2015-03-13 10:14:32,918 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742249_1425
2015-03-13 10:14:32,919 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742252_1428
2015-03-13 10:14:33,120 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742248_1424
2015-03-13 10:14:33,175 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 35 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:33,384 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:33,385 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0035_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:14:33,385 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0035	CONTAINERID=container_1426266260362_0035_01_000002
2015-03-13 10:14:33,385 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0035_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:14:33,386 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0035 container=Container: [ContainerId: container_1426266260362_0035_01_000002, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0035_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:33,386 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:14:33,386 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:33,386 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0035_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:14:33,386 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0035	CONTAINERID=container_1426266260362_0035_01_000003
2015-03-13 10:14:33,387 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0035_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available
2015-03-13 10:14:33,387 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0035 container=Container: [ContainerId: container_1426266260362_0035_01_000003, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0035_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:33,387 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:14:33,387 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:33,438 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0035_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:14:33,438 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0035	CONTAINERID=container_1426266260362_0035_01_000004
2015-03-13 10:14:33,438 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0035_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:14:33,439 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0035 container=Container: [ContainerId: container_1426266260362_0035_01_000004, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0035_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:33,439 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:14:33,439 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:33,439 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0035_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:14:33,440 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0035	CONTAINERID=container_1426266260362_0035_01_000005
2015-03-13 10:14:33,440 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0035_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:14:33,440 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0035 container=Container: [ContainerId: container_1426266260362_0035_01_000005, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0035_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:33,440 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:14:33,440 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:33,551 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0034_01_000001 succeeded 
2015-03-13 10:14:33,551 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0034_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:14:33,551 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0034_01_000001
2015-03-13 10:14:33,566 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0034/container_1426266260362_0034_01_000001
2015-03-13 10:14:33,567 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0034/container_1426266260362_0034_01_000001
2015-03-13 10:14:33,567 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0034/container_1426266260362_0034_01_000001
2015-03-13 10:14:33,567 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0034/container_1426266260362_0034_01_000001
2015-03-13 10:14:33,567 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0034	CONTAINERID=container_1426266260362_0034_01_000001
2015-03-13 10:14:33,567 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0034_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:14:33,567 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0034_01_000001 from application application_1426266260362_0034
2015-03-13 10:14:33,567 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:14:33,568 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0034
2015-03-13 10:14:34,180 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 35 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:34,206 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073742229_1405, blk_1073742233_1409, blk_1073742234_1410, blk_1073742237_1413, blk_1073742239_1415]
2015-03-13 10:14:34,207 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073742229_1405, blk_1073742233_1409, blk_1073742234_1410, blk_1073742235_1411, blk_1073742236_1412, blk_1073742237_1413]
2015-03-13 10:14:34,328 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0035_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:14:34,328 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0035_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:14:34,329 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0035_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:14:34,329 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0035_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:14:34,361 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.jar	dst=null	perm=null
2015-03-13 10:14:34,362 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.jar	dst=null	perm=null
2015-03-13 10:14:34,370 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.xml	dst=null	perm=null
2015-03-13 10:14:34,371 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.xml	dst=null	perm=null
2015-03-13 10:14:34,373 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:14:34,375 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:14:34,380 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:14:34,381 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:14:34,383 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:14:34,384 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:14:34,389 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:14:34,389 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0034_01_000001
2015-03-13 10:14:34,390 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0034_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:14:34,390 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0034_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:14:34,390 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0034	CONTAINERID=container_1426266260362_0034_01_000001
2015-03-13 10:14:34,390 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0034_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60723, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:14:34,390 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:14:34,390 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0034_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:34,390 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:34,390 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=5
2015-03-13 10:14:34,391 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0034_000001 released container container_1426266260362_0034_01_000001 on node: host: 10.1.1.144:60723 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:14:34,391 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0034_000001
2015-03-13 10:14:34,391 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0034_000001 State change from FINISHING to FINISHED
2015-03-13 10:14:34,391 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0034 State change from FINISHING to FINISHED
2015-03-13 10:14:34,391 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1426266260362_0034
2015-03-13 10:14:34,391 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0034,name=[2C202E1F11CB4F72A241D80B1FC5F547/EE2F3C2ED5D34A1D84F91DFB78AE0629] lhs*rhs/(1/2) ...orm/samepipearoundgroupby,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0034/jobhistory/job/job_1426266260362_0034,appMasterHost=Edinburgh.local,startTime=1426266852273,finishTime=1426266867412,finalStatus=SUCCEEDED
2015-03-13 10:14:34,391 INFO  capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0034_000001 is done. finalState=FINISHED
2015-03-13 10:14:34,391 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0034 requests cleared
2015-03-13 10:14:34,391 INFO  capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0034 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:14:34,391 INFO  capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0034 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:14:34,392 INFO  amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0034_000001
2015-03-13 10:14:34,394 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0034_000001 (auth:SIMPLE)
2015-03-13 10:14:34,397 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0034_01_000001
2015-03-13 10:14:34,459 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0035_000001 (auth:SIMPLE)
2015-03-13 10:14:34,459 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0035_000001 (auth:SIMPLE)
2015-03-13 10:14:34,462 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0035_01_000003 by user soberoi
2015-03-13 10:14:34,462 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0035
2015-03-13 10:14:34,462 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0035	CONTAINERID=container_1426266260362_0035_01_000003
2015-03-13 10:14:34,462 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0035_01_000004 by user soberoi
2015-03-13 10:14:34,462 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0035_01_000005 by user soberoi
2015-03-13 10:14:34,462 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0035
2015-03-13 10:14:34,462 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0035 transitioned from NEW to INITING
2015-03-13 10:14:34,462 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0035	CONTAINERID=container_1426266260362_0035_01_000004
2015-03-13 10:14:34,462 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0035_01_000003 to application application_1426266260362_0035
2015-03-13 10:14:34,463 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0035 transitioned from INITING to RUNNING
2015-03-13 10:14:34,462 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0035_01_000002 by user soberoi
2015-03-13 10:14:34,463 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0035_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:14:34,463 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0035	CONTAINERID=container_1426266260362_0035_01_000002
2015-03-13 10:14:34,462 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0035_01_000005 to application application_1426266260362_0035
2015-03-13 10:14:34,463 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0035 transitioned from NEW to INITING
2015-03-13 10:14:34,463 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0035_01_000004 to application application_1426266260362_0035
2015-03-13 10:14:34,462 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0035	CONTAINERID=container_1426266260362_0035_01_000005
2015-03-13 10:14:34,464 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0035 transitioned from INITING to RUNNING
2015-03-13 10:14:34,464 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0035_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:14:34,464 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0035_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:14:34,464 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0035
2015-03-13 10:14:34,464 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0035
2015-03-13 10:14:34,464 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:14:34,464 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0035
2015-03-13 10:14:34,464 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:14:34,463 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0035
2015-03-13 10:14:34,465 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0035
2015-03-13 10:14:34,465 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:14:34,465 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0035
2015-03-13 10:14:34,465 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:14:34,465 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:14:34,465 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:14:34,465 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0035_01_000002 to application application_1426266260362_0035
2015-03-13 10:14:34,465 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0035_01_000003
2015-03-13 10:14:34,466 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0035
2015-03-13 10:14:34,466 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0035
2015-03-13 10:14:34,466 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:14:34,466 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0035
2015-03-13 10:14:34,466 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0035_01_000005
2015-03-13 10:14:34,466 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0035_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:14:34,466 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0035
2015-03-13 10:14:34,466 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0035
2015-03-13 10:14:34,467 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:14:34,467 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0035
2015-03-13 10:14:34,467 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0035_01_000002
2015-03-13 10:14:34,467 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0035_01_000004
2015-03-13 10:14:34,484 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426266260362_0035_01_000003.tokens. Credentials list: 
2015-03-13 10:14:34,486 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1426266260362_0035_01_000004.tokens. Credentials list: 
2015-03-13 10:14:34,487 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1426266260362_0035_01_000005.tokens. Credentials list: 
2015-03-13 10:14:34,489 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1426266260362_0035_01_000002.tokens. Credentials list: 
2015-03-13 10:14:34,502 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:14:34,502 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:14:34,576 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426266260362_0035_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0035/container_1426266260362_0035_01_000003.tokens
2015-03-13 10:14:34,576 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1426266260362_0035_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0035/container_1426266260362_0035_01_000004.tokens
2015-03-13 10:14:34,577 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0035 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0035
2015-03-13 10:14:34,577 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0035 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0035
2015-03-13 10:14:34,640 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.jar	dst=null	perm=null
2015-03-13 10:14:34,640 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.jar	dst=null	perm=null
2015-03-13 10:14:34,641 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.jar	dst=null	perm=null
2015-03-13 10:14:34,641 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.jar	dst=null	perm=null
2015-03-13 10:14:34,641 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.jar	dst=null	perm=null
2015-03-13 10:14:34,641 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.jar	dst=null	perm=null
2015-03-13 10:14:34,648 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63916, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-865614899_18927, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742248_1424, duration: 442000
2015-03-13 10:14:34,648 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63915, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1215163782_18926, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742248_1424, duration: 477000
2015-03-13 10:14:34,669 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:14:34,669 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:14:34,687 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.xml	dst=null	perm=null
2015-03-13 10:14:34,688 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.xml	dst=null	perm=null
2015-03-13 10:14:34,688 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.xml	dst=null	perm=null
2015-03-13 10:14:34,688 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.xml	dst=null	perm=null
2015-03-13 10:14:34,689 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.xml	dst=null	perm=null
2015-03-13 10:14:34,689 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.xml	dst=null	perm=null
2015-03-13 10:14:34,696 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63917, bytes: 98210, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-865614899_18927, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742251_1427, duration: 287000
2015-03-13 10:14:34,696 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63918, bytes: 98210, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1215163782_18926, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742251_1427, duration: 281000
2015-03-13 10:14:34,709 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:14:34,709 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0035_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:14:34,709 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0035_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:14:34,709 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:14:34,710 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0035_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:14:34,710 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0035_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:14:34,753 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0035_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:14:34,753 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:14:34,754 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0035_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:14:34,754 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:14:34,755 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742229_1405 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742229 for deletion
2015-03-13 10:14:34,755 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742233_1409 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742233 for deletion
2015-03-13 10:14:34,755 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742234_1410 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742234 for deletion
2015-03-13 10:14:34,755 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742237_1413 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742237 for deletion
2015-03-13 10:14:34,756 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742239_1415 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742239 for deletion
2015-03-13 10:14:34,756 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742229_1405 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742229
2015-03-13 10:14:34,756 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742234_1410 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742234
2015-03-13 10:14:34,756 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742233_1409 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742233
2015-03-13 10:14:34,756 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742237_1413 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742237
2015-03-13 10:14:34,756 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742239_1415 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742239
2015-03-13 10:14:34,761 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0035_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:14:34,761 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:14:34,762 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0035_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:14:34,762 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:14:34,862 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0035/container_1426266260362_0035_01_000004/default_container_executor.sh]
2015-03-13 10:14:34,862 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0035/container_1426266260362_0035_01_000005/default_container_executor.sh]
2015-03-13 10:14:34,868 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0035/container_1426266260362_0035_01_000003/default_container_executor.sh]
2015-03-13 10:14:34,869 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0035/container_1426266260362_0035_01_000002/default_container_executor.sh]
2015-03-13 10:14:34,966 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742229_1405 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742229 for deletion
2015-03-13 10:14:34,966 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742233_1409 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742233 for deletion
2015-03-13 10:14:34,967 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742234_1410 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742234 for deletion
2015-03-13 10:14:34,967 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742235_1411 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742235 for deletion
2015-03-13 10:14:34,967 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742236_1412 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742236 for deletion
2015-03-13 10:14:34,967 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742229_1405 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742229
2015-03-13 10:14:34,967 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742237_1413 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742237 for deletion
2015-03-13 10:14:34,967 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742233_1409 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742233
2015-03-13 10:14:34,967 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742234_1410 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742234
2015-03-13 10:14:34,967 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742235_1411 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742235
2015-03-13 10:14:34,967 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742236_1412 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742236
2015-03-13 10:14:34,968 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742237_1413 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742237
2015-03-13 10:14:35,185 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 35 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:35,186 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0034 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:14:35,186 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0034
2015-03-13 10:14:35,186 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0034
2015-03-13 10:14:35,186 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0034
2015-03-13 10:14:35,186 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0034
2015-03-13 10:14:35,186 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0034 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:14:35,186 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0034, with delay of 10800 seconds
2015-03-13 10:14:35,187 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0034
2015-03-13 10:14:35,270 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0034 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:14:35,271 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0034
2015-03-13 10:14:35,271 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0034
2015-03-13 10:14:35,271 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0034
2015-03-13 10:14:35,271 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0034
2015-03-13 10:14:35,271 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0034
2015-03-13 10:14:35,271 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0034 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:14:35,271 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0034, with delay of 10800 seconds
2015-03-13 10:14:35,347 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:14:35,395 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 35 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:35,395 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 35 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:35,395 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0034 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:14:35,396 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0035_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:14:35,396 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0035_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:14:35,396 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0034
2015-03-13 10:14:35,396 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0034
2015-03-13 10:14:35,396 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0034
2015-03-13 10:14:35,396 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0034
2015-03-13 10:14:35,396 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0034 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:14:35,396 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0034, with delay of 10800 seconds
2015-03-13 10:14:35,396 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0034
2015-03-13 10:14:35,444 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 35 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:35,444 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 35 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:35,444 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0035_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:14:35,445 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0035_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:14:35,738 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:14:35,739 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:14:35,851 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1426266260362_0035_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0035/container_1426266260362_0035_01_000002.tokens
2015-03-13 10:14:35,851 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1426266260362_0035_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0035/container_1426266260362_0035_01_000005.tokens
2015-03-13 10:14:35,851 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0035 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0035
2015-03-13 10:14:35,851 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0035 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0035
2015-03-13 10:14:36,159 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742248_1424
2015-03-13 10:14:36,190 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 35 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:36,396 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 35 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:36,396 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 35 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:36,446 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 35 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:36,447 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 35 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:37,192 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 35 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:37,397 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 35 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:37,398 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 35 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:37,450 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 35 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:37,450 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 35 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:37,514 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742252_1428
2015-03-13 10:14:38,193 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 35 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:38,399 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 35 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:38,399 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 35 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:38,454 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 35 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:38,454 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 35 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:39,195 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 35 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:39,402 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 35 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:39,402 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 35 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:39,455 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 35 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:39,455 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 35 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:40,196 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 35 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:40,404 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 35 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:40,404 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 35 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:40,457 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 35 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:40,457 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 35 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:41,115 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.split	dst=null	perm=null
2015-03-13 10:14:41,199 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 35 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:41,221 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.split	dst=null	perm=null
2015-03-13 10:14:41,249 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.split	dst=null	perm=null
2015-03-13 10:14:41,262 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job.split	dst=null	perm=null
2015-03-13 10:14:41,278 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63927, bytes: 931, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0035_m_000002_0_-2118582282_1, offset: 512, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742249_1425, duration: 157000
2015-03-13 10:14:41,361 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63930, bytes: 1447, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0035_m_000001_0_-38347836_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742249_1425, duration: 154000
2015-03-13 10:14:41,391 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63932, bytes: 1447, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0035_m_000000_0_1301301573_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742249_1425, duration: 152000
2015-03-13 10:14:41,393 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63931, bytes: 415, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0035_m_000003_0_1547963280_1, offset: 1024, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742249_1425, duration: 143000
2015-03-13 10:14:41,403 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:14:41,405 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 35 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:41,405 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 35 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:41,407 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63927, bytes: 24, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0035_m_000002_0_-2118582282_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742246_1422, duration: 154000
2015-03-13 10:14:41,437 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA/_temporary/1/_temporary/attempt_1426266260362_0035_m_000002_0/part-00002	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:14:41,459 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:14:41,462 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 35 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:41,462 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 35 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:41,463 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63930, bytes: 24, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0035_m_000001_0_-38347836_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742246_1422, duration: 137000
2015-03-13 10:14:41,478 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:14:41,482 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.10.txt	dst=null	perm=null
2015-03-13 10:14:41,486 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63931, bytes: 24, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0035_m_000003_0_1547963280_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742246_1422, duration: 176000
2015-03-13 10:14:41,496 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA/_temporary/1/_temporary/attempt_1426266260362_0035_m_000001_0/part-00001	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:14:41,512 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA/_temporary/1/_temporary/attempt_1426266260362_0035_m_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:14:41,518 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA/_temporary/1/_temporary/attempt_1426266260362_0035_m_000003_0/part-00003	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:14:41,758 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.20.txt	dst=null	perm=null
2015-03-13 10:14:41,766 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.20.txt	dst=null	perm=null
2015-03-13 10:14:41,770 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.20.txt	dst=null	perm=null
2015-03-13 10:14:41,775 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63933, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0035_m_000002_0_-2118582282_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742247_1423, duration: 164000
2015-03-13 10:14:41,803 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA/_temporary/1/_temporary/attempt_1426266260362_0035_m_000002_0/part-00002. BP-1005356445-10.1.1.144-1426266257849 blk_1073742253_1429{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:14:41,835 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.20.txt	dst=null	perm=null
2015-03-13 10:14:41,839 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.20.txt	dst=null	perm=null
2015-03-13 10:14:41,844 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.20.txt	dst=null	perm=null
2015-03-13 10:14:41,846 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742253_1429 src: /127.0.0.1:63934 dest: /127.0.0.1:60693
2015-03-13 10:14:41,847 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.20.txt	dst=null	perm=null
2015-03-13 10:14:41,847 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742253_1429 src: /127.0.0.1:63935 dest: /127.0.0.1:60696
2015-03-13 10:14:41,848 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742253_1429 src: /127.0.0.1:63936 dest: /127.0.0.1:60689
2015-03-13 10:14:41,851 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.20.txt	dst=null	perm=null
2015-03-13 10:14:41,851 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63937, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0035_m_000000_0_1301301573_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742247_1423, duration: 196000
2015-03-13 10:14:41,855 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.20.txt	dst=null	perm=null
2015-03-13 10:14:41,856 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63936, dest: /127.0.0.1:60689, bytes: 102, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0035_m_000002_0_-2118582282_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742253_1429, duration: 6098000
2015-03-13 10:14:41,856 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742253_1429, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:14:41,857 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742253_1429{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:14:41,857 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63935, dest: /127.0.0.1:60696, bytes: 102, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0035_m_000002_0_-2118582282_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742253_1429, duration: 6912000
2015-03-13 10:14:41,857 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742253_1429, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:41,857 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742253_1429{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:14:41,858 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63934, dest: /127.0.0.1:60693, bytes: 102, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0035_m_000002_0_-2118582282_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742253_1429, duration: 7743000
2015-03-13 10:14:41,858 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742253_1429, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:41,858 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742253_1429{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:14:41,860 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63937, bytes: 24, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0035_m_000000_0_1301301573_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742246_1422, duration: 147000
2015-03-13 10:14:41,862 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63938, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0035_m_000001_0_-38347836_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742247_1423, duration: 150000
2015-03-13 10:14:41,862 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA/_temporary/1/_temporary/attempt_1426266260362_0035_m_000002_0/part-00002 is closed by DFSClient_attempt_1426266260362_0035_m_000002_0_-2118582282_1
2015-03-13 10:14:41,871 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA/_temporary/1/_temporary/attempt_1426266260362_0035_m_000002_0	dst=null	perm=null
2015-03-13 10:14:41,878 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA/_temporary/1/_temporary/attempt_1426266260362_0035_m_000002_0	dst=null	perm=null
2015-03-13 10:14:41,879 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA/_temporary/1/task_1426266260362_0035_m_000002	dst=null	perm=null
2015-03-13 10:14:41,883 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA/_temporary/1/_temporary/attempt_1426266260362_0035_m_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073742254_1430{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:14:41,883 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA/_temporary/1/_temporary/attempt_1426266260362_0035_m_000002_0	dst=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA/_temporary/1/task_1426266260362_0035_m_000002	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:14:41,896 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA/_temporary/1/_temporary/attempt_1426266260362_0035_m_000001_0/part-00001. BP-1005356445-10.1.1.144-1426266257849 blk_1073742255_1431{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:14:41,904 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0035_01_000004
2015-03-13 10:14:41,904 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0035	CONTAINERID=container_1426266260362_0035_01_000004
2015-03-13 10:14:41,904 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0035_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:14:41,904 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0035_01_000004
2015-03-13 10:14:41,904 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 35 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:14:41,905 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 35 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:41,917 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0035_01_000004 is : 143
2015-03-13 10:14:41,920 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job_1426266260362_0035_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073742256_1432{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:14:41,922 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742256_1432 src: /127.0.0.1:63941 dest: /127.0.0.1:60696
2015-03-13 10:14:41,923 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742256_1432 src: /127.0.0.1:63942 dest: /127.0.0.1:60686
2015-03-13 10:14:41,925 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742256_1432 src: /127.0.0.1:63943 dest: /127.0.0.1:60689
2015-03-13 10:14:41,929 INFO  hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job_1426266260362_0035_1.jhist for DFSClient_NONMAPREDUCE_-682223200_1
2015-03-13 10:14:41,930 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0035_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:14:41,930 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0035/container_1426266260362_0035_01_000004
2015-03-13 10:14:41,930 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0035/container_1426266260362_0035_01_000004
2015-03-13 10:14:41,930 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0035	CONTAINERID=container_1426266260362_0035_01_000004
2015-03-13 10:14:41,930 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0035_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:14:41,931 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0035_01_000004 from application application_1426266260362_0035
2015-03-13 10:14:41,931 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:14:41,931 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0035
2015-03-13 10:14:41,930 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0035/container_1426266260362_0035_01_000004
2015-03-13 10:14:41,931 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0035/container_1426266260362_0035_01_000004
2015-03-13 10:14:41,954 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742255_1431 src: /127.0.0.1:63940 dest: /127.0.0.1:60689
2015-03-13 10:14:41,955 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742255_1431 src: /127.0.0.1:63944 dest: /127.0.0.1:60696
2015-03-13 10:14:41,956 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742255_1431 src: /127.0.0.1:63945 dest: /127.0.0.1:60686
2015-03-13 10:14:41,957 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742254_1430 src: /127.0.0.1:63939 dest: /127.0.0.1:60693
2015-03-13 10:14:41,958 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742254_1430 src: /127.0.0.1:63946 dest: /127.0.0.1:60689
2015-03-13 10:14:41,959 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742254_1430 src: /127.0.0.1:63947 dest: /127.0.0.1:60696
2015-03-13 10:14:41,965 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63945, dest: /127.0.0.1:60686, bytes: 118, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0035_m_000001_0_-38347836_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742255_1431, duration: 7636000
2015-03-13 10:14:41,966 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742255_1431, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:14:41,966 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742255_1431{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:14:41,966 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63944, dest: /127.0.0.1:60696, bytes: 118, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0035_m_000001_0_-38347836_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742255_1431, duration: 8264000
2015-03-13 10:14:41,966 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742255_1431, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:41,967 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63940, dest: /127.0.0.1:60689, bytes: 118, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0035_m_000001_0_-38347836_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742255_1431, duration: 9178000
2015-03-13 10:14:41,967 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742255_1431, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:41,967 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742255_1431{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:14:41,968 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742255_1431{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:14:41,974 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63947, dest: /127.0.0.1:60696, bytes: 118, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0035_m_000000_0_1301301573_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742254_1430, duration: 13158000
2015-03-13 10:14:41,974 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742254_1430, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:14:41,975 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742254_1430{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:14:41,975 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63946, dest: /127.0.0.1:60689, bytes: 118, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0035_m_000000_0_1301301573_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742254_1430, duration: 13981000
2015-03-13 10:14:41,975 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742254_1430, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:41,976 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742254_1430{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:14:41,976 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63939, dest: /127.0.0.1:60693, bytes: 118, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0035_m_000000_0_1301301573_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742254_1430, duration: 14969000
2015-03-13 10:14:41,976 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742254_1430, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:41,977 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742254_1430{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:14:41,979 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA/_temporary/1/_temporary/attempt_1426266260362_0035_m_000001_0/part-00001 is closed by DFSClient_attempt_1426266260362_0035_m_000001_0_-38347836_1
2015-03-13 10:14:41,983 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.20.txt	dst=null	perm=null
2015-03-13 10:14:41,985 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA/_temporary/1/_temporary/attempt_1426266260362_0035_m_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0035_m_000000_0_1301301573_1
2015-03-13 10:14:41,990 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA/_temporary/1/_temporary/attempt_1426266260362_0035_m_000001_0	dst=null	perm=null
2015-03-13 10:14:41,994 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA/_temporary/1/_temporary/attempt_1426266260362_0035_m_000000_0	dst=null	perm=null
2015-03-13 10:14:41,996 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA/_temporary/1/_temporary/attempt_1426266260362_0035_m_000001_0	dst=null	perm=null
2015-03-13 10:14:41,999 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA/_temporary/1/task_1426266260362_0035_m_000001	dst=null	perm=null
2015-03-13 10:14:41,999 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.20.txt	dst=null	perm=null
2015-03-13 10:14:42,001 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA/_temporary/1/_temporary/attempt_1426266260362_0035_m_000000_0	dst=null	perm=null
2015-03-13 10:14:42,002 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA/_temporary/1/_temporary/attempt_1426266260362_0035_m_000001_0	dst=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA/_temporary/1/task_1426266260362_0035_m_000001	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:14:42,003 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA/_temporary/1/task_1426266260362_0035_m_000000	dst=null	perm=null
2015-03-13 10:14:42,004 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.20.txt	dst=null	perm=null
2015-03-13 10:14:42,008 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA/_temporary/1/_temporary/attempt_1426266260362_0035_m_000000_0	dst=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA/_temporary/1/task_1426266260362_0035_m_000000	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:14:42,009 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63948, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0035_m_000003_0_1547963280_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742247_1423, duration: 170000
2015-03-13 10:14:42,021 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0035_01_000003
2015-03-13 10:14:42,021 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0035	CONTAINERID=container_1426266260362_0035_01_000003
2015-03-13 10:14:42,021 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0035_01_000002
2015-03-13 10:14:42,021 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0035	CONTAINERID=container_1426266260362_0035_01_000002
2015-03-13 10:14:42,021 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 35 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:42,021 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0035_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:14:42,021 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0035_01_000003
2015-03-13 10:14:42,022 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 35 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:14:42,034 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0035_01_000003 is : 143
2015-03-13 10:14:42,046 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0035_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:14:42,046 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0035_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:14:42,047 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0035_01_000002
2015-03-13 10:14:42,053 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA/_temporary/1/_temporary/attempt_1426266260362_0035_m_000003_0/part-00003. BP-1005356445-10.1.1.144-1426266257849 blk_1073742257_1433{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:14:42,059 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0035_01_000002 is : 143
2015-03-13 10:14:42,071 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0035_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:14:42,071 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0035	CONTAINERID=container_1426266260362_0035_01_000003
2015-03-13 10:14:42,071 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0035_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:14:42,072 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0035_01_000003 from application application_1426266260362_0035
2015-03-13 10:14:42,072 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:14:42,072 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0035
2015-03-13 10:14:42,072 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0035	CONTAINERID=container_1426266260362_0035_01_000002
2015-03-13 10:14:42,072 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0035_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:14:42,072 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0035_01_000002 from application application_1426266260362_0035
2015-03-13 10:14:42,072 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:14:42,072 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0035
2015-03-13 10:14:42,072 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0035/container_1426266260362_0035_01_000003
2015-03-13 10:14:42,073 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0035/container_1426266260362_0035_01_000003
2015-03-13 10:14:42,073 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0035/container_1426266260362_0035_01_000003
2015-03-13 10:14:42,074 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0035/container_1426266260362_0035_01_000003
2015-03-13 10:14:42,075 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0035/container_1426266260362_0035_01_000002
2015-03-13 10:14:42,076 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0035/container_1426266260362_0035_01_000002
2015-03-13 10:14:42,076 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0035/container_1426266260362_0035_01_000002
2015-03-13 10:14:42,076 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0035/container_1426266260362_0035_01_000002
2015-03-13 10:14:42,097 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742257_1433 src: /127.0.0.1:63949 dest: /127.0.0.1:60686
2015-03-13 10:14:42,098 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742257_1433 src: /127.0.0.1:63950 dest: /127.0.0.1:60693
2015-03-13 10:14:42,099 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742257_1433 src: /127.0.0.1:63951 dest: /127.0.0.1:60689
2015-03-13 10:14:42,106 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63951, dest: /127.0.0.1:60689, bytes: 103, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0035_m_000003_0_1547963280_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742257_1433, duration: 5311000
2015-03-13 10:14:42,106 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742257_1433, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:14:42,107 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742257_1433{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:14:42,107 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63950, dest: /127.0.0.1:60693, bytes: 103, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0035_m_000003_0_1547963280_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742257_1433, duration: 6085000
2015-03-13 10:14:42,107 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742257_1433, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:42,107 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742257_1433{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:14:42,108 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63949, dest: /127.0.0.1:60686, bytes: 103, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0035_m_000003_0_1547963280_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742257_1433, duration: 6792000
2015-03-13 10:14:42,108 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742257_1433, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:42,108 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742257_1433{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:14:42,112 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA/_temporary/1/_temporary/attempt_1426266260362_0035_m_000003_0/part-00003 is closed by DFSClient_attempt_1426266260362_0035_m_000003_0_1547963280_1
2015-03-13 10:14:42,121 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA/_temporary/1/_temporary/attempt_1426266260362_0035_m_000003_0	dst=null	perm=null
2015-03-13 10:14:42,127 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA/_temporary/1/_temporary/attempt_1426266260362_0035_m_000003_0	dst=null	perm=null
2015-03-13 10:14:42,128 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA/_temporary/1/task_1426266260362_0035_m_000003	dst=null	perm=null
2015-03-13 10:14:42,131 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA/_temporary/1/_temporary/attempt_1426266260362_0035_m_000003_0	dst=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA/_temporary/1/task_1426266260362_0035_m_000003	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:14:42,142 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0035_01_000005
2015-03-13 10:14:42,142 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0035	CONTAINERID=container_1426266260362_0035_01_000005
2015-03-13 10:14:42,142 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0035_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:14:42,142 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0035_01_000005
2015-03-13 10:14:42,142 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 35 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:14:42,142 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0035_01_000004
2015-03-13 10:14:42,142 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 35 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:14:42,143 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0035_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:14:42,143 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0035_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:14:42,143 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0035	CONTAINERID=container_1426266260362_0035_01_000004
2015-03-13 10:14:42,143 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0035_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:14:42,143 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:14:42,143 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0035_01_000004, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:42,143 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:42,143 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:14:42,143 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0035_000001 released container container_1426266260362_0035_01_000004 on node: host: 10.1.1.144:60719 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:14:42,146 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:14:42,148 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-682223200_1
2015-03-13 10:14:42,152 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA/_temporary/1	dst=null	perm=null
2015-03-13 10:14:42,155 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0035_01_000005 is : 143
2015-03-13 10:14:42,159 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA	dst=null	perm=null
2015-03-13 10:14:42,160 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA	dst=null	perm=null
2015-03-13 10:14:42,161 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA/_temporary/1/task_1426266260362_0035_m_000000	dst=null	perm=null
2015-03-13 10:14:42,162 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA/part-00000	dst=null	perm=null
2015-03-13 10:14:42,165 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA/_temporary/1/task_1426266260362_0035_m_000000/part-00000	dst=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA/part-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:14:42,166 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0035_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:14:42,166 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0035/container_1426266260362_0035_01_000005
2015-03-13 10:14:42,166 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0035/container_1426266260362_0035_01_000005
2015-03-13 10:14:42,166 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0035	CONTAINERID=container_1426266260362_0035_01_000005
2015-03-13 10:14:42,167 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0035_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:14:42,167 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0035_01_000005 from application application_1426266260362_0035
2015-03-13 10:14:42,167 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:14:42,167 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0035
2015-03-13 10:14:42,167 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0035/container_1426266260362_0035_01_000005
2015-03-13 10:14:42,167 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0035/container_1426266260362_0035_01_000005
2015-03-13 10:14:42,168 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA	dst=null	perm=null
2015-03-13 10:14:42,169 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA	dst=null	perm=null
2015-03-13 10:14:42,170 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA/_temporary/1/task_1426266260362_0035_m_000001	dst=null	perm=null
2015-03-13 10:14:42,171 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA/part-00001	dst=null	perm=null
2015-03-13 10:14:42,173 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA/_temporary/1/task_1426266260362_0035_m_000001/part-00001	dst=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA/part-00001	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:14:42,174 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA	dst=null	perm=null
2015-03-13 10:14:42,175 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA	dst=null	perm=null
2015-03-13 10:14:42,176 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA/_temporary/1/task_1426266260362_0035_m_000002	dst=null	perm=null
2015-03-13 10:14:42,177 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA/part-00002	dst=null	perm=null
2015-03-13 10:14:42,180 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA/_temporary/1/task_1426266260362_0035_m_000002/part-00002	dst=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA/part-00002	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:14:42,181 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA	dst=null	perm=null
2015-03-13 10:14:42,182 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA	dst=null	perm=null
2015-03-13 10:14:42,183 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA/_temporary/1/task_1426266260362_0035_m_000003	dst=null	perm=null
2015-03-13 10:14:42,184 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA/part-00003	dst=null	perm=null
2015-03-13 10:14:42,186 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA/_temporary/1/task_1426266260362_0035_m_000003/part-00003	dst=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA/part-00003	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:14:42,189 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA/_temporary	dst=null	perm=null
2015-03-13 10:14:42,193 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:14:42,195 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-682223200_1
2015-03-13 10:14:42,198 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:14:42,199 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-682223200_1
2015-03-13 10:14:42,200 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 35 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:42,212 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63943, dest: /127.0.0.1:60689, bytes: 46396, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-682223200_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742256_1432, duration: 286075000
2015-03-13 10:14:42,213 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742256_1432, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:14:42,214 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742256_1432{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:14:42,214 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63942, dest: /127.0.0.1:60686, bytes: 46396, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-682223200_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742256_1432, duration: 287383000
2015-03-13 10:14:42,214 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742256_1432, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:42,215 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742256_1432{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:14:42,215 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63941, dest: /127.0.0.1:60696, bytes: 46396, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-682223200_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742256_1432, duration: 288770000
2015-03-13 10:14:42,215 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742256_1432, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:42,216 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742256_1432{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:14:42,217 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job_1426266260362_0035_1.jhist is closed by DFSClient_NONMAPREDUCE_-682223200_1
2015-03-13 10:14:42,220 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0035.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:14:42,223 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0035.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742258_1434{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:14:42,224 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742258_1434 src: /127.0.0.1:63952 dest: /127.0.0.1:60689
2015-03-13 10:14:42,226 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742258_1434 src: /127.0.0.1:63953 dest: /127.0.0.1:60686
2015-03-13 10:14:42,227 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742258_1434 src: /127.0.0.1:63954 dest: /127.0.0.1:60696
2015-03-13 10:14:42,230 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63954, dest: /127.0.0.1:60696, bytes: 404, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-682223200_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742258_1434, duration: 1450000
2015-03-13 10:14:42,230 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742258_1434, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:14:42,230 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742258_1434{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:14:42,231 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63953, dest: /127.0.0.1:60686, bytes: 404, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-682223200_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742258_1434, duration: 1712000
2015-03-13 10:14:42,231 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742258_1434, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:42,231 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742258_1434{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:14:42,231 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63952, dest: /127.0.0.1:60689, bytes: 404, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-682223200_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742258_1434, duration: 2632000
2015-03-13 10:14:42,231 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742258_1434, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:42,232 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742258_1434{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:14:42,233 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0035.summary_tmp is closed by DFSClient_NONMAPREDUCE_-682223200_1
2015-03-13 10:14:42,237 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0035.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:14:42,241 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job_1426266260362_0035_1.jhist	dst=null	perm=null
2015-03-13 10:14:42,242 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0035-1426266868668-soberoi-%5B965FB86188914C2F858E802B0FA30893%2F960BB94BC14B45F0-1426266882201-4-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:14:42,245 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job_1426266260362_0035_1.jhist	dst=null	perm=null
2015-03-13 10:14:42,246 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0035-1426266868668-soberoi-%5B965FB86188914C2F858E802B0FA30893%2F960BB94BC14B45F0-1426266882201-4-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:14:42,246 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job_1426266260362_0035_1.jhist	dst=null	perm=null
2015-03-13 10:14:42,248 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0035-1426266868668-soberoi-%5B965FB86188914C2F858E802B0FA30893%2F960BB94BC14B45F0-1426266882201-4-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:14:42,250 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63955, bytes: 46760, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-682223200_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742256_1432, duration: 161000
2015-03-13 10:14:42,252 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0035-1426266868668-soberoi-%5B965FB86188914C2F858E802B0FA30893%2F960BB94BC14B45F0-1426266882201-4-0-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742259_1435{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:14:42,253 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742259_1435 src: /127.0.0.1:63956 dest: /127.0.0.1:60686
2015-03-13 10:14:42,254 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742259_1435 src: /127.0.0.1:63957 dest: /127.0.0.1:60689
2015-03-13 10:14:42,256 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742259_1435 src: /127.0.0.1:63958 dest: /127.0.0.1:60693
2015-03-13 10:14:42,258 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63958, dest: /127.0.0.1:60693, bytes: 46396, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-682223200_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742259_1435, duration: 1155000
2015-03-13 10:14:42,258 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742259_1435, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:14:42,259 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742259_1435{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:14:42,259 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63957, dest: /127.0.0.1:60689, bytes: 46396, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-682223200_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742259_1435, duration: 1600000
2015-03-13 10:14:42,259 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742259_1435, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:42,259 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742259_1435{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:14:42,259 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63956, dest: /127.0.0.1:60686, bytes: 46396, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-682223200_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742259_1435, duration: 2338000
2015-03-13 10:14:42,260 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742259_1435, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:42,260 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742259_1435{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:14:42,262 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0035-1426266868668-soberoi-%5B965FB86188914C2F858E802B0FA30893%2F960BB94BC14B45F0-1426266882201-4-0-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-682223200_1
2015-03-13 10:14:42,263 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0035-1426266868668-soberoi-%5B965FB86188914C2F858E802B0FA30893%2F960BB94BC14B45F0-1426266882201-4-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:14:42,264 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job_1426266260362_0035_1_conf.xml	dst=null	perm=null
2015-03-13 10:14:42,265 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0035_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:14:42,266 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job_1426266260362_0035_1_conf.xml	dst=null	perm=null
2015-03-13 10:14:42,267 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0035_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:14:42,268 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035/job_1426266260362_0035_1_conf.xml	dst=null	perm=null
2015-03-13 10:14:42,270 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0035_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:14:42,276 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63959, bytes: 91094, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-682223200_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742252_1428, duration: 269000
2015-03-13 10:14:42,278 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0035_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742260_1436{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:14:42,280 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742260_1436 src: /127.0.0.1:63960 dest: /127.0.0.1:60696
2015-03-13 10:14:42,281 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742260_1436 src: /127.0.0.1:63961 dest: /127.0.0.1:60686
2015-03-13 10:14:42,283 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742260_1436 src: /127.0.0.1:63962 dest: /127.0.0.1:60689
2015-03-13 10:14:42,286 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63962, dest: /127.0.0.1:60689, bytes: 90386, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-682223200_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742260_1436, duration: 1888000
2015-03-13 10:14:42,286 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742260_1436, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:14:42,287 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742260_1436{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:14:42,287 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63961, dest: /127.0.0.1:60686, bytes: 90386, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-682223200_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742260_1436, duration: 2382000
2015-03-13 10:14:42,287 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742260_1436, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:42,287 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742260_1436{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:14:42,288 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63960, dest: /127.0.0.1:60696, bytes: 90386, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-682223200_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742260_1436, duration: 3161000
2015-03-13 10:14:42,288 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742260_1436, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:42,288 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742260_1436{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:14:42,291 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0035_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-682223200_1
2015-03-13 10:14:42,292 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0035_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:14:42,297 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0035.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0035.summary	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:14:42,302 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0035_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0035_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:14:42,304 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0035-1426266868668-soberoi-%5B965FB86188914C2F858E802B0FA30893%2F960BB94BC14B45F0-1426266882201-4-0-SUCCEEDED-default.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0035-1426266868668-soberoi-%5B965FB86188914C2F858E802B0FA30893%2F960BB94BC14B45F0-1426266882201-4-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:14:42,309 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0035_000001 State change from RUNNING to FINISHING
2015-03-13 10:14:42,309 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0035
2015-03-13 10:14:42,309 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0035 State change from RUNNING to REMOVING
2015-03-13 10:14:42,309 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0035
2015-03-13 10:14:42,309 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0035 State change from REMOVING to FINISHING
2015-03-13 10:14:42,519 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742256_1432
2015-03-13 10:14:42,519 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742255_1431
2015-03-13 10:14:42,519 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742258_1434
2015-03-13 10:14:42,520 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742257_1433
2015-03-13 10:14:42,520 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742259_1435
2015-03-13 10:14:42,521 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742260_1436
2015-03-13 10:14:42,588 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742259_1435
2015-03-13 10:14:42,589 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742253_1429
2015-03-13 10:14:42,589 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742257_1433
2015-03-13 10:14:42,589 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742254_1430
2015-03-13 10:14:43,023 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 35 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:14:43,023 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0035_01_000002
2015-03-13 10:14:43,023 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 35 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:14:43,023 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0035_01_000003
2015-03-13 10:14:43,024 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0035_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:14:43,024 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0035_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:14:43,024 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0035	CONTAINERID=container_1426266260362_0035_01_000002
2015-03-13 10:14:43,024 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0035_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:14:43,025 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:14:43,025 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0035_01_000002, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:43,025 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:43,025 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:14:43,025 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0035_000001 released container container_1426266260362_0035_01_000002 on node: host: 10.1.1.144:60723 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:14:43,025 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0035_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:14:43,025 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0035_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:14:43,026 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0035	CONTAINERID=container_1426266260362_0035_01_000003
2015-03-13 10:14:43,026 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0035_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:14:43,026 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:14:43,026 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0035_01_000003, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:43,026 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:43,026 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:14:43,026 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0035_000001 released container container_1426266260362_0035_01_000003 on node: host: 10.1.1.144:60723 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:14:43,129 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742253_1429
2015-03-13 10:14:43,130 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742255_1431
2015-03-13 10:14:43,130 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742254_1430
2015-03-13 10:14:43,131 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742260_1436
2015-03-13 10:14:43,132 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742256_1432
2015-03-13 10:14:43,132 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742258_1434
2015-03-13 10:14:43,143 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 35 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:14:43,144 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0035_01_000005
2015-03-13 10:14:43,144 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0035_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:14:43,145 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0035_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:14:43,145 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0035	CONTAINERID=container_1426266260362_0035_01_000005
2015-03-13 10:14:43,145 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0035_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:14:43,145 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:14:43,145 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0035_01_000005, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:43,145 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:43,146 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:14:43,146 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0035_000001 released container container_1426266260362_0035_01_000005 on node: host: 10.1.1.144:60719 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:14:43,200 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 35 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:43,316 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742248_1424 127.0.0.1:60686 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60689 
2015-03-13 10:14:43,316 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742249_1425 127.0.0.1:60689 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60693 
2015-03-13 10:14:43,316 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742250_1426 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60693 
2015-03-13 10:14:43,316 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742251_1427 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60686 
2015-03-13 10:14:43,316 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742256_1432 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60689 
2015-03-13 10:14:43,316 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742252_1428 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60693 
2015-03-13 10:14:43,317 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0035	dst=null	perm=null
2015-03-13 10:14:43,342 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [] starting step: (1/2) ...JoinMergeGroupBy/hashjoin
2015-03-13 10:14:43,350 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:14:43,357 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:14:43,360 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinMergeGroupBy/hashjoin	dst=null	perm=null
2015-03-13 10:14:43,360 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:14:43,361 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:14:43,363 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 36
2015-03-13 10:14:43,363 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036	dst=null	perm=null
2015-03-13 10:14:43,364 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036	dst=null	perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:14:43,365 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036	dst=null	perm=soberoi:supergroup:rwx------
2015-03-13 10:14:43,366 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.jar	dst=null	perm=null
2015-03-13 10:14:43,367 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:14:43,369 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073742261_1437{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:14:43,370 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742261_1437 src: /127.0.0.1:63965 dest: /127.0.0.1:60689
2015-03-13 10:14:43,371 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742261_1437 src: /127.0.0.1:63966 dest: /127.0.0.1:60693
2015-03-13 10:14:43,372 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742261_1437 src: /127.0.0.1:63967 dest: /127.0.0.1:60686
2015-03-13 10:14:43,376 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63967, dest: /127.0.0.1:60686, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742261_1437, duration: 1844000
2015-03-13 10:14:43,376 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742261_1437, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:14:43,376 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742261_1437{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:14:43,377 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63966, dest: /127.0.0.1:60693, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742261_1437, duration: 2136000
2015-03-13 10:14:43,377 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742261_1437, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:43,377 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742261_1437{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:14:43,377 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63965, dest: /127.0.0.1:60689, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742261_1437, duration: 3180000
2015-03-13 10:14:43,378 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742261_1437, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:43,378 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742261_1437{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:14:43,379 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:14:43,379 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.jar
2015-03-13 10:14:43,380 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.jar	dst=null	perm=null
2015-03-13 10:14:43,381 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:14:43,381 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:14:43,382 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:14:43,383 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:14:43,384 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:14:43,384 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:14:43,385 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:14:43,386 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:14:43,386 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:14:43,387 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:14:43,395 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA	dst=null	perm=null
2015-03-13 10:14:43,395 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA	dst=null	perm=null
2015-03-13 10:14:43,396 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA	dst=null	perm=null
2015-03-13 10:14:43,397 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 4
2015-03-13 10:14:43,397 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.20.txt	dst=null	perm=null
2015-03-13 10:14:43,397 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:14:43,398 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.20.txt	dst=null	perm=null
2015-03-13 10:14:43,398 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA	dst=null	perm=null
2015-03-13 10:14:43,399 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA	dst=null	perm=null
2015-03-13 10:14:43,399 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA	dst=null	perm=null
2015-03-13 10:14:43,400 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 4
2015-03-13 10:14:43,401 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.20.txt	dst=null	perm=null
2015-03-13 10:14:43,401 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:14:43,401 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.20.txt	dst=null	perm=null
2015-03-13 10:14:43,403 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:14:43,404 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:14:43,404 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.split
2015-03-13 10:14:43,405 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.split	dst=null	perm=null
2015-03-13 10:14:43,406 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073742262_1438{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:14:43,407 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742262_1438 src: /127.0.0.1:63968 dest: /127.0.0.1:60686
2015-03-13 10:14:43,408 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742262_1438 src: /127.0.0.1:63969 dest: /127.0.0.1:60693
2015-03-13 10:14:43,409 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742262_1438 src: /127.0.0.1:63970 dest: /127.0.0.1:60696
2015-03-13 10:14:43,410 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742262_1438 src: /127.0.0.1:63971 dest: /127.0.0.1:60689
2015-03-13 10:14:43,412 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63971, dest: /127.0.0.1:60689, bytes: 2466, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742262_1438, duration: 1806000
2015-03-13 10:14:43,413 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742262_1438, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:14:43,413 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742262_1438{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:14:43,413 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63970, dest: /127.0.0.1:60696, bytes: 2466, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742262_1438, duration: 2326000
2015-03-13 10:14:43,413 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742262_1438, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:43,414 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742262_1438{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:14:43,414 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63969, dest: /127.0.0.1:60693, bytes: 2466, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742262_1438, duration: 2994000
2015-03-13 10:14:43,414 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742262_1438, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:43,414 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742262_1438{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:14:43,415 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63968, dest: /127.0.0.1:60686, bytes: 2466, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742262_1438, duration: 3721000
2015-03-13 10:14:43,415 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742262_1438, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:43,416 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742262_1438{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:14:43,417 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:14:43,418 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:14:43,420 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:14:43,421 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073742263_1439{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:14:43,422 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742263_1439 src: /127.0.0.1:63972 dest: /127.0.0.1:60689
2015-03-13 10:14:43,423 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742263_1439 src: /127.0.0.1:63973 dest: /127.0.0.1:60696
2015-03-13 10:14:43,424 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742263_1439 src: /127.0.0.1:63974 dest: /127.0.0.1:60686
2015-03-13 10:14:43,427 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63974, dest: /127.0.0.1:60686, bytes: 253, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742263_1439, duration: 1235000
2015-03-13 10:14:43,427 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742263_1439, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:14:43,428 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742263_1439{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:14:43,428 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63973, dest: /127.0.0.1:60696, bytes: 253, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742263_1439, duration: 1537000
2015-03-13 10:14:43,428 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742263_1439, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:43,428 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742263_1439{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:14:43,428 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63972, dest: /127.0.0.1:60689, bytes: 253, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742263_1439, duration: 2150000
2015-03-13 10:14:43,428 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742263_1439, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:43,430 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742263_1439{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:14:43,430 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:14:43,431 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:7
2015-03-13 10:14:43,432 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:14:43,433 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:14:43,434 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:14:43,435 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:14:43,435 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:14:43,439 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742264_1440{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:14:43,441 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742264_1440 src: /127.0.0.1:63975 dest: /127.0.0.1:60696
2015-03-13 10:14:43,442 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742264_1440 src: /127.0.0.1:63976 dest: /127.0.0.1:60689
2015-03-13 10:14:43,443 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742264_1440 src: /127.0.0.1:63977 dest: /127.0.0.1:60686
2015-03-13 10:14:43,445 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63977, dest: /127.0.0.1:60686, bytes: 99390, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742264_1440, duration: 1419000
2015-03-13 10:14:43,445 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742264_1440, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:14:43,446 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742264_1440{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:14:43,446 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63976, dest: /127.0.0.1:60689, bytes: 99390, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742264_1440, duration: 1801000
2015-03-13 10:14:43,446 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742264_1440, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:43,446 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742264_1440{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:14:43,446 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63975, dest: /127.0.0.1:60696, bytes: 99390, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742264_1440, duration: 2523000
2015-03-13 10:14:43,447 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742264_1440, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:43,447 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742264_1440{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:14:43,448 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:14:43,448 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0036
2015-03-13 10:14:43,448 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036	dst=null	perm=null
2015-03-13 10:14:43,449 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.xml	dst=null	perm=null
2015-03-13 10:14:43,450 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.xml	dst=null	perm=null
2015-03-13 10:14:43,450 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.jar	dst=null	perm=null
2015-03-13 10:14:43,450 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.jar	dst=null	perm=null
2015-03-13 10:14:43,451 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.split	dst=null	perm=null
2015-03-13 10:14:43,451 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.split	dst=null	perm=null
2015-03-13 10:14:43,452 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:14:43,452 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:14:43,454 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:14:43,454 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:14:43,454 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:14:43,455 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:14:43,456 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:14:43,456 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:14:43,457 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 36 submitted by user soberoi
2015-03-13 10:14:43,457 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0036
2015-03-13 10:14:43,457 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	IP=10.1.1.144	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1426266260362_0036
2015-03-13 10:14:43,457 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0036
2015-03-13 10:14:43,457 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0036 State change from NEW to NEW_SAVING
2015-03-13 10:14:43,458 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0036 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:14:43,458 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0036_000001
2015-03-13 10:14:43,458 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0036_000001 State change from NEW to SUBMITTED
2015-03-13 10:14:43,458 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0036 from user: soberoi activated in queue: default
2015-03-13 10:14:43,458 INFO  capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0036 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:14:43,458 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0036 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:14:43,458 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0036 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:14:43,458 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0036_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:14:43,459 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0036_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:14:43,460 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0036 State change from SUBMITTED to ACCEPTED
2015-03-13 10:14:43,461 INFO  mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0036/
2015-03-13 10:14:43,461 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [] submitted hadoop job: job_1426266260362_0036
2015-03-13 10:14:43,461 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0036/
2015-03-13 10:14:44,025 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0036_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:14:44,025 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0036	CONTAINERID=container_1426266260362_0036_01_000001
2015-03-13 10:14:44,025 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0036_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:14:44,025 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0036 container=Container: [ContainerId: container_1426266260362_0036_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0036_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:44,025 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:14:44,025 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0036_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:14:44,026 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:44,027 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0036 AttemptId: appattempt_1426266260362_0036_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0036_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ]
2015-03-13 10:14:44,027 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0036_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:14:44,027 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0036_000001
2015-03-13 10:14:44,027 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0036_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:14:44,027 INFO  amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0036_000001
2015-03-13 10:14:44,028 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0036_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] for AM appattempt_1426266260362_0036_000001
2015-03-13 10:14:44,028 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0036_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-03-13 10:14:44,030 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0036_000001 (auth:SIMPLE)
2015-03-13 10:14:44,031 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0036_01_000001 by user soberoi
2015-03-13 10:14:44,031 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0036
2015-03-13 10:14:44,032 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0036	CONTAINERID=container_1426266260362_0036_01_000001
2015-03-13 10:14:44,032 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0036 transitioned from NEW to INITING
2015-03-13 10:14:44,032 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0036_01_000001 to application application_1426266260362_0036
2015-03-13 10:14:44,032 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0036 transitioned from INITING to RUNNING
2015-03-13 10:14:44,032 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0036_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] for AM appattempt_1426266260362_0036_000001
2015-03-13 10:14:44,032 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0036_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:14:44,032 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0036_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:14:44,032 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0036
2015-03-13 10:14:44,032 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:14:44,033 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:14:44,033 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:14:44,033 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:14:44,033 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0036_01_000001
2015-03-13 10:14:44,041 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426266260362_0036_01_000001.tokens. Credentials list: 
2015-03-13 10:14:44,056 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:14:44,126 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426266260362_0036_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0036/container_1426266260362_0036_01_000001.tokens
2015-03-13 10:14:44,126 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0036 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0036
2015-03-13 10:14:44,183 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.jar	dst=null	perm=null
2015-03-13 10:14:44,184 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.jar	dst=null	perm=null
2015-03-13 10:14:44,185 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.jar	dst=null	perm=null
2015-03-13 10:14:44,191 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63981, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_663108890_19264, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742261_1437, duration: 455000
2015-03-13 10:14:44,201 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 35 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:44,209 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:14:44,225 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:14:44,226 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:14:44,226 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:14:44,233 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63982, bytes: 257, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_663108890_19264, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742263_1439, duration: 176000
2015-03-13 10:14:44,246 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:14:44,261 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.split	dst=null	perm=null
2015-03-13 10:14:44,262 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.split	dst=null	perm=null
2015-03-13 10:14:44,262 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.split	dst=null	perm=null
2015-03-13 10:14:44,268 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63981, bytes: 2486, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_663108890_19264, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742262_1438, duration: 120000
2015-03-13 10:14:44,280 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:14:44,298 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.xml	dst=null	perm=null
2015-03-13 10:14:44,298 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.xml	dst=null	perm=null
2015-03-13 10:14:44,299 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.xml	dst=null	perm=null
2015-03-13 10:14:44,305 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63983, bytes: 100170, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_663108890_19264, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742264_1440, duration: 296000
2015-03-13 10:14:44,318 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:14:44,319 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0036_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:14:44,345 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0036_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:14:44,345 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:14:44,411 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0036/container_1426266260362_0036_01_000001/default_container_executor.sh]
2015-03-13 10:14:45,024 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:45,025 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0036_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:14:45,206 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 35 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:45,993 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:14:46,017 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/COMMIT_STARTED	dst=null	perm=null
2015-03-13 10:14:46,019 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/COMMIT_SUCCESS	dst=null	perm=null
2015-03-13 10:14:46,019 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/COMMIT_FAIL	dst=null	perm=null
2015-03-13 10:14:46,025 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:46,073 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036	dst=null	perm=null
2015-03-13 10:14:46,074 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:14:46,075 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:14:46,168 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742260_1436
2015-03-13 10:14:46,169 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742262_1438
2015-03-13 10:14:46,169 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742256_1432
2015-03-13 10:14:46,169 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742257_1433
2015-03-13 10:14:46,170 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742253_1429
2015-03-13 10:14:46,170 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742255_1431
2015-03-13 10:14:46,170 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742264_1440
2015-03-13 10:14:46,211 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 35 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:46,225 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60693 to replicate blk_1073742261_1437 to datanode(s) 127.0.0.1:60696
2015-03-13 10:14:46,225 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073742256_1432, blk_1073742248_1424, blk_1073742249_1425, blk_1073742250_1426]
2015-03-13 10:14:46,225 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073742256_1432, blk_1073742248_1424, blk_1073742249_1425, blk_1073742251_1427, blk_1073742252_1428]
2015-03-13 10:14:46,353 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:14:46,360 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:14:46,371 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742261_1437
2015-03-13 10:14:46,372 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742259_1435
2015-03-13 10:14:46,372 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742258_1434
2015-03-13 10:14:46,373 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742254_1430
2015-03-13 10:14:46,373 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742263_1439
2015-03-13 10:14:46,420 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63985, bytes: 257, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1156178742_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742263_1439, duration: 191000
2015-03-13 10:14:46,733 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742256_1432 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir2/blk_1073742256 for deletion
2015-03-13 10:14:46,733 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742248_1424 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742248 for deletion
2015-03-13 10:14:46,733 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742249_1425 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir2/blk_1073742249 for deletion
2015-03-13 10:14:46,733 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742250_1426 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir57/blk_1073742250 for deletion
2015-03-13 10:14:46,733 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742256_1432 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir2/blk_1073742256
2015-03-13 10:14:46,733 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742250_1426 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir57/blk_1073742250
2015-03-13 10:14:46,733 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742248_1424 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742248
2015-03-13 10:14:46,734 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742249_1425 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir2/blk_1073742249
2015-03-13 10:14:46,767 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742256_1432 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742256 for deletion
2015-03-13 10:14:46,767 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742248_1424 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742248 for deletion
2015-03-13 10:14:46,767 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742249_1425 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742249 for deletion
2015-03-13 10:14:46,767 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742251_1427 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742251 for deletion
2015-03-13 10:14:46,767 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742252_1428 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742252 for deletion
2015-03-13 10:14:46,768 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742256_1432 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742256
2015-03-13 10:14:46,768 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742248_1424 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742248
2015-03-13 10:14:46,768 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742251_1427 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742251
2015-03-13 10:14:46,768 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742249_1425 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742249
2015-03-13 10:14:46,768 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742252_1428 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742252
2015-03-13 10:14:46,972 INFO  datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-1589780806-10.1.1.144-60693-1426266259390, infoPort=60694, ipcPort=60695, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073742261_1437 to 127.0.0.1:60696 
2015-03-13 10:14:46,974 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742261_1437 src: /127.0.0.1:63988 dest: /127.0.0.1:60696
2015-03-13 10:14:46,974 INFO  datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073742261_1437 (numBytes=254067) to /127.0.0.1:60696
2015-03-13 10:14:46,976 INFO  datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073742261_1437 src: /127.0.0.1:63988 dest: /127.0.0.1:60696 of size 254067
2015-03-13 10:14:46,976 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742261_1437 size 254067
2015-03-13 10:14:47,027 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:47,197 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0036_000001 (auth:SIMPLE)
2015-03-13 10:14:47,199 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0036_000001
2015-03-13 10:14:47,199 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi	IP=10.1.1.144	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1426266260362_0036	APPATTEMPTID=appattempt_1426266260362_0036_000001
2015-03-13 10:14:47,199 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0036_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:14:47,199 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0036 State change from ACCEPTED to RUNNING
2015-03-13 10:14:47,217 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 35 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:47,219 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job_1426266260362_0036_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:14:47,223 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinMergeGroupBy/hashjoin/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:14:47,293 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job_1426266260362_0036_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:14:47,412 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job_1426266260362_0036_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742265_1441{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:14:47,454 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742265_1441 src: /127.0.0.1:63992 dest: /127.0.0.1:60696
2015-03-13 10:14:47,456 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742265_1441 src: /127.0.0.1:63993 dest: /127.0.0.1:60693
2015-03-13 10:14:47,457 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742265_1441 src: /127.0.0.1:63994 dest: /127.0.0.1:60689
2015-03-13 10:14:47,465 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63994, dest: /127.0.0.1:60689, bytes: 91867, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1156178742_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742265_1441, duration: 5978000
2015-03-13 10:14:47,465 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742265_1441, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:14:47,466 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63993, dest: /127.0.0.1:60693, bytes: 91867, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1156178742_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742265_1441, duration: 6669000
2015-03-13 10:14:47,467 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742265_1441, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:47,467 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742265_1441{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:14:47,468 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63992, dest: /127.0.0.1:60696, bytes: 91867, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1156178742_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742265_1441, duration: 8130000
2015-03-13 10:14:47,469 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742265_1441, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:47,470 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742265_1441{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:14:47,470 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742265_1441{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:14:47,474 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job_1426266260362_0036_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-1156178742_1
2015-03-13 10:14:47,527 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742261_1437
2015-03-13 10:14:47,527 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742262_1438
2015-03-13 10:14:47,528 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742263_1439
2015-03-13 10:14:47,528 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742264_1440
2015-03-13 10:14:47,596 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742262_1438
2015-03-13 10:14:47,798 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742261_1437
2015-03-13 10:14:47,799 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742265_1441
2015-03-13 10:14:48,028 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:48,135 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742263_1439
2015-03-13 10:14:48,135 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742262_1438
2015-03-13 10:14:48,136 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742264_1440
2015-03-13 10:14:48,219 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 35 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:48,220 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0036_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:14:48,220 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0036	CONTAINERID=container_1426266260362_0036_01_000002
2015-03-13 10:14:48,220 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0036_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:14:48,220 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0036 container=Container: [ContainerId: container_1426266260362_0036_01_000002, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0036_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:48,220 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:14:48,220 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:48,221 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0036_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:14:48,221 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0036	CONTAINERID=container_1426266260362_0036_01_000003
2015-03-13 10:14:48,221 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0036_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available
2015-03-13 10:14:48,221 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0036 container=Container: [ContainerId: container_1426266260362_0036_01_000003, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0036_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:48,221 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:14:48,221 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:48,305 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0036_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:14:48,305 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0036	CONTAINERID=container_1426266260362_0036_01_000004
2015-03-13 10:14:48,305 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0036_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:14:48,305 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0036 container=Container: [ContainerId: container_1426266260362_0036_01_000004, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0036_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:48,306 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:14:48,306 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:48,306 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0036_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:14:48,306 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0036	CONTAINERID=container_1426266260362_0036_01_000005
2015-03-13 10:14:48,306 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0036_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:14:48,306 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0036 container=Container: [ContainerId: container_1426266260362_0036_01_000005, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0036_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:48,307 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:14:48,307 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:48,307 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0036_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:14:48,307 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0036	CONTAINERID=container_1426266260362_0036_01_000006
2015-03-13 10:14:48,307 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0036_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:14:48,307 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0036 container=Container: [ContainerId: container_1426266260362_0036_01_000006, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0036_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:48,307 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7
2015-03-13 10:14:48,308 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:48,308 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0036_01_000007 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:14:48,308 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0036	CONTAINERID=container_1426266260362_0036_01_000007
2015-03-13 10:14:48,308 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0036_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:14:48,308 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0036 container=Container: [ContainerId: container_1426266260362_0036_01_000007, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0036_01_000007 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7 usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:48,308 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:10240, vCores:8>usedCapacity=0.625, absoluteUsedCapacity=0.625, numApps=2, numContainers=8
2015-03-13 10:14:48,308 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.625 absoluteUsedCapacity=0.625 used=<memory:10240, vCores:8> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:48,340 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742261_1437
2015-03-13 10:14:48,341 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742265_1441
2015-03-13 10:14:48,347 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0035_01_000001 succeeded 
2015-03-13 10:14:48,347 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0035_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:14:48,347 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0035_01_000001
2015-03-13 10:14:48,355 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0035/container_1426266260362_0035_01_000001
2015-03-13 10:14:48,355 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0035/container_1426266260362_0035_01_000001
2015-03-13 10:14:48,355 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0035/container_1426266260362_0035_01_000001
2015-03-13 10:14:48,356 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0035/container_1426266260362_0035_01_000001
2015-03-13 10:14:48,356 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0035	CONTAINERID=container_1426266260362_0035_01_000001
2015-03-13 10:14:48,356 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0035_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:14:48,356 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0035_01_000001 from application application_1426266260362_0035
2015-03-13 10:14:48,356 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:14:48,356 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0035
2015-03-13 10:14:49,028 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:49,029 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0036_01_000008 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:14:49,029 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0036	CONTAINERID=container_1426266260362_0036_01_000008
2015-03-13 10:14:49,030 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0036_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:14:49,030 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0036 container=Container: [ContainerId: container_1426266260362_0036_01_000008, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0036_01_000008 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:10240, vCores:8>usedCapacity=0.625, absoluteUsedCapacity=0.625, numApps=2, numContainers=8 usedCapacity=0.625 absoluteUsedCapacity=0.625 used=<memory:10240, vCores:8> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:49,030 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:11264, vCores:9>usedCapacity=0.6875, absoluteUsedCapacity=0.6875, numApps=2, numContainers=9
2015-03-13 10:14:49,030 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.6875 absoluteUsedCapacity=0.6875 used=<memory:11264, vCores:9> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:49,223 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 35 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:14:49,223 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0035_01_000001
2015-03-13 10:14:49,224 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0035_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:14:49,224 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0035_000001
2015-03-13 10:14:49,224 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0035_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:14:49,224 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0035_000001 State change from FINISHING to FINISHED
2015-03-13 10:14:49,224 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0035	CONTAINERID=container_1426266260362_0035_01_000001
2015-03-13 10:14:49,224 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0035 State change from FINISHING to FINISHED
2015-03-13 10:14:49,224 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0035_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:14:49,225 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1426266260362_0035
2015-03-13 10:14:49,225 INFO  amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0035_000001
2015-03-13 10:14:49,225 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:9216, vCores:8> numContainers=8 user=soberoi user-resources=<memory:9216, vCores:8>
2015-03-13 10:14:49,225 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0035,name=[965FB86188914C2F858E802B0FA30893/960BB94BC14B45F0A71D960D1EB660C1] null/(2/2),user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0035/jobhistory/job/job_1426266260362_0035,appMasterHost=Edinburgh.local,startTime=1426266868668,finishTime=1426266882309,finalStatus=SUCCEEDED
2015-03-13 10:14:49,225 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0035_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:8>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=8 usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:8> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:49,226 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:8> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:49,226 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:8>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=8
2015-03-13 10:14:49,226 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0035_000001 released container container_1426266260362_0035_01_000001 on node: host: 10.1.1.144:60715 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:14:49,226 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073742256_1432, blk_1073742248_1424, blk_1073742249_1425, blk_1073742250_1426, blk_1073742251_1427, blk_1073742252_1428]
2015-03-13 10:14:49,226 INFO  capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0035_000001 is done. finalState=FINISHED
2015-03-13 10:14:49,226 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0035 requests cleared
2015-03-13 10:14:49,226 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073742248_1424, blk_1073742249_1425, blk_1073742250_1426, blk_1073742251_1427, blk_1073742252_1428]
2015-03-13 10:14:49,226 INFO  capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0035 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:14:49,226 INFO  capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0035 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:14:49,228 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0035_000001 (auth:SIMPLE)
2015-03-13 10:14:49,229 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0035_01_000001
2015-03-13 10:14:49,237 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0036_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:14:49,237 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0036_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:14:49,237 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0036_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:14:49,237 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0036_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:14:49,237 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0036_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:14:49,237 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0036_01_000007 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:14:49,238 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0036_01_000008 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:14:49,267 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.jar	dst=null	perm=null
2015-03-13 10:14:49,268 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.jar	dst=null	perm=null
2015-03-13 10:14:49,279 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.xml	dst=null	perm=null
2015-03-13 10:14:49,280 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.xml	dst=null	perm=null
2015-03-13 10:14:49,282 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:14:49,283 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:14:49,287 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:14:49,289 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:14:49,290 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:14:49,291 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:14:49,366 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0036_000001 (auth:SIMPLE)
2015-03-13 10:14:49,366 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0036_000001 (auth:SIMPLE)
2015-03-13 10:14:49,366 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0036_000001 (auth:SIMPLE)
2015-03-13 10:14:49,371 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0036_01_000003 by user soberoi
2015-03-13 10:14:49,371 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0036_01_000008 by user soberoi
2015-03-13 10:14:49,371 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0036
2015-03-13 10:14:49,371 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0036	CONTAINERID=container_1426266260362_0036_01_000003
2015-03-13 10:14:49,371 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0036_01_000008 to application application_1426266260362_0036
2015-03-13 10:14:49,371 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0036	CONTAINERID=container_1426266260362_0036_01_000008
2015-03-13 10:14:49,372 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0036_01_000008 transitioned from NEW to LOCALIZING
2015-03-13 10:14:49,372 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0036
2015-03-13 10:14:49,372 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0036
2015-03-13 10:14:49,372 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:14:49,372 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0036
2015-03-13 10:14:49,372 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0036_01_000008 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:14:49,371 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0036 transitioned from NEW to INITING
2015-03-13 10:14:49,372 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0036_01_000003 to application application_1426266260362_0036
2015-03-13 10:14:49,372 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0036 transitioned from INITING to RUNNING
2015-03-13 10:14:49,373 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0036_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:14:49,373 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0036
2015-03-13 10:14:49,373 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0036
2015-03-13 10:14:49,373 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:14:49,373 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0036
2015-03-13 10:14:49,373 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:14:49,373 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:14:49,373 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0036_01_000003
2015-03-13 10:14:49,376 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0036_01_000002 by user soberoi
2015-03-13 10:14:49,376 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0036	CONTAINERID=container_1426266260362_0036_01_000002
2015-03-13 10:14:49,377 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0036_01_000006 by user soberoi
2015-03-13 10:14:49,377 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0036
2015-03-13 10:14:49,377 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0036	CONTAINERID=container_1426266260362_0036_01_000006
2015-03-13 10:14:49,378 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0036_01_000005 by user soberoi
2015-03-13 10:14:49,378 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0036	CONTAINERID=container_1426266260362_0036_01_000005
2015-03-13 10:14:49,378 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0036_01_000007 by user soberoi
2015-03-13 10:14:49,378 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0036	CONTAINERID=container_1426266260362_0036_01_000007
2015-03-13 10:14:49,379 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0036_01_000004 by user soberoi
2015-03-13 10:14:49,379 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0036	CONTAINERID=container_1426266260362_0036_01_000004
2015-03-13 10:14:49,379 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0036_01_000002 to application application_1426266260362_0036
2015-03-13 10:14:49,380 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0036_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:14:49,380 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0036
2015-03-13 10:14:49,380 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0036
2015-03-13 10:14:49,380 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:14:49,380 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0036
2015-03-13 10:14:49,380 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0036_01_000002
2015-03-13 10:14:49,380 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0036 transitioned from NEW to INITING
2015-03-13 10:14:49,381 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0036_01_000006 to application application_1426266260362_0036
2015-03-13 10:14:49,381 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0036_01_000005 to application application_1426266260362_0036
2015-03-13 10:14:49,381 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0036_01_000007 to application application_1426266260362_0036
2015-03-13 10:14:49,381 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0036_01_000004 to application application_1426266260362_0036
2015-03-13 10:14:49,381 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0036 transitioned from INITING to RUNNING
2015-03-13 10:14:49,381 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0036_01_000007 transitioned from NEW to LOCALIZING
2015-03-13 10:14:49,381 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0036_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:14:49,382 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0036_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:14:49,382 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0036_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:14:49,382 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0036
2015-03-13 10:14:49,382 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0036
2015-03-13 10:14:49,382 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:14:49,382 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0036
2015-03-13 10:14:49,382 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:14:49,382 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:14:49,382 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0036
2015-03-13 10:14:49,382 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0036
2015-03-13 10:14:49,382 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:14:49,382 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0036
2015-03-13 10:14:49,383 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0036
2015-03-13 10:14:49,383 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0036
2015-03-13 10:14:49,383 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:14:49,383 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0036
2015-03-13 10:14:49,383 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0036
2015-03-13 10:14:49,383 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0036
2015-03-13 10:14:49,383 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:14:49,383 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0036
2015-03-13 10:14:49,383 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0036_01_000007
2015-03-13 10:14:49,384 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0036_01_000005
2015-03-13 10:14:49,385 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0036_01_000006
2015-03-13 10:14:49,386 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0036_01_000004
2015-03-13 10:14:49,406 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426266260362_0036_01_000003.tokens. Credentials list: 
2015-03-13 10:14:49,409 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426266260362_0036_01_000002.tokens. Credentials list: 
2015-03-13 10:14:49,411 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1426266260362_0036_01_000007.tokens. Credentials list: 
2015-03-13 10:14:49,413 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0036_01_000005.tokens. Credentials list: 
2015-03-13 10:14:49,415 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1426266260362_0036_01_000006.tokens. Credentials list: 
2015-03-13 10:14:49,415 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0036_01_000004.tokens. Credentials list: 
2015-03-13 10:14:49,429 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0036_01_000008 transitioned from LOCALIZED to RUNNING
2015-03-13 10:14:49,429 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:14:49,439 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:14:49,439 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:14:49,543 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0036/container_1426266260362_0036_01_000008/default_container_executor.sh]
2015-03-13 10:14:49,543 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1426266260362_0036_01_000007.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0036/container_1426266260362_0036_01_000007.tokens
2015-03-13 10:14:49,543 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0036 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0036
2015-03-13 10:14:49,544 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426266260362_0036_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0036/container_1426266260362_0036_01_000003.tokens
2015-03-13 10:14:49,544 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0036 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0036
2015-03-13 10:14:49,640 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.jar	dst=null	perm=null
2015-03-13 10:14:49,641 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.jar	dst=null	perm=null
2015-03-13 10:14:49,642 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.jar	dst=null	perm=null
2015-03-13 10:14:49,642 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.jar	dst=null	perm=null
2015-03-13 10:14:49,643 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.jar	dst=null	perm=null
2015-03-13 10:14:49,643 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.jar	dst=null	perm=null
2015-03-13 10:14:49,651 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:64004, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-951340720_19438, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742261_1437, duration: 484000
2015-03-13 10:14:49,651 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64003, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1698618244_19437, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742261_1437, duration: 497000
2015-03-13 10:14:49,675 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:14:49,676 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:14:49,705 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.xml	dst=null	perm=null
2015-03-13 10:14:49,705 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.xml	dst=null	perm=null
2015-03-13 10:14:49,706 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.xml	dst=null	perm=null
2015-03-13 10:14:49,706 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.xml	dst=null	perm=null
2015-03-13 10:14:49,707 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.xml	dst=null	perm=null
2015-03-13 10:14:49,708 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.xml	dst=null	perm=null
2015-03-13 10:14:49,713 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64003, bytes: 100170, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-951340720_19438, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742264_1440, duration: 291000
2015-03-13 10:14:49,716 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:64005, bytes: 100170, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1698618244_19437, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742264_1440, duration: 241000
2015-03-13 10:14:49,738 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:14:49,738 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0036_01_000007 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:14:49,738 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0036_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:14:49,738 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0036_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:14:49,738 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0036_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:14:49,758 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:14:49,758 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0036_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:14:49,759 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0036_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:14:49,802 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0036_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:14:49,802 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:14:49,802 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0036_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:14:49,802 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:14:49,808 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0036_01_000007 transitioned from LOCALIZED to RUNNING
2015-03-13 10:14:49,809 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:14:49,814 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0036_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:14:49,814 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:14:49,814 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0036_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:14:49,814 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:14:49,817 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0036_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:14:49,818 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:14:49,972 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742248_1424 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742248 for deletion
2015-03-13 10:14:49,972 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742249_1425 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742249 for deletion
2015-03-13 10:14:49,973 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742250_1426 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir56/blk_1073742250 for deletion
2015-03-13 10:14:49,973 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742251_1427 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742251 for deletion
2015-03-13 10:14:49,973 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742252_1428 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir56/blk_1073742252 for deletion
2015-03-13 10:14:49,972 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742248_1424 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742248
2015-03-13 10:14:49,973 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742250_1426 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir56/blk_1073742250
2015-03-13 10:14:49,973 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742249_1425 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742249
2015-03-13 10:14:49,973 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742252_1428 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir56/blk_1073742252
2015-03-13 10:14:49,973 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742251_1427 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742251
2015-03-13 10:14:49,988 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0036/container_1426266260362_0036_01_000005/default_container_executor.sh]
2015-03-13 10:14:50,000 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0036/container_1426266260362_0036_01_000004/default_container_executor.sh]
2015-03-13 10:14:50,009 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0036/container_1426266260362_0036_01_000006/default_container_executor.sh]
2015-03-13 10:14:50,018 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0036/container_1426266260362_0036_01_000002/default_container_executor.sh]
2015-03-13 10:14:50,020 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0036/container_1426266260362_0036_01_000003/default_container_executor.sh]
2015-03-13 10:14:50,027 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0036/container_1426266260362_0036_01_000007/default_container_executor.sh]
2015-03-13 10:14:50,029 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:50,029 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 8 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:50,030 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0036_01_000008 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:14:50,030 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0035 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:14:50,030 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0035
2015-03-13 10:14:50,031 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0035 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:14:50,031 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0035, with delay of 10800 seconds
2015-03-13 10:14:50,032 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0035
2015-03-13 10:14:50,032 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0035
2015-03-13 10:14:50,033 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0035
2015-03-13 10:14:50,033 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0035
2015-03-13 10:14:50,167 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742256_1432 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir39/blk_1073742256 for deletion
2015-03-13 10:14:50,167 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742248_1424 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir39/blk_1073742248 for deletion
2015-03-13 10:14:50,167 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742256_1432 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir39/blk_1073742256
2015-03-13 10:14:50,167 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742249_1425 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742249 for deletion
2015-03-13 10:14:50,168 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742250_1426 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir39/blk_1073742250 for deletion
2015-03-13 10:14:50,168 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742248_1424 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir39/blk_1073742248
2015-03-13 10:14:50,168 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742249_1425 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742249
2015-03-13 10:14:50,168 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742251_1427 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742251 for deletion
2015-03-13 10:14:50,168 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742252_1428 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742252 for deletion
2015-03-13 10:14:50,168 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742250_1426 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir39/blk_1073742250
2015-03-13 10:14:50,168 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742252_1428 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742252
2015-03-13 10:14:50,168 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742251_1427 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742251
2015-03-13 10:14:50,174 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0035 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:14:50,174 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0035
2015-03-13 10:14:50,174 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0035
2015-03-13 10:14:50,174 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0035
2015-03-13 10:14:50,174 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0035
2015-03-13 10:14:50,174 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0035 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:14:50,174 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0035, with delay of 10800 seconds
2015-03-13 10:14:50,175 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0035
2015-03-13 10:14:50,224 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:50,224 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:50,224 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0035 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:14:50,224 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0036_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:14:50,225 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0036_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:14:50,225 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0035
2015-03-13 10:14:50,225 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0035
2015-03-13 10:14:50,225 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0035 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:14:50,225 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0035, with delay of 10800 seconds
2015-03-13 10:14:50,225 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0035
2015-03-13 10:14:50,226 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0035
2015-03-13 10:14:50,226 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0035
2015-03-13 10:14:50,254 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:14:50,307 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:50,307 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:50,307 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:50,307 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:50,308 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0036_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:14:50,308 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0036_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:14:50,308 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0036_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:14:50,308 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0036_01_000007 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:14:50,769 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:14:50,797 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:14:50,885 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0036_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0036/container_1426266260362_0036_01_000004.tokens
2015-03-13 10:14:50,885 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0036 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0036
2015-03-13 10:14:50,909 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426266260362_0036_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0036/container_1426266260362_0036_01_000002.tokens
2015-03-13 10:14:50,909 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0036 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0036
2015-03-13 10:14:50,974 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:14:51,034 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:51,034 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 8 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:51,090 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1426266260362_0036_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0036/container_1426266260362_0036_01_000006.tokens
2015-03-13 10:14:51,091 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0036 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0036
2015-03-13 10:14:51,216 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:14:51,225 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:51,225 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:51,312 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:51,313 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:51,313 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:51,313 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:51,337 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0036_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0036/container_1426266260362_0036_01_000005.tokens
2015-03-13 10:14:51,337 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0036 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0036
2015-03-13 10:14:51,381 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742265_1441
2015-03-13 10:14:52,035 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:52,035 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 8 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:52,227 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:52,227 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:52,316 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:52,316 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:52,317 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:52,317 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:53,040 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:53,040 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 8 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:53,227 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:53,228 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:53,322 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:53,323 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:53,323 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:53,323 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:54,044 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:54,045 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 8 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:54,228 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:54,228 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:54,326 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:54,326 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:54,326 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:54,326 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:55,049 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:55,049 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 8 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:55,229 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:55,229 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:55,328 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:55,328 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:55,329 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:55,329 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:56,051 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:56,051 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 8 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:56,229 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:56,229 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:56,331 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:56,331 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:56,331 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:56,331 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:57,052 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:57,052 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 8 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:57,231 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:57,232 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:57,332 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:57,332 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:57,332 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:57,332 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:58,055 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:58,056 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 8 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:58,234 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:58,234 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:58,334 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:58,334 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:58,335 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:58,335 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:59,061 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:59,061 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 8 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:59,238 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:59,238 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:59,340 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:59,340 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:59,341 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:59,341 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:00,067 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:00,067 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 8 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:00,241 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:00,241 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:00,346 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:00,347 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:00,347 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:00,347 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:00,542 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.split	dst=null	perm=null
2015-03-13 10:15:00,817 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.split	dst=null	perm=null
2015-03-13 10:15:00,827 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:64018, bytes: 422, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0036_m_000006_0_-1308191517_1, offset: 2048, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742262_1438, duration: 141000
2015-03-13 10:15:00,916 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.split	dst=null	perm=null
2015-03-13 10:15:00,966 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.split	dst=null	perm=null
2015-03-13 10:15:00,990 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.split	dst=null	perm=null
2015-03-13 10:15:01,069 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:01,069 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 8 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:01,073 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.split	dst=null	perm=null
2015-03-13 10:15:01,095 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.20.txt	dst=null	perm=null
2015-03-13 10:15:01,095 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:64023, bytes: 1970, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0036_m_000002_0_156337584_1, offset: 512, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742262_1438, duration: 148000
2015-03-13 10:15:01,099 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:64018, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0036_m_000006_0_-1308191517_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742247_1423, duration: 145000
2015-03-13 10:15:01,135 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job.split	dst=null	perm=null
2015-03-13 10:15:01,174 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64026, bytes: 938, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0036_m_000005_0_1726064478_1, offset: 1536, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742262_1438, duration: 157000
2015-03-13 10:15:01,191 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:64025, bytes: 2486, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0036_m_000001_0_-480417836_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742262_1438, duration: 147000
2015-03-13 10:15:01,246 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:01,247 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:01,257 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:64028, bytes: 2486, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0036_m_000000_0_589317300_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742262_1438, duration: 133000
2015-03-13 10:15:01,309 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA/part-00003	dst=null	perm=null
2015-03-13 10:15:01,318 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA/part-00003	dst=null	perm=null
2015-03-13 10:15:01,321 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64031, bytes: 107, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0036_m_000002_0_156337584_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742257_1433, duration: 168000
2015-03-13 10:15:01,322 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64029, bytes: 1454, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0036_m_000004_0_1304219594_1, offset: 1024, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742262_1438, duration: 146000
2015-03-13 10:15:01,341 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64030, bytes: 1454, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0036_m_000003_0_-1632238713_1, offset: 1024, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742262_1438, duration: 168000
2015-03-13 10:15:01,351 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:01,351 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:01,351 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:01,352 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:01,360 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.20.txt	dst=null	perm=null
2015-03-13 10:15:01,376 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:64032, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0036_m_000005_0_1726064478_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742247_1423, duration: 160000
2015-03-13 10:15:01,378 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA/part-00001	dst=null	perm=null
2015-03-13 10:15:01,387 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA/part-00001	dst=null	perm=null
2015-03-13 10:15:01,389 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64033, bytes: 122, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0036_m_000001_0_-480417836_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742255_1431, duration: 157000
2015-03-13 10:15:01,436 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA/part-00000	dst=null	perm=null
2015-03-13 10:15:01,446 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA/part-00000	dst=null	perm=null
2015-03-13 10:15:01,449 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:64034, bytes: 122, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0036_m_000000_0_589317300_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742254_1430, duration: 151000
2015-03-13 10:15:01,508 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/nums.20.txt	dst=null	perm=null
2015-03-13 10:15:01,510 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA/part-00002	dst=null	perm=null
2015-03-13 10:15:01,534 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA/part-00002	dst=null	perm=null
2015-03-13 10:15:01,566 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:64035, bytes: 106, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0036_m_000003_0_-1632238713_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742253_1429, duration: 144000
2015-03-13 10:15:01,835 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinMergeGroupBy/hashjoin/_temporary/1/_temporary/attempt_1426266260362_0036_m_000006_0	dst=null	perm=null
2015-03-13 10:15:01,885 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0036_000001 (auth:SIMPLE)
2015-03-13 10:15:01,887 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0036_01_000008
2015-03-13 10:15:01,887 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0036	CONTAINERID=container_1426266260362_0036_01_000008
2015-03-13 10:15:01,887 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0036_01_000008 transitioned from RUNNING to KILLING
2015-03-13 10:15:01,887 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0036_01_000008
2015-03-13 10:15:01,887 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:01,888 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 8 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:15:01,902 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0036_01_000008 is : 143
2015-03-13 10:15:01,907 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job_1426266260362_0036_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073742266_1442{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:15:01,909 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742266_1442 src: /127.0.0.1:64038 dest: /127.0.0.1:60686
2015-03-13 10:15:01,910 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742266_1442 src: /127.0.0.1:64039 dest: /127.0.0.1:60696
2015-03-13 10:15:01,911 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742266_1442 src: /127.0.0.1:64040 dest: /127.0.0.1:60689
2015-03-13 10:15:01,915 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0036_01_000008 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:15:01,915 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0036/container_1426266260362_0036_01_000008
2015-03-13 10:15:01,915 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0036/container_1426266260362_0036_01_000008
2015-03-13 10:15:01,915 INFO  hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job_1426266260362_0036_1.jhist for DFSClient_NONMAPREDUCE_-1156178742_1
2015-03-13 10:15:01,916 INFO  namenode.FSEditLog (FSEditLog.java:printStatistics(663)) - Number of transactions: 3712 Total time for transactions(ms): 155 Number of transactions batched in Syncs: 14 Number of syncs: 2114 SyncTimes(ms): 601 477 
2015-03-13 10:15:01,916 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0036/container_1426266260362_0036_01_000008
2015-03-13 10:15:01,916 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0036/container_1426266260362_0036_01_000008
2015-03-13 10:15:01,916 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0036	CONTAINERID=container_1426266260362_0036_01_000008
2015-03-13 10:15:01,917 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0036_01_000008 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:15:01,918 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0036_01_000008 from application application_1426266260362_0036
2015-03-13 10:15:01,918 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:15:01,918 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0036
2015-03-13 10:15:02,077 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinMergeGroupBy/hashjoin/_temporary/1/_temporary/attempt_1426266260362_0036_m_000002_0	dst=null	perm=null
2015-03-13 10:15:02,094 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0036_000001 (auth:SIMPLE)
2015-03-13 10:15:02,096 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0036_01_000004
2015-03-13 10:15:02,096 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0036	CONTAINERID=container_1426266260362_0036_01_000004
2015-03-13 10:15:02,096 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0036_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:15:02,096 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0036_01_000004
2015-03-13 10:15:02,096 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:15:02,096 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:02,096 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:02,097 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:02,106 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinMergeGroupBy/hashjoin/_temporary/1/_temporary/attempt_1426266260362_0036_m_000005_0	dst=null	perm=null
2015-03-13 10:15:02,109 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0036_01_000004 is : 143
2015-03-13 10:15:02,120 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0036_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:15:02,120 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0036/container_1426266260362_0036_01_000004
2015-03-13 10:15:02,121 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0036/container_1426266260362_0036_01_000004
2015-03-13 10:15:02,121 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0036/container_1426266260362_0036_01_000004
2015-03-13 10:15:02,121 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0036/container_1426266260362_0036_01_000004
2015-03-13 10:15:02,121 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0036	CONTAINERID=container_1426266260362_0036_01_000004
2015-03-13 10:15:02,122 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0036_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:15:02,122 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0036_01_000004 from application application_1426266260362_0036
2015-03-13 10:15:02,122 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:15:02,122 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0036
2015-03-13 10:15:02,126 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0036_01_000007
2015-03-13 10:15:02,127 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0036	CONTAINERID=container_1426266260362_0036_01_000007
2015-03-13 10:15:02,127 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0036_01_000007 transitioned from RUNNING to KILLING
2015-03-13 10:15:02,127 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:15:02,127 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0036_01_000007
2015-03-13 10:15:02,127 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0036_01_000004
2015-03-13 10:15:02,127 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:02,128 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:02,128 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:15:02,128 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0036_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:15:02,128 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0036_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:15:02,128 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0036	CONTAINERID=container_1426266260362_0036_01_000004
2015-03-13 10:15:02,128 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0036_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:15:02,128 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:8192, vCores:7> numContainers=7 user=soberoi user-resources=<memory:8192, vCores:7>
2015-03-13 10:15:02,129 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0036_01_000004, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:7>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=1, numContainers=7 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:02,129 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:02,129 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:7>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=1, numContainers=7
2015-03-13 10:15:02,129 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0036_000001 released container container_1426266260362_0036_01_000004 on node: host: 10.1.1.144:60711 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:15:02,140 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0036_01_000007 is : 143
2015-03-13 10:15:02,152 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0036_01_000007 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:15:02,152 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0036/container_1426266260362_0036_01_000007
2015-03-13 10:15:02,152 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0036/container_1426266260362_0036_01_000007
2015-03-13 10:15:02,153 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0036/container_1426266260362_0036_01_000007
2015-03-13 10:15:02,153 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0036/container_1426266260362_0036_01_000007
2015-03-13 10:15:02,153 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0036	CONTAINERID=container_1426266260362_0036_01_000007
2015-03-13 10:15:02,154 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0036_01_000007 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:15:02,154 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0036_01_000007 from application application_1426266260362_0036
2015-03-13 10:15:02,154 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:15:02,154 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0036
2015-03-13 10:15:02,190 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinMergeGroupBy/hashjoin/_temporary/1/_temporary/attempt_1426266260362_0036_m_000001_0	dst=null	perm=null
2015-03-13 10:15:02,209 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0036_000001 (auth:SIMPLE)
2015-03-13 10:15:02,211 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0036_01_000003
2015-03-13 10:15:02,211 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0036	CONTAINERID=container_1426266260362_0036_01_000003
2015-03-13 10:15:02,211 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0036_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:15:02,211 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0036_01_000003
2015-03-13 10:15:02,211 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:02,211 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:15:02,224 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0036_01_000003 is : 143
2015-03-13 10:15:02,228 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinMergeGroupBy/hashjoin/_temporary/1/_temporary/attempt_1426266260362_0036_m_000000_0	dst=null	perm=null
2015-03-13 10:15:02,237 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0036_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:15:02,237 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0036/container_1426266260362_0036_01_000003
2015-03-13 10:15:02,237 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0036/container_1426266260362_0036_01_000003
2015-03-13 10:15:02,237 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0036/container_1426266260362_0036_01_000003
2015-03-13 10:15:02,237 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0036/container_1426266260362_0036_01_000003
2015-03-13 10:15:02,237 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0036	CONTAINERID=container_1426266260362_0036_01_000003
2015-03-13 10:15:02,237 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0036_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:15:02,237 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0036_01_000003 from application application_1426266260362_0036
2015-03-13 10:15:02,238 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:15:02,238 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0036
2015-03-13 10:15:02,241 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0036_01_000002
2015-03-13 10:15:02,241 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0036	CONTAINERID=container_1426266260362_0036_01_000002
2015-03-13 10:15:02,241 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0036_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:15:02,241 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0036_01_000002
2015-03-13 10:15:02,241 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:15:02,241 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:15:02,242 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0036_01_000003
2015-03-13 10:15:02,242 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0036_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:15:02,242 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0036_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:15:02,242 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0036	CONTAINERID=container_1426266260362_0036_01_000003
2015-03-13 10:15:02,242 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0036_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:15:02,242 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:7168, vCores:6> numContainers=6 user=soberoi user-resources=<memory:7168, vCores:6>
2015-03-13 10:15:02,242 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0036_01_000003, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=1, numContainers=6 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:02,243 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:02,243 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=1, numContainers=6
2015-03-13 10:15:02,243 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0036_000001 released container container_1426266260362_0036_01_000003 on node: host: 10.1.1.144:60715 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:15:02,254 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0036_01_000002 is : 143
2015-03-13 10:15:02,284 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0036_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:15:02,284 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0036/container_1426266260362_0036_01_000002
2015-03-13 10:15:02,284 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0036/container_1426266260362_0036_01_000002
2015-03-13 10:15:02,284 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0036/container_1426266260362_0036_01_000002
2015-03-13 10:15:02,284 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0036	CONTAINERID=container_1426266260362_0036_01_000002
2015-03-13 10:15:02,284 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0036_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:15:02,284 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0036/container_1426266260362_0036_01_000002
2015-03-13 10:15:02,284 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0036_01_000002 from application application_1426266260362_0036
2015-03-13 10:15:02,285 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:15:02,285 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0036
2015-03-13 10:15:02,301 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:64043, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0036_m_000004_0_1304219594_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742247_1423, duration: 160000
2015-03-13 10:15:02,349 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinMergeGroupBy/hashjoin/_temporary/1/_temporary/attempt_1426266260362_0036_m_000004_0	dst=null	perm=null
2015-03-13 10:15:02,370 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinMergeGroupBy/hashjoin/_temporary/1/_temporary/attempt_1426266260362_0036_m_000003_0	dst=null	perm=null
2015-03-13 10:15:02,378 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0036_01_000006
2015-03-13 10:15:02,378 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0036	CONTAINERID=container_1426266260362_0036_01_000006
2015-03-13 10:15:02,379 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0036_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:15:02,383 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0036_01_000006
2015-03-13 10:15:02,384 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:02,384 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:15:02,384 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:15:02,384 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0036_01_000007
2015-03-13 10:15:02,387 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0036_01_000007 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:15:02,387 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0036_01_000007 in state: COMPLETED event:FINISHED
2015-03-13 10:15:02,387 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0036	CONTAINERID=container_1426266260362_0036_01_000007
2015-03-13 10:15:02,387 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0036_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:15:02,387 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:15:02,387 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0036_01_000007, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:02,387 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:02,387 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:15:02,387 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0036_000001 released container container_1426266260362_0036_01_000007 on node: host: 10.1.1.144:60711 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:15:02,397 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0036_01_000005
2015-03-13 10:15:02,397 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0036	CONTAINERID=container_1426266260362_0036_01_000005
2015-03-13 10:15:02,398 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:02,398 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:15:02,400 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0036_01_000006 is : 143
2015-03-13 10:15:02,415 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0036_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:15:02,415 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0036_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:15:02,415 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0036_01_000005
2015-03-13 10:15:02,427 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0036_01_000005 is : 143
2015-03-13 10:15:02,439 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0036/container_1426266260362_0036_01_000006
2015-03-13 10:15:02,439 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0036/container_1426266260362_0036_01_000006
2015-03-13 10:15:02,440 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0036/container_1426266260362_0036_01_000006
2015-03-13 10:15:02,440 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0036/container_1426266260362_0036_01_000006
2015-03-13 10:15:02,440 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0036_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:15:02,440 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0036	CONTAINERID=container_1426266260362_0036_01_000006
2015-03-13 10:15:02,441 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0036_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:15:02,441 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0036/container_1426266260362_0036_01_000005
2015-03-13 10:15:02,441 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0036/container_1426266260362_0036_01_000005
2015-03-13 10:15:02,442 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0036/container_1426266260362_0036_01_000005
2015-03-13 10:15:02,442 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0036/container_1426266260362_0036_01_000005
2015-03-13 10:15:02,442 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0036_01_000006 from application application_1426266260362_0036
2015-03-13 10:15:02,442 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:15:02,442 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0036
2015-03-13 10:15:02,443 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0036	CONTAINERID=container_1426266260362_0036_01_000005
2015-03-13 10:15:02,443 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0036_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:15:02,443 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0036_01_000005 from application application_1426266260362_0036
2015-03-13 10:15:02,443 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:15:02,443 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0036
2015-03-13 10:15:02,891 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:02,891 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 8 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:15:02,891 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0036_01_000008
2015-03-13 10:15:02,892 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0036_01_000008 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:15:02,892 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0036_01_000008 in state: COMPLETED event:FINISHED
2015-03-13 10:15:02,892 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0036	CONTAINERID=container_1426266260362_0036_01_000008
2015-03-13 10:15:02,892 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0036_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:15:02,893 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:15:02,894 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0036_01_000008, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:02,894 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:02,894 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:15:02,894 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0036_000001 released container container_1426266260362_0036_01_000008 on node: host: 10.1.1.144:60723 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:15:03,247 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:15:03,247 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0036_01_000002
2015-03-13 10:15:03,248 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0036_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:15:03,248 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0036_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:15:03,248 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0036	CONTAINERID=container_1426266260362_0036_01_000002
2015-03-13 10:15:03,248 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0036_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:15:03,249 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:15:03,249 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0036_01_000002, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:03,249 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:03,249 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:15:03,249 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0036_000001 released container container_1426266260362_0036_01_000002 on node: host: 10.1.1.144:60715 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:15:03,401 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:15:03,401 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0036_01_000005
2015-03-13 10:15:03,401 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:15:03,401 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0036_01_000006
2015-03-13 10:15:03,402 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0036_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:15:03,402 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0036_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:15:03,402 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0036	CONTAINERID=container_1426266260362_0036_01_000005
2015-03-13 10:15:03,402 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0036_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:15:03,403 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:15:03,403 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0036_01_000005, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:03,403 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:03,403 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:15:03,403 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0036_000001 released container container_1426266260362_0036_01_000005 on node: host: 10.1.1.144:60711 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:15:03,403 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0036_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:15:03,403 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0036_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:15:03,403 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0036	CONTAINERID=container_1426266260362_0036_01_000006
2015-03-13 10:15:03,404 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0036_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:15:03,404 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:15:03,404 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0036_01_000006, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:03,404 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:03,404 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:15:03,404 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0036_000001 released container container_1426266260362_0036_01_000006 on node: host: 10.1.1.144:60711 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:15:03,404 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0036_01_000009 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:15:03,404 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0036	CONTAINERID=container_1426266260362_0036_01_000009
2015-03-13 10:15:03,404 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0036_01_000009 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:15:03,405 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0036 container=Container: [ContainerId: container_1426266260362_0036_01_000009, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0036_01_000009 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:03,405 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:15:03,405 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:03,892 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:04,318 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0036_01_000009 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:15:04,326 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0036_01_000009 by user soberoi
2015-03-13 10:15:04,326 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0036	CONTAINERID=container_1426266260362_0036_01_000009
2015-03-13 10:15:04,326 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0036_01_000009 to application application_1426266260362_0036
2015-03-13 10:15:04,327 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0036_01_000009 transitioned from NEW to LOCALIZING
2015-03-13 10:15:04,327 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0036
2015-03-13 10:15:04,327 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0036
2015-03-13 10:15:04,327 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:15:04,327 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0036
2015-03-13 10:15:04,327 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0036_01_000009 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:15:04,351 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0036_01_000009 transitioned from LOCALIZED to RUNNING
2015-03-13 10:15:04,351 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:15:04,404 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 9 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:04,405 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0036_01_000009 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:15:04,418 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0036/container_1426266260362_0036_01_000009/default_container_executor.sh]
2015-03-13 10:15:04,893 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:05,323 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:15:05,406 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 9 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:05,895 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:06,412 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 9 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:06,730 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinMergeGroupBy/hashjoin/_temporary/1/_temporary/attempt_1426266260362_0036_r_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:15:06,773 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinMergeGroupBy/hashjoin/_temporary/1/_temporary/attempt_1426266260362_0036_r_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073742267_1443{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:15:06,827 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742267_1443 src: /127.0.0.1:64051 dest: /127.0.0.1:60693
2015-03-13 10:15:06,828 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742267_1443 src: /127.0.0.1:64052 dest: /127.0.0.1:60686
2015-03-13 10:15:06,829 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742267_1443 src: /127.0.0.1:64053 dest: /127.0.0.1:60696
2015-03-13 10:15:06,839 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64053, dest: /127.0.0.1:60696, bytes: 101, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0036_r_000000_0_183202732_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742267_1443, duration: 8183000
2015-03-13 10:15:06,839 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742267_1443, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:15:06,839 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742267_1443{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:15:06,839 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64052, dest: /127.0.0.1:60686, bytes: 101, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0036_r_000000_0_183202732_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742267_1443, duration: 8637000
2015-03-13 10:15:06,839 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742267_1443, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:06,840 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742267_1443{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:15:06,840 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64051, dest: /127.0.0.1:60693, bytes: 101, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0036_r_000000_0_183202732_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742267_1443, duration: 9401000
2015-03-13 10:15:06,840 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742267_1443, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:06,840 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742267_1443{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:15:06,843 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinMergeGroupBy/hashjoin/_temporary/1/_temporary/attempt_1426266260362_0036_r_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0036_r_000000_0_183202732_1
2015-03-13 10:15:06,850 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinMergeGroupBy/hashjoin/_temporary/1/_temporary/attempt_1426266260362_0036_r_000000_0	dst=null	perm=null
2015-03-13 10:15:06,856 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinMergeGroupBy/hashjoin/_temporary/1/_temporary/attempt_1426266260362_0036_r_000000_0	dst=null	perm=null
2015-03-13 10:15:06,856 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinMergeGroupBy/hashjoin/_temporary/1/task_1426266260362_0036_r_000000	dst=null	perm=null
2015-03-13 10:15:06,859 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinMergeGroupBy/hashjoin/_temporary/1/_temporary/attempt_1426266260362_0036_r_000000_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinMergeGroupBy/hashjoin/_temporary/1/task_1426266260362_0036_r_000000	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:15:06,866 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0036_01_000009
2015-03-13 10:15:06,866 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0036	CONTAINERID=container_1426266260362_0036_01_000009
2015-03-13 10:15:06,866 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0036_01_000009 transitioned from RUNNING to KILLING
2015-03-13 10:15:06,866 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0036_01_000009
2015-03-13 10:15:06,867 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 9 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:15:06,871 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:15:06,873 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-1156178742_1
2015-03-13 10:15:06,877 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinMergeGroupBy/hashjoin/_temporary/1	dst=null	perm=null
2015-03-13 10:15:06,877 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0036_01_000009 is : 143
2015-03-13 10:15:06,884 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinMergeGroupBy/hashjoin	dst=null	perm=null
2015-03-13 10:15:06,885 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinMergeGroupBy/hashjoin	dst=null	perm=null
2015-03-13 10:15:06,886 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinMergeGroupBy/hashjoin/_temporary/1/task_1426266260362_0036_r_000000	dst=null	perm=null
2015-03-13 10:15:06,887 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0036_01_000009 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:15:06,887 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0036/container_1426266260362_0036_01_000009
2015-03-13 10:15:06,887 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0036/container_1426266260362_0036_01_000009
2015-03-13 10:15:06,887 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0036	CONTAINERID=container_1426266260362_0036_01_000009
2015-03-13 10:15:06,887 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0036_01_000009 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:15:06,887 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0036_01_000009 from application application_1426266260362_0036
2015-03-13 10:15:06,887 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0036/container_1426266260362_0036_01_000009
2015-03-13 10:15:06,888 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0036/container_1426266260362_0036_01_000009
2015-03-13 10:15:06,887 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:15:06,888 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0036
2015-03-13 10:15:06,889 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinMergeGroupBy/hashjoin/part-00000	dst=null	perm=null
2015-03-13 10:15:06,891 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinMergeGroupBy/hashjoin/_temporary/1/task_1426266260362_0036_r_000000/part-00000	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinMergeGroupBy/hashjoin/part-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:15:06,895 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinMergeGroupBy/hashjoin/_temporary	dst=null	perm=null
2015-03-13 10:15:06,897 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:06,898 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinMergeGroupBy/hashjoin/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:15:06,900 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinMergeGroupBy/hashjoin/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-1156178742_1
2015-03-13 10:15:06,901 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:15:06,902 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-1156178742_1
2015-03-13 10:15:06,916 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64040, dest: /127.0.0.1:60689, bytes: 83106, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1156178742_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742266_1442, duration: 5002961000
2015-03-13 10:15:06,916 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742266_1442, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:15:06,917 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742266_1442{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:15:06,917 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64039, dest: /127.0.0.1:60696, bytes: 83106, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1156178742_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742266_1442, duration: 5003972000
2015-03-13 10:15:06,917 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742266_1442, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:06,918 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742266_1442{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:15:06,918 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64038, dest: /127.0.0.1:60686, bytes: 83106, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1156178742_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742266_1442, duration: 5005337000
2015-03-13 10:15:06,918 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742266_1442, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:06,919 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742266_1442{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:15:06,920 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job_1426266260362_0036_1.jhist is closed by DFSClient_NONMAPREDUCE_-1156178742_1
2015-03-13 10:15:06,922 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0036.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:15:06,924 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0036.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742268_1444{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:15:06,925 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742268_1444 src: /127.0.0.1:64054 dest: /127.0.0.1:60693
2015-03-13 10:15:06,926 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742268_1444 src: /127.0.0.1:64055 dest: /127.0.0.1:60689
2015-03-13 10:15:06,928 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742268_1444 src: /127.0.0.1:64056 dest: /127.0.0.1:60686
2015-03-13 10:15:06,930 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64056, dest: /127.0.0.1:60686, bytes: 448, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1156178742_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742268_1444, duration: 1035000
2015-03-13 10:15:06,930 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742268_1444, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:15:06,931 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742268_1444{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:15:06,931 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64055, dest: /127.0.0.1:60689, bytes: 448, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1156178742_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742268_1444, duration: 1438000
2015-03-13 10:15:06,931 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742268_1444, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:06,931 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742268_1444{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:15:06,931 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64054, dest: /127.0.0.1:60693, bytes: 448, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1156178742_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742268_1444, duration: 2233000
2015-03-13 10:15:06,932 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742268_1444, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:06,932 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742268_1444{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:15:06,933 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0036.summary_tmp is closed by DFSClient_NONMAPREDUCE_-1156178742_1
2015-03-13 10:15:06,936 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0036.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:15:06,940 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job_1426266260362_0036_1.jhist	dst=null	perm=null
2015-03-13 10:15:06,941 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0036-1426266883457-soberoi-%5B965FB86188914C2F858E802B0FA30893%2F02B21DDD5990483A-1426266906903-7-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:15:06,944 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job_1426266260362_0036_1.jhist	dst=null	perm=null
2015-03-13 10:15:06,945 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0036-1426266883457-soberoi-%5B965FB86188914C2F858E802B0FA30893%2F02B21DDD5990483A-1426266906903-7-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:15:06,946 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job_1426266260362_0036_1.jhist	dst=null	perm=null
2015-03-13 10:15:06,947 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0036-1426266883457-soberoi-%5B965FB86188914C2F858E802B0FA30893%2F02B21DDD5990483A-1426266906903-7-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:15:06,949 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64057, bytes: 83758, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1156178742_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742266_1442, duration: 316000
2015-03-13 10:15:06,951 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0036-1426266883457-soberoi-%5B965FB86188914C2F858E802B0FA30893%2F02B21DDD5990483A-1426266906903-7-1-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742269_1445{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:15:06,952 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742269_1445 src: /127.0.0.1:64058 dest: /127.0.0.1:60696
2015-03-13 10:15:06,954 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742269_1445 src: /127.0.0.1:64059 dest: /127.0.0.1:60693
2015-03-13 10:15:06,955 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742269_1445 src: /127.0.0.1:64060 dest: /127.0.0.1:60686
2015-03-13 10:15:06,958 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64060, dest: /127.0.0.1:60686, bytes: 83106, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1156178742_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742269_1445, duration: 1824000
2015-03-13 10:15:06,958 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742269_1445, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:15:06,958 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742269_1445{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:15:06,958 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64059, dest: /127.0.0.1:60693, bytes: 83106, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1156178742_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742269_1445, duration: 2336000
2015-03-13 10:15:06,959 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742269_1445, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:06,959 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742269_1445{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:15:06,959 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64058, dest: /127.0.0.1:60696, bytes: 83106, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1156178742_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742269_1445, duration: 3335000
2015-03-13 10:15:06,960 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742269_1445, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:06,960 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742269_1445{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:15:06,961 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0036-1426266883457-soberoi-%5B965FB86188914C2F858E802B0FA30893%2F02B21DDD5990483A-1426266906903-7-1-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-1156178742_1
2015-03-13 10:15:06,962 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0036-1426266883457-soberoi-%5B965FB86188914C2F858E802B0FA30893%2F02B21DDD5990483A-1426266906903-7-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:15:06,964 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job_1426266260362_0036_1_conf.xml	dst=null	perm=null
2015-03-13 10:15:06,964 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0036_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:15:06,965 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job_1426266260362_0036_1_conf.xml	dst=null	perm=null
2015-03-13 10:15:06,966 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0036_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:15:06,966 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036/job_1426266260362_0036_1_conf.xml	dst=null	perm=null
2015-03-13 10:15:06,968 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0036_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:15:06,971 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:64061, bytes: 92587, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1156178742_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742265_1441, duration: 277000
2015-03-13 10:15:06,972 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0036_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742270_1446{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:15:06,974 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742270_1446 src: /127.0.0.1:64062 dest: /127.0.0.1:60689
2015-03-13 10:15:06,975 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742270_1446 src: /127.0.0.1:64063 dest: /127.0.0.1:60693
2015-03-13 10:15:06,976 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742270_1446 src: /127.0.0.1:64064 dest: /127.0.0.1:60686
2015-03-13 10:15:06,979 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64064, dest: /127.0.0.1:60686, bytes: 91867, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1156178742_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742270_1446, duration: 1786000
2015-03-13 10:15:06,979 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742270_1446, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:15:06,979 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742270_1446{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:15:06,980 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64063, dest: /127.0.0.1:60693, bytes: 91867, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1156178742_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742270_1446, duration: 2272000
2015-03-13 10:15:06,980 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742270_1446, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:06,980 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742270_1446{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:15:06,980 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64062, dest: /127.0.0.1:60689, bytes: 91867, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1156178742_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742270_1446, duration: 3130000
2015-03-13 10:15:06,981 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742270_1446, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:06,981 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742270_1446{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:15:06,982 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0036_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-1156178742_1
2015-03-13 10:15:06,983 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0036_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:15:06,985 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0036.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0036.summary	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:15:06,986 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0036_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0036_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:15:06,988 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0036-1426266883457-soberoi-%5B965FB86188914C2F858E802B0FA30893%2F02B21DDD5990483A-1426266906903-7-1-SUCCEEDED-default.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0036-1426266883457-soberoi-%5B965FB86188914C2F858E802B0FA30893%2F02B21DDD5990483A-1426266906903-7-1-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:15:06,996 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0036_000001 State change from RUNNING to FINISHING
2015-03-13 10:15:06,996 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0036
2015-03-13 10:15:06,996 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0036 State change from RUNNING to REMOVING
2015-03-13 10:15:06,996 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0036
2015-03-13 10:15:06,996 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0036 State change from REMOVING to FINISHING
2015-03-13 10:15:07,543 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742270_1446
2015-03-13 10:15:07,544 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742266_1442
2015-03-13 10:15:07,747 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742269_1445
2015-03-13 10:15:07,747 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742267_1443
2015-03-13 10:15:07,747 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742268_1444
2015-03-13 10:15:07,808 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742269_1445
2015-03-13 10:15:07,809 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742270_1446
2015-03-13 10:15:07,809 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742267_1443
2015-03-13 10:15:07,809 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742268_1444
2015-03-13 10:15:07,867 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 9 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:15:07,868 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0036_01_000009
2015-03-13 10:15:07,868 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0036_01_000009 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:15:07,868 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0036_01_000009 in state: COMPLETED event:FINISHED
2015-03-13 10:15:07,868 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0036	CONTAINERID=container_1426266260362_0036_01_000009
2015-03-13 10:15:07,869 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0036_01_000009 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:15:07,869 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:15:07,869 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0036_01_000009, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:07,869 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:07,869 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:15:07,869 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0036_000001 released container container_1426266260362_0036_01_000009 on node: host: 10.1.1.144:60711 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:15:07,903 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:08,002 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742261_1437 127.0.0.1:60689 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60696 
2015-03-13 10:15:08,002 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742262_1438 127.0.0.1:60686 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60689 
2015-03-13 10:15:08,002 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742263_1439 127.0.0.1:60689 127.0.0.1:60696 127.0.0.1:60686 
2015-03-13 10:15:08,002 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742264_1440 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60686 
2015-03-13 10:15:08,003 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742266_1442 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60689 
2015-03-13 10:15:08,003 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742265_1441 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60689 
2015-03-13 10:15:08,003 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0036	dst=null	perm=null
2015-03-13 10:15:08,030 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742254_1430 127.0.0.1:60693 127.0.0.1:60689 127.0.0.1:60696 
2015-03-13 10:15:08,030 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742255_1431 127.0.0.1:60689 127.0.0.1:60696 127.0.0.1:60686 
2015-03-13 10:15:08,030 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742253_1429 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60689 
2015-03-13 10:15:08,030 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742257_1433 127.0.0.1:60686 127.0.0.1:60693 127.0.0.1:60689 
2015-03-13 10:15:08,031 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-soberoi/5416442242_lhs_rhs_1D16C8169F0F4E4FA9D862E85975D1FA	dst=null	perm=null
2015-03-13 10:15:08,031 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinMergeGroupBy/hashjoin	dst=null	perm=null
2015-03-13 10:15:08,032 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinMergeGroupBy/hashjoin/_temporary
2015-03-13 10:15:08,032 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinMergeGroupBy/hashjoin/_temporary	dst=null	perm=null
2015-03-13 10:15:08,038 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:15:08,038 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:15:08,039 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:15:08,040 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinMergeGroupBy/hashjoin	dst=null	perm=null
2015-03-13 10:15:08,040 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinMergeGroupBy/hashjoin	dst=null	perm=null
2015-03-13 10:15:08,041 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinMergeGroupBy/hashjoin	dst=null	perm=null
2015-03-13 10:15:08,041 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:15:08,042 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinMergeGroupBy/hashjoin/part-00000	dst=null	perm=null
2015-03-13 10:15:08,044 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:64066, bytes: 105, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742267_1443, duration: 178000
2015-03-13 10:15:08,050 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:15:08,050 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:15:08,050 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:15:08,051 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinMergeGroupBy/hashjoin	dst=null	perm=null
2015-03-13 10:15:08,052 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinMergeGroupBy/hashjoin	dst=null	perm=null
2015-03-13 10:15:08,052 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinMergeGroupBy/hashjoin	dst=null	perm=null
2015-03-13 10:15:08,053 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:15:08,053 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinMergeGroupBy/hashjoin/part-00000	dst=null	perm=null
2015-03-13 10:15:08,054 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:64066, bytes: 105, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742267_1443, duration: 178000
2015-03-13 10:15:08,055 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/testJoinMergeGroupBy/hashjoin
2015-03-13 10:15:08,055 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinMergeGroupBy/hashjoin	dst=null	perm=null
2015-03-13 10:15:08,056 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinMergeGroupBy/hashjoin	dst=null	perm=null
2015-03-13 10:15:08,056 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinMergeGroupBy/hashjoin	dst=null	perm=null
2015-03-13 10:15:08,057 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinMergeGroupBy/hashjoin	dst=null	perm=null
2015-03-13 10:15:08,057 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinMergeGroupBy/hashjoin/part-00000	dst=null	perm=null
2015-03-13 10:15:08,058 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/testJoinMergeGroupBy/hashjoin/part-00000	dst=null	perm=null
2015-03-13 10:15:08,060 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:64067, bytes: 105, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742267_1443, duration: 176000
2015-03-13 10:15:08,061 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:15:08,075 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:15:08,076 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:15:08,077 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:15:08,082 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2	dst=null	perm=null
2015-03-13 10:15:08,083 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower] starting
2015-03-13 10:15:08,083 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-03-13 10:15:08,084 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower]  sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2"]
2015-03-13 10:15:08,084 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower]  parallel execution is enabled: true
2015-03-13 10:15:08,084 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower]  starting jobs: 1
2015-03-13 10:15:08,084 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower]  allocating threads: 1
2015-03-13 10:15:08,085 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower] starting step: (1/1) ...edpipesplatform/samepipe2
2015-03-13 10:15:08,092 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:15:08,098 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:15:08,100 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2	dst=null	perm=null
2015-03-13 10:15:08,100 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:15:08,101 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:15:08,102 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 37
2015-03-13 10:15:08,103 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037	dst=null	perm=null
2015-03-13 10:15:08,104 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037	dst=null	perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:15:08,105 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037	dst=null	perm=soberoi:supergroup:rwx------
2015-03-13 10:15:08,105 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.jar	dst=null	perm=null
2015-03-13 10:15:08,106 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:15:08,108 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073742271_1447{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:15:08,109 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742271_1447 src: /127.0.0.1:64069 dest: /127.0.0.1:60693
2015-03-13 10:15:08,110 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742271_1447 src: /127.0.0.1:64070 dest: /127.0.0.1:60686
2015-03-13 10:15:08,111 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742271_1447 src: /127.0.0.1:64071 dest: /127.0.0.1:60696
2015-03-13 10:15:08,115 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64071, dest: /127.0.0.1:60696, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742271_1447, duration: 1894000
2015-03-13 10:15:08,115 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742271_1447, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:15:08,115 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742271_1447{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:15:08,115 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64070, dest: /127.0.0.1:60686, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742271_1447, duration: 2406000
2015-03-13 10:15:08,115 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742271_1447, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:08,116 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742271_1447{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:15:08,116 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64069, dest: /127.0.0.1:60693, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742271_1447, duration: 3248000
2015-03-13 10:15:08,116 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742271_1447, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:08,117 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742271_1447{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:15:08,117 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:15:08,118 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.jar
2015-03-13 10:15:08,118 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.jar	dst=null	perm=null
2015-03-13 10:15:08,119 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:15:08,120 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:15:08,120 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:15:08,121 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:15:08,121 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:15:08,122 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:15:08,122 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:15:08,123 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:15:08,123 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:15:08,123 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:15:08,125 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:15:08,125 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:15:08,125 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:15:08,127 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:15:08,128 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:15:08,128 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.split
2015-03-13 10:15:08,129 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.split	dst=null	perm=null
2015-03-13 10:15:08,129 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073742272_1448{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:15:08,131 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742272_1448 src: /127.0.0.1:64072 dest: /127.0.0.1:60696
2015-03-13 10:15:08,132 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742272_1448 src: /127.0.0.1:64073 dest: /127.0.0.1:60689
2015-03-13 10:15:08,133 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742272_1448 src: /127.0.0.1:64074 dest: /127.0.0.1:60686
2015-03-13 10:15:08,134 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742272_1448 src: /127.0.0.1:64075 dest: /127.0.0.1:60693
2015-03-13 10:15:08,136 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64075, dest: /127.0.0.1:60693, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742272_1448, duration: 1550000
2015-03-13 10:15:08,136 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742272_1448, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:15:08,137 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742272_1448{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:15:08,137 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64074, dest: /127.0.0.1:60686, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742272_1448, duration: 1890000
2015-03-13 10:15:08,137 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742272_1448, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:08,138 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742272_1448{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:15:08,138 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64073, dest: /127.0.0.1:60689, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742272_1448, duration: 2563000
2015-03-13 10:15:08,138 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742272_1448, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:08,138 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742272_1448{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:15:08,138 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64072, dest: /127.0.0.1:60696, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742272_1448, duration: 3453000
2015-03-13 10:15:08,138 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742272_1448, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:08,139 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742272_1448{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:15:08,140 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:15:08,142 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:15:08,143 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:15:08,144 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073742273_1449{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:15:08,145 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742273_1449 src: /127.0.0.1:64076 dest: /127.0.0.1:60686
2015-03-13 10:15:08,146 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742273_1449 src: /127.0.0.1:64077 dest: /127.0.0.1:60693
2015-03-13 10:15:08,147 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742273_1449 src: /127.0.0.1:64078 dest: /127.0.0.1:60696
2015-03-13 10:15:08,149 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64078, dest: /127.0.0.1:60696, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742273_1449, duration: 1200000
2015-03-13 10:15:08,149 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742273_1449, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:15:08,149 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742273_1449{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:15:08,149 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64077, dest: /127.0.0.1:60693, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742273_1449, duration: 1523000
2015-03-13 10:15:08,149 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742273_1449, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:08,150 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742273_1449{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:15:08,150 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64076, dest: /127.0.0.1:60686, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742273_1449, duration: 2205000
2015-03-13 10:15:08,150 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742273_1449, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:08,151 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742273_1449{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:15:08,154 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:15:08,155 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:15:08,156 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:15:08,157 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:15:08,158 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:15:08,158 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:15:08,158 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:15:08,161 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742274_1450{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:15:08,162 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742274_1450 src: /127.0.0.1:64079 dest: /127.0.0.1:60696
2015-03-13 10:15:08,163 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742274_1450 src: /127.0.0.1:64080 dest: /127.0.0.1:60689
2015-03-13 10:15:08,164 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742274_1450 src: /127.0.0.1:64081 dest: /127.0.0.1:60693
2015-03-13 10:15:08,167 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64081, dest: /127.0.0.1:60693, bytes: 96797, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742274_1450, duration: 1308000
2015-03-13 10:15:08,167 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742274_1450, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:15:08,167 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742274_1450{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:15:08,167 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64080, dest: /127.0.0.1:60689, bytes: 96797, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742274_1450, duration: 1647000
2015-03-13 10:15:08,168 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742274_1450, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:08,168 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742274_1450{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:15:08,168 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64079, dest: /127.0.0.1:60696, bytes: 96797, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742274_1450, duration: 2512000
2015-03-13 10:15:08,169 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742274_1450, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:08,169 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742274_1450{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:15:08,171 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:15:08,171 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0037
2015-03-13 10:15:08,172 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037	dst=null	perm=null
2015-03-13 10:15:08,172 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.xml	dst=null	perm=null
2015-03-13 10:15:08,173 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.xml	dst=null	perm=null
2015-03-13 10:15:08,173 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.jar	dst=null	perm=null
2015-03-13 10:15:08,174 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.jar	dst=null	perm=null
2015-03-13 10:15:08,174 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.split	dst=null	perm=null
2015-03-13 10:15:08,175 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.split	dst=null	perm=null
2015-03-13 10:15:08,175 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:15:08,176 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:15:08,177 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:15:08,178 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:15:08,178 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:15:08,179 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:15:08,180 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:15:08,180 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:15:08,181 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 37 submitted by user soberoi
2015-03-13 10:15:08,181 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0037
2015-03-13 10:15:08,181 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	IP=10.1.1.144	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1426266260362_0037
2015-03-13 10:15:08,181 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0037
2015-03-13 10:15:08,181 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0037 State change from NEW to NEW_SAVING
2015-03-13 10:15:08,182 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0037 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:15:08,182 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0037_000001
2015-03-13 10:15:08,182 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0037_000001 State change from NEW to SUBMITTED
2015-03-13 10:15:08,182 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0037 from user: soberoi activated in queue: default
2015-03-13 10:15:08,182 INFO  capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0037 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:15:08,182 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0037 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:15:08,182 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0037 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:15:08,182 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0037_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:15:08,183 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0037_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:15:08,184 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0037 State change from SUBMITTED to ACCEPTED
2015-03-13 10:15:08,185 INFO  mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0037/
2015-03-13 10:15:08,185 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower] submitted hadoop job: job_1426266260362_0037
2015-03-13 10:15:08,185 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0037/
2015-03-13 10:15:08,214 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0037_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:15:08,214 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0037	CONTAINERID=container_1426266260362_0037_01_000001
2015-03-13 10:15:08,214 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0037_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:15:08,214 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0037 container=Container: [ContainerId: container_1426266260362_0037_01_000001, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0037_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:08,215 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:15:08,215 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0037_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:15:08,215 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:08,216 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0037 AttemptId: appattempt_1426266260362_0037_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0037_01_000001, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ]
2015-03-13 10:15:08,216 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0037_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:15:08,216 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0037_000001
2015-03-13 10:15:08,216 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0037_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:15:08,216 INFO  amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0037_000001
2015-03-13 10:15:08,217 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0037_01_000001, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] for AM appattempt_1426266260362_0037_000001
2015-03-13 10:15:08,217 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0037_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-03-13 10:15:08,219 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0037_000001 (auth:SIMPLE)
2015-03-13 10:15:08,220 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0037_01_000001 by user soberoi
2015-03-13 10:15:08,220 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0037
2015-03-13 10:15:08,220 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0037	CONTAINERID=container_1426266260362_0037_01_000001
2015-03-13 10:15:08,221 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0037 transitioned from NEW to INITING
2015-03-13 10:15:08,221 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0037_01_000001 to application application_1426266260362_0037
2015-03-13 10:15:08,221 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0037 transitioned from INITING to RUNNING
2015-03-13 10:15:08,221 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0037_01_000001, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] for AM appattempt_1426266260362_0037_000001
2015-03-13 10:15:08,221 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0037_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:15:08,221 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0037_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:15:08,221 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0037
2015-03-13 10:15:08,221 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:15:08,221 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:15:08,222 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:15:08,222 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:15:08,222 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0037_01_000001
2015-03-13 10:15:08,231 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426266260362_0037_01_000001.tokens. Credentials list: 
2015-03-13 10:15:08,246 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:15:08,310 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426266260362_0037_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0037/container_1426266260362_0037_01_000001.tokens
2015-03-13 10:15:08,311 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0037 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0037
2015-03-13 10:15:08,355 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742269_1445
2015-03-13 10:15:08,356 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742274_1450
2015-03-13 10:15:08,365 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.jar	dst=null	perm=null
2015-03-13 10:15:08,366 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.jar	dst=null	perm=null
2015-03-13 10:15:08,366 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.jar	dst=null	perm=null
2015-03-13 10:15:08,373 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64085, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_2073429676_19909, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742271_1447, duration: 322000
2015-03-13 10:15:08,391 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:15:08,410 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:15:08,411 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:15:08,411 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:15:08,417 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64085, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_2073429676_19909, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742273_1449, duration: 168000
2015-03-13 10:15:08,429 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:15:08,445 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.split	dst=null	perm=null
2015-03-13 10:15:08,445 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.split	dst=null	perm=null
2015-03-13 10:15:08,446 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.split	dst=null	perm=null
2015-03-13 10:15:08,452 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:64086, bytes: 1798, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_2073429676_19909, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742272_1448, duration: 176000
2015-03-13 10:15:08,464 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:15:08,480 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.xml	dst=null	perm=null
2015-03-13 10:15:08,480 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.xml	dst=null	perm=null
2015-03-13 10:15:08,481 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.xml	dst=null	perm=null
2015-03-13 10:15:08,486 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:64066, bytes: 97557, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_2073429676_19909, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742274_1450, duration: 316000
2015-03-13 10:15:08,498 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:15:08,498 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0037_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:15:08,522 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0037_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:15:08,522 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:15:08,558 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742271_1447
2015-03-13 10:15:08,559 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742266_1442
2015-03-13 10:15:08,559 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742267_1443
2015-03-13 10:15:08,559 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742273_1449
2015-03-13 10:15:08,559 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742272_1448
2015-03-13 10:15:08,594 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0037/container_1426266260362_0037_01_000001/default_container_executor.sh]
2015-03-13 10:15:08,904 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:09,218 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:09,218 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0037_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:15:09,909 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:10,150 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:15:10,171 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/COMMIT_STARTED	dst=null	perm=null
2015-03-13 10:15:10,172 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/COMMIT_SUCCESS	dst=null	perm=null
2015-03-13 10:15:10,173 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/COMMIT_FAIL	dst=null	perm=null
2015-03-13 10:15:10,222 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:10,223 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037	dst=null	perm=null
2015-03-13 10:15:10,224 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:15:10,225 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:15:10,241 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60696 to replicate blk_1073742271_1447 to datanode(s) 127.0.0.1:60689
2015-03-13 10:15:10,241 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073742257_1433, blk_1073742261_1437, blk_1073742262_1438, blk_1073742263_1439, blk_1073742264_1440, blk_1073742265_1441, blk_1073742266_1442, blk_1073742253_1429, blk_1073742254_1430, blk_1073742255_1431]
2015-03-13 10:15:10,241 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073742261_1437, blk_1073742262_1438, blk_1073742263_1439, blk_1073742264_1440, blk_1073742265_1441, blk_1073742266_1442, blk_1073742253_1429, blk_1073742254_1430, blk_1073742255_1431]
2015-03-13 10:15:10,499 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:15:10,505 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:15:10,561 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64088, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_198358789_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742273_1449, duration: 173000
2015-03-13 10:15:10,755 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742257_1433 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742257 for deletion
2015-03-13 10:15:10,755 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742261_1437 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir57/blk_1073742261 for deletion
2015-03-13 10:15:10,755 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742262_1438 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir2/blk_1073742262 for deletion
2015-03-13 10:15:10,756 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742263_1439 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir57/blk_1073742263 for deletion
2015-03-13 10:15:10,756 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742264_1440 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir2/blk_1073742264 for deletion
2015-03-13 10:15:10,756 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742265_1441 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir57/blk_1073742265 for deletion
2015-03-13 10:15:10,756 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742266_1442 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742266 for deletion
2015-03-13 10:15:10,756 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742253_1429 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742253 for deletion
2015-03-13 10:15:10,756 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742254_1430 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir2/blk_1073742254 for deletion
2015-03-13 10:15:10,756 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742255_1431 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742255 for deletion
2015-03-13 10:15:10,757 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742257_1433 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742257
2015-03-13 10:15:10,757 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742261_1437 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir57/blk_1073742261
2015-03-13 10:15:10,757 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742263_1439 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir57/blk_1073742263
2015-03-13 10:15:10,757 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742265_1441 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir57/blk_1073742265
2015-03-13 10:15:10,757 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742253_1429 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742253
2015-03-13 10:15:10,758 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742255_1431 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742255
2015-03-13 10:15:10,758 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742262_1438 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir2/blk_1073742262
2015-03-13 10:15:10,758 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742264_1440 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir2/blk_1073742264
2015-03-13 10:15:10,758 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742266_1442 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742266
2015-03-13 10:15:10,759 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742254_1430 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir2/blk_1073742254
2015-03-13 10:15:10,913 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:11,186 INFO  datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-318492837-10.1.1.144-60696-1426266259571, infoPort=60697, ipcPort=60698, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073742271_1447 to 127.0.0.1:60689 
2015-03-13 10:15:11,187 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742261_1437 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir39/blk_1073742261 for deletion
2015-03-13 10:15:11,187 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742262_1438 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742262 for deletion
2015-03-13 10:15:11,187 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742263_1439 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir39/blk_1073742263 for deletion
2015-03-13 10:15:11,187 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742264_1440 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742264 for deletion
2015-03-13 10:15:11,187 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742265_1441 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742265 for deletion
2015-03-13 10:15:11,187 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742266_1442 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742266 for deletion
2015-03-13 10:15:11,187 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742253_1429 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742253 for deletion
2015-03-13 10:15:11,187 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742254_1430 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir39/blk_1073742254 for deletion
2015-03-13 10:15:11,187 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742255_1431 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742255 for deletion
2015-03-13 10:15:11,188 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742261_1437 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir39/blk_1073742261
2015-03-13 10:15:11,188 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742263_1439 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir39/blk_1073742263
2015-03-13 10:15:11,188 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742266_1442 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742266
2015-03-13 10:15:11,189 INFO  datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073742271_1447 (numBytes=254067) to /127.0.0.1:60689
2015-03-13 10:15:11,188 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742262_1438 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742262
2015-03-13 10:15:11,189 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742264_1440 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742264
2015-03-13 10:15:11,189 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742254_1430 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir39/blk_1073742254
2015-03-13 10:15:11,189 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742265_1441 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742265
2015-03-13 10:15:11,189 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742253_1429 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742253
2015-03-13 10:15:11,189 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742271_1447 src: /127.0.0.1:64091 dest: /127.0.0.1:60689
2015-03-13 10:15:11,190 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742255_1431 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742255
2015-03-13 10:15:11,191 INFO  datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073742271_1447 src: /127.0.0.1:64091 dest: /127.0.0.1:60689 of size 254067
2015-03-13 10:15:11,192 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742271_1447 size 254067
2015-03-13 10:15:11,223 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:11,314 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0037_000001 (auth:SIMPLE)
2015-03-13 10:15:11,316 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0037_000001
2015-03-13 10:15:11,316 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi	IP=10.1.1.144	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1426266260362_0037	APPATTEMPTID=appattempt_1426266260362_0037_000001
2015-03-13 10:15:11,316 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0037_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:15:11,316 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0037 State change from ACCEPTED to RUNNING
2015-03-13 10:15:11,335 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job_1426266260362_0037_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:15:11,338 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:15:11,396 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job_1426266260362_0037_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:15:11,399 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742271_1447
2015-03-13 10:15:11,400 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742270_1446
2015-03-13 10:15:11,400 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742268_1444
2015-03-13 10:15:11,515 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job_1426266260362_0037_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742275_1451{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:15:11,550 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742275_1451 src: /127.0.0.1:64095 dest: /127.0.0.1:60696
2015-03-13 10:15:11,551 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742275_1451 src: /127.0.0.1:64096 dest: /127.0.0.1:60686
2015-03-13 10:15:11,553 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742275_1451 src: /127.0.0.1:64097 dest: /127.0.0.1:60693
2015-03-13 10:15:11,560 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64097, dest: /127.0.0.1:60693, bytes: 89590, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_198358789_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742275_1451, duration: 5724000
2015-03-13 10:15:11,560 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742275_1451, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:15:11,560 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742275_1451{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:15:11,560 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64096, dest: /127.0.0.1:60686, bytes: 89590, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_198358789_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742275_1451, duration: 6329000
2015-03-13 10:15:11,561 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742275_1451, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:11,561 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742275_1451{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:15:11,561 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64095, dest: /127.0.0.1:60696, bytes: 89590, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_198358789_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742275_1451, duration: 7308000
2015-03-13 10:15:11,562 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742275_1451, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:11,562 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742275_1451{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:15:11,566 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job_1426266260362_0037_1_conf.xml is closed by DFSClient_NONMAPREDUCE_198358789_1
2015-03-13 10:15:11,599 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742272_1448
2015-03-13 10:15:11,600 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742274_1450
2015-03-13 10:15:11,917 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:12,224 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:12,756 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742273_1449
2015-03-13 10:15:12,757 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742275_1451
2015-03-13 10:15:12,758 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742271_1447
2015-03-13 10:15:12,758 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742272_1448
2015-03-13 10:15:12,816 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742274_1450
2015-03-13 10:15:12,817 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742273_1449
2015-03-13 10:15:12,817 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742275_1451
2015-03-13 10:15:12,892 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0037_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:15:12,892 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0037	CONTAINERID=container_1426266260362_0037_01_000002
2015-03-13 10:15:12,892 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0037_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:15:12,892 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0037 container=Container: [ContainerId: container_1426266260362_0037_01_000002, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0037_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:12,893 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:15:12,893 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:12,893 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0037_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:15:12,893 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0037	CONTAINERID=container_1426266260362_0037_01_000003
2015-03-13 10:15:12,894 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0037_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:15:12,894 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0037 container=Container: [ContainerId: container_1426266260362_0037_01_000003, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0037_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:12,894 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:15:12,894 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:12,895 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0037_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:15:12,895 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0037	CONTAINERID=container_1426266260362_0037_01_000004
2015-03-13 10:15:12,895 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0037_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:15:12,895 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0037 container=Container: [ContainerId: container_1426266260362_0037_01_000004, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0037_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:12,895 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:15:12,895 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:12,896 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0037_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:15:12,896 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0037	CONTAINERID=container_1426266260362_0037_01_000005
2015-03-13 10:15:12,896 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0037_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:15:12,896 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0037 container=Container: [ContainerId: container_1426266260362_0037_01_000005, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0037_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:12,896 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:15:12,896 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:12,921 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:12,922 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0037_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:15:12,922 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0037	CONTAINERID=container_1426266260362_0037_01_000006
2015-03-13 10:15:12,922 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0037_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:15:12,922 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0037 container=Container: [ContainerId: container_1426266260362_0037_01_000006, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0037_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:12,923 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7
2015-03-13 10:15:12,923 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:13,018 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742271_1447
2015-03-13 10:15:13,018 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742272_1448
2015-03-13 10:15:13,137 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0036_01_000001 succeeded 
2015-03-13 10:15:13,137 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0036_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:15:13,137 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0036_01_000001
2015-03-13 10:15:13,145 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0036/container_1426266260362_0036_01_000001
2015-03-13 10:15:13,145 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0036/container_1426266260362_0036_01_000001
2015-03-13 10:15:13,145 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0036	CONTAINERID=container_1426266260362_0036_01_000001
2015-03-13 10:15:13,145 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0036_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:15:13,145 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0036/container_1426266260362_0036_01_000001
2015-03-13 10:15:13,145 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0036/container_1426266260362_0036_01_000001
2015-03-13 10:15:13,146 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0036_01_000001 from application application_1426266260362_0036
2015-03-13 10:15:13,146 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:15:13,146 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0036
2015-03-13 10:15:13,225 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:13,247 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073742257_1433, blk_1073742261_1437, blk_1073742262_1438, blk_1073742263_1439, blk_1073742264_1440, blk_1073742266_1442, blk_1073742255_1431]
2015-03-13 10:15:13,247 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073742257_1433, blk_1073742261_1437, blk_1073742262_1438, blk_1073742265_1441, blk_1073742253_1429, blk_1073742254_1430]
2015-03-13 10:15:13,350 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0037_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:15:13,350 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0037_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:15:13,350 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0037_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:15:13,350 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0037_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:15:13,351 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0037_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:15:13,377 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.jar	dst=null	perm=null
2015-03-13 10:15:13,378 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.jar	dst=null	perm=null
2015-03-13 10:15:13,386 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.xml	dst=null	perm=null
2015-03-13 10:15:13,387 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.xml	dst=null	perm=null
2015-03-13 10:15:13,389 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:15:13,391 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:15:13,395 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:15:13,397 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:15:13,398 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:15:13,399 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:15:13,476 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0037_000001 (auth:SIMPLE)
2015-03-13 10:15:13,476 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0037_000001 (auth:SIMPLE)
2015-03-13 10:15:13,479 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0037_01_000006 by user soberoi
2015-03-13 10:15:13,480 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0037_01_000004 by user soberoi
2015-03-13 10:15:13,480 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0037
2015-03-13 10:15:13,480 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0037
2015-03-13 10:15:13,480 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0037	CONTAINERID=container_1426266260362_0037_01_000006
2015-03-13 10:15:13,480 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0037	CONTAINERID=container_1426266260362_0037_01_000004
2015-03-13 10:15:13,480 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0037_01_000003 by user soberoi
2015-03-13 10:15:13,480 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0037	CONTAINERID=container_1426266260362_0037_01_000003
2015-03-13 10:15:13,480 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0037_01_000002 by user soberoi
2015-03-13 10:15:13,481 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0037 transitioned from NEW to INITING
2015-03-13 10:15:13,481 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0037_01_000006 to application application_1426266260362_0037
2015-03-13 10:15:13,481 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0037 transitioned from NEW to INITING
2015-03-13 10:15:13,480 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0037_01_000005 by user soberoi
2015-03-13 10:15:13,481 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0037	CONTAINERID=container_1426266260362_0037_01_000005
2015-03-13 10:15:13,481 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0037_01_000004 to application application_1426266260362_0037
2015-03-13 10:15:13,482 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0037_01_000003 to application application_1426266260362_0037
2015-03-13 10:15:13,482 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0037_01_000002 to application application_1426266260362_0037
2015-03-13 10:15:13,482 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0037_01_000005 to application application_1426266260362_0037
2015-03-13 10:15:13,482 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0037 transitioned from INITING to RUNNING
2015-03-13 10:15:13,481 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0037 transitioned from INITING to RUNNING
2015-03-13 10:15:13,483 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0037_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:15:13,483 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0037_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:15:13,483 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0037_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:15:13,481 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0037	CONTAINERID=container_1426266260362_0037_01_000002
2015-03-13 10:15:13,483 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0037_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:15:13,483 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0037_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:15:13,483 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0037
2015-03-13 10:15:13,483 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0037
2015-03-13 10:15:13,483 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:15:13,484 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0037
2015-03-13 10:15:13,484 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:15:13,484 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:15:13,484 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0037
2015-03-13 10:15:13,484 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0037
2015-03-13 10:15:13,484 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:15:13,484 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0037
2015-03-13 10:15:13,483 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0037
2015-03-13 10:15:13,484 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0037
2015-03-13 10:15:13,484 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:15:13,484 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0037
2015-03-13 10:15:13,484 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0037
2015-03-13 10:15:13,484 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:15:13,484 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0037
2015-03-13 10:15:13,485 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:15:13,485 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:15:13,485 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0037
2015-03-13 10:15:13,485 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0037_01_000006
2015-03-13 10:15:13,485 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0037
2015-03-13 10:15:13,485 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0037
2015-03-13 10:15:13,485 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:15:13,485 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0037
2015-03-13 10:15:13,485 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0037_01_000005
2015-03-13 10:15:13,486 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0037_01_000002
2015-03-13 10:15:13,486 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0037_01_000003
2015-03-13 10:15:13,487 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0037_01_000004
2015-03-13 10:15:13,507 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0037_01_000003.tokens. Credentials list: 
2015-03-13 10:15:13,507 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1426266260362_0037_01_000004.tokens. Credentials list: 
2015-03-13 10:15:13,507 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1426266260362_0037_01_000002.tokens. Credentials list: 
2015-03-13 10:15:13,508 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1426266260362_0037_01_000006.tokens. Credentials list: 
2015-03-13 10:15:13,508 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0037_01_000005.tokens. Credentials list: 
2015-03-13 10:15:13,525 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:15:13,525 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:15:13,566 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742275_1451
2015-03-13 10:15:13,600 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0037_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0037/container_1426266260362_0037_01_000003.tokens
2015-03-13 10:15:13,600 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1426266260362_0037_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0037/container_1426266260362_0037_01_000006.tokens
2015-03-13 10:15:13,600 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0037 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0037
2015-03-13 10:15:13,600 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0037 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0037
2015-03-13 10:15:13,664 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.jar	dst=null	perm=null
2015-03-13 10:15:13,665 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.jar	dst=null	perm=null
2015-03-13 10:15:13,665 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.jar	dst=null	perm=null
2015-03-13 10:15:13,665 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.jar	dst=null	perm=null
2015-03-13 10:15:13,666 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.jar	dst=null	perm=null
2015-03-13 10:15:13,666 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.jar	dst=null	perm=null
2015-03-13 10:15:13,673 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64104, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1811696130_20056, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742271_1447, duration: 469000
2015-03-13 10:15:13,673 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:64105, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1418652279_20055, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742271_1447, duration: 495000
2015-03-13 10:15:13,693 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:15:13,693 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:15:13,719 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.xml	dst=null	perm=null
2015-03-13 10:15:13,719 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.xml	dst=null	perm=null
2015-03-13 10:15:13,720 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.xml	dst=null	perm=null
2015-03-13 10:15:13,720 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.xml	dst=null	perm=null
2015-03-13 10:15:13,720 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.xml	dst=null	perm=null
2015-03-13 10:15:13,720 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.xml	dst=null	perm=null
2015-03-13 10:15:13,727 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:64107, bytes: 97557, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1418652279_20055, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742274_1450, duration: 247000
2015-03-13 10:15:13,727 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:64106, bytes: 97557, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1811696130_20056, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742274_1450, duration: 276000
2015-03-13 10:15:13,741 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:15:13,741 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0037_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:15:13,741 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0037_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:15:13,741 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0037_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:15:13,741 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:15:13,741 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0037_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:15:13,741 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0037_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:15:13,782 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742257_1433 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742257 for deletion
2015-03-13 10:15:13,782 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742261_1437 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742261 for deletion
2015-03-13 10:15:13,782 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742262_1438 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742262 for deletion
2015-03-13 10:15:13,782 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742263_1439 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742263 for deletion
2015-03-13 10:15:13,783 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742264_1440 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742264 for deletion
2015-03-13 10:15:13,783 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742266_1442 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742266 for deletion
2015-03-13 10:15:13,783 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742255_1431 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742255 for deletion
2015-03-13 10:15:13,783 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742262_1438 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742262
2015-03-13 10:15:13,783 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742264_1440 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742264
2015-03-13 10:15:13,783 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742255_1431 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742255
2015-03-13 10:15:13,783 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742257_1433 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742257
2015-03-13 10:15:13,784 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742261_1437 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742261
2015-03-13 10:15:13,784 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742263_1439 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742263
2015-03-13 10:15:13,784 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742266_1442 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742266
2015-03-13 10:15:13,793 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0037_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:15:13,793 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0037_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:15:13,794 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:15:13,794 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:15:13,794 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0037_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:15:13,794 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:15:13,794 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0037_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:15:13,795 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:15:13,795 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0037_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:15:13,795 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:15:13,893 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:13,893 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:13,893 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:13,893 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:13,894 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0037_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:15:13,894 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0037_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:15:13,894 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0037_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:15:13,894 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0037_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:15:13,922 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 36 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:15:13,922 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0036_01_000001
2015-03-13 10:15:13,922 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:13,923 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0037_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:15:13,924 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0036_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:15:13,924 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0036_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:15:13,924 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0036	CONTAINERID=container_1426266260362_0036_01_000001
2015-03-13 10:15:13,924 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0036_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:15:13,924 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:7168, vCores:6> numContainers=6 user=soberoi user-resources=<memory:7168, vCores:6>
2015-03-13 10:15:13,924 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0036_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:13,925 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:13,925 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6
2015-03-13 10:15:13,925 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0036_000001
2015-03-13 10:15:13,925 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0036_000001 released container container_1426266260362_0036_01_000001 on node: host: 10.1.1.144:60723 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:15:13,925 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0036_000001 State change from FINISHING to FINISHED
2015-03-13 10:15:13,925 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0036 State change from FINISHING to FINISHED
2015-03-13 10:15:13,925 INFO  capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0036_000001 is done. finalState=FINISHED
2015-03-13 10:15:13,925 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0036 requests cleared
2015-03-13 10:15:13,925 INFO  capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0036 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:15:13,925 INFO  capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0036 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:15:13,925 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1426266260362_0036
2015-03-13 10:15:13,926 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0036,name=[965FB86188914C2F858E802B0FA30893/02B21DDD5990483A85D5008DAA74B1FB] null/(1/2) ...JoinMergeGroupBy/hashjoin,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0036/jobhistory/job/job_1426266260362_0036,appMasterHost=Edinburgh.local,startTime=1426266883457,finishTime=1426266906996,finalStatus=SUCCEEDED
2015-03-13 10:15:13,925 INFO  amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0036_000001
2015-03-13 10:15:13,927 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0037/container_1426266260362_0037_01_000006/default_container_executor.sh]
2015-03-13 10:15:13,928 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0036_000001 (auth:SIMPLE)
2015-03-13 10:15:13,929 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0037/container_1426266260362_0037_01_000005/default_container_executor.sh]
2015-03-13 10:15:13,930 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0037/container_1426266260362_0037_01_000002/default_container_executor.sh]
2015-03-13 10:15:13,931 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0036_01_000001
2015-03-13 10:15:13,940 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0037/container_1426266260362_0037_01_000004/default_container_executor.sh]
2015-03-13 10:15:13,940 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0037/container_1426266260362_0037_01_000003/default_container_executor.sh]
2015-03-13 10:15:13,995 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742257_1433 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742257 for deletion
2015-03-13 10:15:13,995 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742261_1437 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742261 for deletion
2015-03-13 10:15:13,995 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742262_1438 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742262 for deletion
2015-03-13 10:15:13,995 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742265_1441 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742265 for deletion
2015-03-13 10:15:13,995 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742253_1429 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742253 for deletion
2015-03-13 10:15:13,995 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742254_1430 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742254 for deletion
2015-03-13 10:15:13,996 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742257_1433 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742257
2015-03-13 10:15:13,996 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742261_1437 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742261
2015-03-13 10:15:13,996 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742265_1441 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742265
2015-03-13 10:15:13,996 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742262_1438 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742262
2015-03-13 10:15:13,996 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742253_1429 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742253
2015-03-13 10:15:13,997 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742254_1430 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742254
2015-03-13 10:15:14,226 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:14,270 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0036 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:15:14,271 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0036
2015-03-13 10:15:14,271 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0036
2015-03-13 10:15:14,271 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0036 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:15:14,271 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0036, with delay of 10800 seconds
2015-03-13 10:15:14,271 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0036
2015-03-13 10:15:14,271 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0036
2015-03-13 10:15:14,271 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0036
2015-03-13 10:15:14,364 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:15:14,774 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:15:14,899 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:14,899 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:14,899 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:14,899 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:14,900 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0036 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:15:14,900 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0036
2015-03-13 10:15:14,918 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0036
2015-03-13 10:15:14,919 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0036
2015-03-13 10:15:14,919 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0036
2015-03-13 10:15:14,919 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0036 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:15:14,919 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0036, with delay of 10800 seconds
2015-03-13 10:15:14,919 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0036
2015-03-13 10:15:14,921 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0037_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0037/container_1426266260362_0037_01_000005.tokens
2015-03-13 10:15:14,921 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0037 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0037
2015-03-13 10:15:14,925 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:14,925 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0036 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:15:14,925 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0036
2015-03-13 10:15:14,925 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0036
2015-03-13 10:15:14,925 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0036
2015-03-13 10:15:14,926 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0036
2015-03-13 10:15:14,926 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0036
2015-03-13 10:15:14,926 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0036 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:15:14,926 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0036, with delay of 10800 seconds
2015-03-13 10:15:15,029 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:15:15,159 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1426266260362_0037_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0037/container_1426266260362_0037_01_000004.tokens
2015-03-13 10:15:15,159 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0037 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0037
2015-03-13 10:15:15,231 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:15,258 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:15:15,375 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1426266260362_0037_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0037/container_1426266260362_0037_01_000002.tokens
2015-03-13 10:15:15,376 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0037 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0037
2015-03-13 10:15:15,904 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:15,904 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:15,904 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:15,904 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:15,925 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:16,236 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:16,907 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:16,907 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:16,907 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:16,908 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:16,927 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:17,241 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:17,909 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:17,909 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:17,909 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:17,910 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:17,928 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:18,244 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:18,914 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:18,914 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:18,914 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:18,914 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:18,932 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:19,247 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:19,917 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:19,918 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:19,918 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:19,918 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:19,938 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:20,251 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:20,921 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:20,921 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:20,921 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:20,921 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:20,941 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:21,256 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:21,927 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:21,927 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:21,927 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:21,927 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:21,945 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:21,981 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.split	dst=null	perm=null
2015-03-13 10:15:22,095 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.split	dst=null	perm=null
2015-03-13 10:15:22,096 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.split	dst=null	perm=null
2015-03-13 10:15:22,163 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.split	dst=null	perm=null
2015-03-13 10:15:22,201 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job.split	dst=null	perm=null
2015-03-13 10:15:22,226 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64121, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0037_m_000003_0_910781425_1, offset: 1024, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742272_1448, duration: 154000
2015-03-13 10:15:22,256 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:22,266 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:64123, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0037_m_000004_0_-1721288628_1, offset: 1024, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742272_1448, duration: 194000
2015-03-13 10:15:22,273 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:64124, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0037_m_000000_0_1665862476_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742272_1448, duration: 149000
2015-03-13 10:15:22,340 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64125, bytes: 1282, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0037_m_000002_0_1357487425_1, offset: 512, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742272_1448, duration: 176000
2015-03-13 10:15:22,346 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:15:22,350 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64121, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0037_m_000003_0_910781425_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 175000
2015-03-13 10:15:22,365 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:64126, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0037_m_000001_0_739525124_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742272_1448, duration: 167000
2015-03-13 10:15:22,379 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/_temporary/1/_temporary/attempt_1426266260362_0037_m_000003_0/part-00003	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:15:22,400 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:15:22,404 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:64123, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0037_m_000004_0_-1721288628_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 152000
2015-03-13 10:15:22,427 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:15:22,433 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/_temporary/1/_temporary/attempt_1426266260362_0037_m_000004_0/part-00004	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:15:22,448 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/_temporary/1/_temporary/attempt_1426266260362_0037_m_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:15:22,473 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:15:22,477 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:15:22,477 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:64127, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0037_m_000002_0_1357487425_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 165000
2015-03-13 10:15:22,480 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:64126, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0037_m_000001_0_739525124_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 166000
2015-03-13 10:15:22,492 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/_temporary/1/_temporary/attempt_1426266260362_0037_m_000002_0/part-00002	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:15:22,511 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/_temporary/1/_temporary/attempt_1426266260362_0037_m_000001_0/part-00001	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:15:22,778 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/_temporary/1/_temporary/attempt_1426266260362_0037_m_000003_0/part-00003. BP-1005356445-10.1.1.144-1426266257849 blk_1073742276_1452{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:15:22,803 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/_temporary/1/_temporary/attempt_1426266260362_0037_m_000004_0/part-00004 is closed by DFSClient_attempt_1426266260362_0037_m_000004_0_-1721288628_1
2015-03-13 10:15:22,814 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/_temporary/1/_temporary/attempt_1426266260362_0037_m_000004_0	dst=null	perm=null
2015-03-13 10:15:22,823 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742276_1452 src: /127.0.0.1:64128 dest: /127.0.0.1:60689
2015-03-13 10:15:22,824 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742276_1452 src: /127.0.0.1:64130 dest: /127.0.0.1:60686
2015-03-13 10:15:22,826 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742276_1452 src: /127.0.0.1:64131 dest: /127.0.0.1:60696
2015-03-13 10:15:22,828 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/_temporary/1/_temporary/attempt_1426266260362_0037_m_000004_0	dst=null	perm=null
2015-03-13 10:15:22,829 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/_temporary/1/task_1426266260362_0037_m_000004	dst=null	perm=null
2015-03-13 10:15:22,830 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64129, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0037_m_000000_0_1665862476_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 151000
2015-03-13 10:15:22,833 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64131, dest: /127.0.0.1:60696, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0037_m_000003_0_910781425_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742276_1452, duration: 6208000
2015-03-13 10:15:22,833 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742276_1452, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:15:22,834 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742276_1452{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:15:22,834 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64130, dest: /127.0.0.1:60686, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0037_m_000003_0_910781425_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742276_1452, duration: 6898000
2015-03-13 10:15:22,834 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742276_1452, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:22,835 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742276_1452{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:15:22,835 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64128, dest: /127.0.0.1:60689, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0037_m_000003_0_910781425_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742276_1452, duration: 7746000
2015-03-13 10:15:22,835 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742276_1452, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:22,835 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742276_1452{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:15:22,840 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/_temporary/1/_temporary/attempt_1426266260362_0037_m_000003_0/part-00003 is closed by DFSClient_attempt_1426266260362_0037_m_000003_0_910781425_1
2015-03-13 10:15:22,840 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/_temporary/1/_temporary/attempt_1426266260362_0037_m_000004_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/_temporary/1/task_1426266260362_0037_m_000004	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:15:22,852 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/_temporary/1/_temporary/attempt_1426266260362_0037_m_000003_0	dst=null	perm=null
2015-03-13 10:15:22,856 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/_temporary/1/_temporary/attempt_1426266260362_0037_m_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073742277_1453{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:15:22,861 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/_temporary/1/_temporary/attempt_1426266260362_0037_m_000003_0	dst=null	perm=null
2015-03-13 10:15:22,862 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0037_01_000006
2015-03-13 10:15:22,862 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0037	CONTAINERID=container_1426266260362_0037_01_000006
2015-03-13 10:15:22,862 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0037_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:15:22,862 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0037_01_000006
2015-03-13 10:15:22,862 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:15:22,863 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/_temporary/1/task_1426266260362_0037_m_000003	dst=null	perm=null
2015-03-13 10:15:22,870 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/_temporary/1/_temporary/attempt_1426266260362_0037_m_000003_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/_temporary/1/task_1426266260362_0037_m_000003	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:15:22,875 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0037_01_000006 is : 143
2015-03-13 10:15:22,877 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job_1426266260362_0037_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073742278_1454{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:15:22,879 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742278_1454 src: /127.0.0.1:64133 dest: /127.0.0.1:60696
2015-03-13 10:15:22,880 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742278_1454 src: /127.0.0.1:64134 dest: /127.0.0.1:60689
2015-03-13 10:15:22,881 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742278_1454 src: /127.0.0.1:64135 dest: /127.0.0.1:60686
2015-03-13 10:15:22,885 INFO  hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job_1426266260362_0037_1.jhist for DFSClient_NONMAPREDUCE_198358789_1
2015-03-13 10:15:22,888 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0037_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:15:22,888 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0037/container_1426266260362_0037_01_000006
2015-03-13 10:15:22,888 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0037/container_1426266260362_0037_01_000006
2015-03-13 10:15:22,888 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0037/container_1426266260362_0037_01_000006
2015-03-13 10:15:22,889 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0037/container_1426266260362_0037_01_000006
2015-03-13 10:15:22,889 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0037	CONTAINERID=container_1426266260362_0037_01_000006
2015-03-13 10:15:22,889 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0037_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:15:22,889 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0037_01_000006 from application application_1426266260362_0037
2015-03-13 10:15:22,889 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:15:22,890 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0037
2015-03-13 10:15:22,906 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0037_01_000005
2015-03-13 10:15:22,906 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0037	CONTAINERID=container_1426266260362_0037_01_000005
2015-03-13 10:15:22,906 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0037_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:15:22,906 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0037_01_000005
2015-03-13 10:15:22,906 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:22,906 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:22,906 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:22,907 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:15:22,918 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0037_01_000005 is : 143
2015-03-13 10:15:22,930 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0037_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:15:22,930 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0037/container_1426266260362_0037_01_000005
2015-03-13 10:15:22,930 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0037/container_1426266260362_0037_01_000005
2015-03-13 10:15:22,931 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0037	CONTAINERID=container_1426266260362_0037_01_000005
2015-03-13 10:15:22,931 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0037/container_1426266260362_0037_01_000005
2015-03-13 10:15:22,931 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0037/container_1426266260362_0037_01_000005
2015-03-13 10:15:22,931 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0037_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:15:22,931 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0037_01_000005 from application application_1426266260362_0037
2015-03-13 10:15:22,932 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:15:22,932 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0037
2015-03-13 10:15:22,934 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742277_1453 src: /127.0.0.1:64132 dest: /127.0.0.1:60693
2015-03-13 10:15:22,936 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742277_1453 src: /127.0.0.1:64136 dest: /127.0.0.1:60689
2015-03-13 10:15:22,937 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742277_1453 src: /127.0.0.1:64137 dest: /127.0.0.1:60686
2015-03-13 10:15:22,945 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64137, dest: /127.0.0.1:60686, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0037_m_000000_0_1665862476_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742277_1453, duration: 5994000
2015-03-13 10:15:22,945 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742277_1453, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:15:22,945 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742277_1453{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:15:22,945 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64136, dest: /127.0.0.1:60689, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0037_m_000000_0_1665862476_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742277_1453, duration: 6545000
2015-03-13 10:15:22,946 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742277_1453, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:22,946 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742277_1453{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:15:22,946 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64132, dest: /127.0.0.1:60693, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0037_m_000000_0_1665862476_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742277_1453, duration: 7257000
2015-03-13 10:15:22,946 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742277_1453, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:22,947 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742277_1453{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:15:22,951 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/_temporary/1/_temporary/attempt_1426266260362_0037_m_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0037_m_000000_0_1665862476_1
2015-03-13 10:15:22,965 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/_temporary/1/_temporary/attempt_1426266260362_0037_m_000000_0	dst=null	perm=null
2015-03-13 10:15:22,974 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/_temporary/1/_temporary/attempt_1426266260362_0037_m_000000_0	dst=null	perm=null
2015-03-13 10:15:22,975 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/_temporary/1/_temporary/attempt_1426266260362_0037_m_000002_0/part-00002. BP-1005356445-10.1.1.144-1426266257849 blk_1073742279_1455{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:15:22,975 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/_temporary/1/task_1426266260362_0037_m_000000	dst=null	perm=null
2015-03-13 10:15:22,979 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/_temporary/1/_temporary/attempt_1426266260362_0037_m_000000_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/_temporary/1/task_1426266260362_0037_m_000000	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:15:22,990 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0037_01_000002
2015-03-13 10:15:22,990 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0037	CONTAINERID=container_1426266260362_0037_01_000002
2015-03-13 10:15:22,990 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0037_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:15:22,991 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0037_01_000002
2015-03-13 10:15:22,991 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:15:22,991 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:22,991 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:22,991 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:15:22,991 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0037_01_000005
2015-03-13 10:15:22,992 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0037_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:15:22,992 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0037_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:15:22,992 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0037	CONTAINERID=container_1426266260362_0037_01_000005
2015-03-13 10:15:22,992 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0037_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:15:22,992 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:15:22,992 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0037_01_000005, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:22,992 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:22,992 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:15:22,992 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0037_000001 released container container_1426266260362_0037_01_000005 on node: host: 10.1.1.144:60711 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:15:23,004 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0037_01_000002 is : 143
2015-03-13 10:15:23,027 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742277_1453
2015-03-13 10:15:23,032 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742279_1455 src: /127.0.0.1:64138 dest: /127.0.0.1:60693
2015-03-13 10:15:23,033 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0037_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:15:23,033 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742279_1455 src: /127.0.0.1:64139 dest: /127.0.0.1:60689
2015-03-13 10:15:23,033 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0037/container_1426266260362_0037_01_000002
2015-03-13 10:15:23,033 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0037/container_1426266260362_0037_01_000002
2015-03-13 10:15:23,034 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0037/container_1426266260362_0037_01_000002
2015-03-13 10:15:23,034 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742279_1455 src: /127.0.0.1:64140 dest: /127.0.0.1:60686
2015-03-13 10:15:23,034 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0037/container_1426266260362_0037_01_000002
2015-03-13 10:15:23,036 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0037	CONTAINERID=container_1426266260362_0037_01_000002
2015-03-13 10:15:23,036 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0037_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:15:23,036 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0037_01_000002 from application application_1426266260362_0037
2015-03-13 10:15:23,036 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:15:23,036 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0037
2015-03-13 10:15:23,044 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64140, dest: /127.0.0.1:60686, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0037_m_000002_0_1357487425_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742279_1455, duration: 8071000
2015-03-13 10:15:23,044 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742279_1455, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:15:23,045 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742279_1455{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:15:23,045 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64139, dest: /127.0.0.1:60689, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0037_m_000002_0_1357487425_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742279_1455, duration: 8663000
2015-03-13 10:15:23,045 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742279_1455, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:23,045 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742279_1455{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:15:23,045 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64138, dest: /127.0.0.1:60693, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0037_m_000002_0_1357487425_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742279_1455, duration: 9350000
2015-03-13 10:15:23,046 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742279_1455, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:23,046 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742279_1455{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:15:23,050 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/_temporary/1/_temporary/attempt_1426266260362_0037_m_000002_0/part-00002 is closed by DFSClient_attempt_1426266260362_0037_m_000002_0_1357487425_1
2015-03-13 10:15:23,061 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/_temporary/1/_temporary/attempt_1426266260362_0037_m_000001_0/part-00001. BP-1005356445-10.1.1.144-1426266257849 blk_1073742280_1456{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:15:23,065 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/_temporary/1/_temporary/attempt_1426266260362_0037_m_000002_0	dst=null	perm=null
2015-03-13 10:15:23,100 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/_temporary/1/_temporary/attempt_1426266260362_0037_m_000002_0	dst=null	perm=null
2015-03-13 10:15:23,108 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742280_1456 src: /127.0.0.1:64141 dest: /127.0.0.1:60693
2015-03-13 10:15:23,109 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742280_1456 src: /127.0.0.1:64142 dest: /127.0.0.1:60689
2015-03-13 10:15:23,110 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742280_1456 src: /127.0.0.1:64143 dest: /127.0.0.1:60696
2015-03-13 10:15:23,118 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64143, dest: /127.0.0.1:60696, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0037_m_000001_0_739525124_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742280_1456, duration: 6648000
2015-03-13 10:15:23,119 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742280_1456, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:15:23,118 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/_temporary/1/task_1426266260362_0037_m_000002	dst=null	perm=null
2015-03-13 10:15:23,119 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742280_1456{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:15:23,119 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64142, dest: /127.0.0.1:60689, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0037_m_000001_0_739525124_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742280_1456, duration: 7327000
2015-03-13 10:15:23,119 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742280_1456, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:23,120 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742280_1456{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:15:23,120 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64141, dest: /127.0.0.1:60693, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0037_m_000001_0_739525124_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742280_1456, duration: 8142000
2015-03-13 10:15:23,120 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742280_1456, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:23,120 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742280_1456{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:15:23,125 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/_temporary/1/_temporary/attempt_1426266260362_0037_m_000002_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/_temporary/1/task_1426266260362_0037_m_000002	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:15:23,136 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/_temporary/1/_temporary/attempt_1426266260362_0037_m_000001_0/part-00001 is closed by DFSClient_attempt_1426266260362_0037_m_000001_0_739525124_1
2015-03-13 10:15:23,142 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0037_01_000004
2015-03-13 10:15:23,143 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0037	CONTAINERID=container_1426266260362_0037_01_000004
2015-03-13 10:15:23,143 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0037_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:15:23,143 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:15:23,143 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0037_01_000004
2015-03-13 10:15:23,143 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0037_01_000002
2015-03-13 10:15:23,143 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:23,143 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:15:23,144 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0037_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:15:23,144 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0037_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:15:23,144 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0037	CONTAINERID=container_1426266260362_0037_01_000002
2015-03-13 10:15:23,144 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0037_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:15:23,144 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:15:23,144 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0037_01_000002, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:23,144 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:23,144 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:15:23,145 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0037_000001 released container container_1426266260362_0037_01_000002 on node: host: 10.1.1.144:60711 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:15:23,157 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/_temporary/1/_temporary/attempt_1426266260362_0037_m_000001_0	dst=null	perm=null
2015-03-13 10:15:23,161 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0037_01_000004 is : 143
2015-03-13 10:15:23,175 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0037_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:15:23,175 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0037/container_1426266260362_0037_01_000004
2015-03-13 10:15:23,176 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0037/container_1426266260362_0037_01_000004
2015-03-13 10:15:23,177 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0037/container_1426266260362_0037_01_000004
2015-03-13 10:15:23,178 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0037/container_1426266260362_0037_01_000004
2015-03-13 10:15:23,179 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0037	CONTAINERID=container_1426266260362_0037_01_000004
2015-03-13 10:15:23,179 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0037_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:15:23,179 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0037_01_000004 from application application_1426266260362_0037
2015-03-13 10:15:23,179 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:15:23,179 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0037
2015-03-13 10:15:23,183 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/_temporary/1/_temporary/attempt_1426266260362_0037_m_000001_0	dst=null	perm=null
2015-03-13 10:15:23,184 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/_temporary/1/task_1426266260362_0037_m_000001	dst=null	perm=null
2015-03-13 10:15:23,188 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/_temporary/1/_temporary/attempt_1426266260362_0037_m_000001_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/_temporary/1/task_1426266260362_0037_m_000001	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:15:23,198 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0037_01_000003
2015-03-13 10:15:23,198 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0037	CONTAINERID=container_1426266260362_0037_01_000003
2015-03-13 10:15:23,198 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0037_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:15:23,198 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0037_01_000003
2015-03-13 10:15:23,198 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:15:23,199 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:15:23,199 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0037_01_000004
2015-03-13 10:15:23,199 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0037_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:15:23,199 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0037_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:15:23,199 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0037	CONTAINERID=container_1426266260362_0037_01_000004
2015-03-13 10:15:23,199 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0037_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:15:23,199 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:15:23,199 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0037_01_000004, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:23,200 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:23,200 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:15:23,200 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0037_000001 released container container_1426266260362_0037_01_000004 on node: host: 10.1.1.144:60711 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:15:23,202 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:15:23,205 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_198358789_1
2015-03-13 10:15:23,208 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/_temporary/1	dst=null	perm=null
2015-03-13 10:15:23,211 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0037_01_000003 is : 143
2015-03-13 10:15:23,216 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2	dst=null	perm=null
2015-03-13 10:15:23,217 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2	dst=null	perm=null
2015-03-13 10:15:23,218 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/_temporary/1/task_1426266260362_0037_m_000000	dst=null	perm=null
2015-03-13 10:15:23,219 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/part-00000	dst=null	perm=null
2015-03-13 10:15:23,222 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/_temporary/1/task_1426266260362_0037_m_000000/part-00000	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/part-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:15:23,223 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0037_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:15:23,223 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0037/container_1426266260362_0037_01_000003
2015-03-13 10:15:23,224 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0037/container_1426266260362_0037_01_000003
2015-03-13 10:15:23,224 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0037/container_1426266260362_0037_01_000003
2015-03-13 10:15:23,225 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0037/container_1426266260362_0037_01_000003
2015-03-13 10:15:23,226 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0037	CONTAINERID=container_1426266260362_0037_01_000003
2015-03-13 10:15:23,226 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2	dst=null	perm=null
2015-03-13 10:15:23,226 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0037_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:15:23,226 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0037_01_000003 from application application_1426266260362_0037
2015-03-13 10:15:23,226 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:15:23,226 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0037
2015-03-13 10:15:23,226 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2	dst=null	perm=null
2015-03-13 10:15:23,227 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/_temporary/1/task_1426266260362_0037_m_000001	dst=null	perm=null
2015-03-13 10:15:23,229 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/part-00001	dst=null	perm=null
2015-03-13 10:15:23,230 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/_temporary/1/task_1426266260362_0037_m_000001/part-00001	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/part-00001	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:15:23,232 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2	dst=null	perm=null
2015-03-13 10:15:23,233 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2	dst=null	perm=null
2015-03-13 10:15:23,234 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/_temporary/1/task_1426266260362_0037_m_000002	dst=null	perm=null
2015-03-13 10:15:23,235 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/part-00002	dst=null	perm=null
2015-03-13 10:15:23,237 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/_temporary/1/task_1426266260362_0037_m_000002/part-00002	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/part-00002	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:15:23,238 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2	dst=null	perm=null
2015-03-13 10:15:23,239 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2	dst=null	perm=null
2015-03-13 10:15:23,240 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/_temporary/1/task_1426266260362_0037_m_000003	dst=null	perm=null
2015-03-13 10:15:23,241 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/part-00003	dst=null	perm=null
2015-03-13 10:15:23,243 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/_temporary/1/task_1426266260362_0037_m_000003/part-00003	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/part-00003	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:15:23,244 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2	dst=null	perm=null
2015-03-13 10:15:23,245 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2	dst=null	perm=null
2015-03-13 10:15:23,246 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/_temporary/1/task_1426266260362_0037_m_000004	dst=null	perm=null
2015-03-13 10:15:23,247 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/part-00004	dst=null	perm=null
2015-03-13 10:15:23,248 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/_temporary/1/task_1426266260362_0037_m_000004/part-00004	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/part-00004	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:15:23,252 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/_temporary	dst=null	perm=null
2015-03-13 10:15:23,257 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:15:23,257 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:23,259 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/_SUCCESS is closed by DFSClient_NONMAPREDUCE_198358789_1
2015-03-13 10:15:23,261 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:15:23,263 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_198358789_1
2015-03-13 10:15:23,277 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64135, dest: /127.0.0.1:60686, bytes: 53317, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_198358789_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742278_1454, duration: 394828000
2015-03-13 10:15:23,278 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742278_1454, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:15:23,279 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742278_1454{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:15:23,279 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64134, dest: /127.0.0.1:60689, bytes: 53317, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_198358789_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742278_1454, duration: 396068000
2015-03-13 10:15:23,279 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742278_1454, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:23,280 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742278_1454{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:15:23,280 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64133, dest: /127.0.0.1:60696, bytes: 53317, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_198358789_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742278_1454, duration: 397466000
2015-03-13 10:15:23,280 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742278_1454, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:23,281 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742278_1454{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:15:23,282 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job_1426266260362_0037_1.jhist is closed by DFSClient_NONMAPREDUCE_198358789_1
2015-03-13 10:15:23,284 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0037.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:15:23,287 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0037.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742281_1457{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:15:23,288 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742281_1457 src: /127.0.0.1:64144 dest: /127.0.0.1:60686
2015-03-13 10:15:23,290 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742281_1457 src: /127.0.0.1:64145 dest: /127.0.0.1:60696
2015-03-13 10:15:23,291 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742281_1457 src: /127.0.0.1:64146 dest: /127.0.0.1:60693
2015-03-13 10:15:23,294 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64146, dest: /127.0.0.1:60693, bytes: 434, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_198358789_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742281_1457, duration: 1202000
2015-03-13 10:15:23,294 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742281_1457, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:15:23,294 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742281_1457{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:15:23,295 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64145, dest: /127.0.0.1:60696, bytes: 434, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_198358789_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742281_1457, duration: 1924000
2015-03-13 10:15:23,295 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742281_1457, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:23,295 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742281_1457{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:15:23,295 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64144, dest: /127.0.0.1:60686, bytes: 434, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_198358789_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742281_1457, duration: 2632000
2015-03-13 10:15:23,295 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742281_1457, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:23,296 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742281_1457{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:15:23,297 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0037.summary_tmp is closed by DFSClient_NONMAPREDUCE_198358789_1
2015-03-13 10:15:23,305 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0037.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:15:23,310 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job_1426266260362_0037_1.jhist	dst=null	perm=null
2015-03-13 10:15:23,311 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0037-1426266908181-soberoi-%5B60EF8DB99DB643778E218C05CBD6D765%2F03EFE4BB2CF14F0F-1426266923264-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:15:23,314 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job_1426266260362_0037_1.jhist	dst=null	perm=null
2015-03-13 10:15:23,315 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0037-1426266908181-soberoi-%5B60EF8DB99DB643778E218C05CBD6D765%2F03EFE4BB2CF14F0F-1426266923264-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:15:23,316 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job_1426266260362_0037_1.jhist	dst=null	perm=null
2015-03-13 10:15:23,318 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0037-1426266908181-soberoi-%5B60EF8DB99DB643778E218C05CBD6D765%2F03EFE4BB2CF14F0F-1426266923264-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:15:23,320 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:64147, bytes: 53737, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_198358789_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742278_1454, duration: 239000
2015-03-13 10:15:23,322 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0037-1426266908181-soberoi-%5B60EF8DB99DB643778E218C05CBD6D765%2F03EFE4BB2CF14F0F-1426266923264-5-0-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742282_1458{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:15:23,324 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742282_1458 src: /127.0.0.1:64148 dest: /127.0.0.1:60693
2015-03-13 10:15:23,325 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742282_1458 src: /127.0.0.1:64149 dest: /127.0.0.1:60689
2015-03-13 10:15:23,327 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742282_1458 src: /127.0.0.1:64150 dest: /127.0.0.1:60686
2015-03-13 10:15:23,330 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64150, dest: /127.0.0.1:60686, bytes: 53317, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_198358789_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742282_1458, duration: 1651000
2015-03-13 10:15:23,330 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742282_1458, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:15:23,331 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742282_1458{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:15:23,331 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64149, dest: /127.0.0.1:60689, bytes: 53317, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_198358789_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742282_1458, duration: 2426000
2015-03-13 10:15:23,331 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742282_1458, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:23,332 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64148, dest: /127.0.0.1:60693, bytes: 53317, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_198358789_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742282_1458, duration: 3220000
2015-03-13 10:15:23,332 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742282_1458{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:15:23,332 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742282_1458, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:23,332 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742282_1458{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:15:23,334 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0037-1426266908181-soberoi-%5B60EF8DB99DB643778E218C05CBD6D765%2F03EFE4BB2CF14F0F-1426266923264-5-0-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_198358789_1
2015-03-13 10:15:23,336 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0037-1426266908181-soberoi-%5B60EF8DB99DB643778E218C05CBD6D765%2F03EFE4BB2CF14F0F-1426266923264-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:15:23,338 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job_1426266260362_0037_1_conf.xml	dst=null	perm=null
2015-03-13 10:15:23,339 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0037_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:15:23,340 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job_1426266260362_0037_1_conf.xml	dst=null	perm=null
2015-03-13 10:15:23,341 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0037_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:15:23,342 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037/job_1426266260362_0037_1_conf.xml	dst=null	perm=null
2015-03-13 10:15:23,343 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0037_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:15:23,345 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:64147, bytes: 90290, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_198358789_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742275_1451, duration: 247000
2015-03-13 10:15:23,347 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0037_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742283_1459{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:15:23,348 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742283_1459 src: /127.0.0.1:64151 dest: /127.0.0.1:60696
2015-03-13 10:15:23,349 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742283_1459 src: /127.0.0.1:64152 dest: /127.0.0.1:60686
2015-03-13 10:15:23,351 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742283_1459 src: /127.0.0.1:64153 dest: /127.0.0.1:60689
2015-03-13 10:15:23,354 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64153, dest: /127.0.0.1:60689, bytes: 89590, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_198358789_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742283_1459, duration: 1694000
2015-03-13 10:15:23,354 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742283_1459, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:15:23,354 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742283_1459{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:15:23,354 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64152, dest: /127.0.0.1:60686, bytes: 89590, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_198358789_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742283_1459, duration: 2256000
2015-03-13 10:15:23,355 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742283_1459, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:23,355 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742283_1459{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:15:23,355 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64151, dest: /127.0.0.1:60696, bytes: 89590, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_198358789_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742283_1459, duration: 3008000
2015-03-13 10:15:23,355 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742283_1459, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:23,356 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742283_1459{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:15:23,357 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0037_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_198358789_1
2015-03-13 10:15:23,359 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0037_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:15:23,360 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0037.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0037.summary	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:15:23,362 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0037_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0037_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:15:23,364 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0037-1426266908181-soberoi-%5B60EF8DB99DB643778E218C05CBD6D765%2F03EFE4BB2CF14F0F-1426266923264-5-0-SUCCEEDED-default.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0037-1426266908181-soberoi-%5B60EF8DB99DB643778E218C05CBD6D765%2F03EFE4BB2CF14F0F-1426266923264-5-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:15:23,370 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0037_000001 State change from RUNNING to FINISHING
2015-03-13 10:15:23,370 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0037
2015-03-13 10:15:23,370 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0037 State change from RUNNING to REMOVING
2015-03-13 10:15:23,370 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0037
2015-03-13 10:15:23,370 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0037 State change from REMOVING to FINISHING
2015-03-13 10:15:23,573 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742276_1452
2015-03-13 10:15:23,574 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742280_1456
2015-03-13 10:15:23,574 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742278_1454
2015-03-13 10:15:23,575 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742281_1457
2015-03-13 10:15:23,575 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742283_1459
2015-03-13 10:15:23,868 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:15:23,868 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0037_01_000006
2015-03-13 10:15:23,868 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0037_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:15:23,869 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0037_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:15:23,869 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0037	CONTAINERID=container_1426266260362_0037_01_000006
2015-03-13 10:15:23,869 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0037_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:15:23,869 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:15:23,869 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0037_01_000006, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:23,869 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:23,870 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:15:23,870 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0037_000001 released container container_1426266260362_0037_01_000006 on node: host: 10.1.1.144:60723 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:15:24,199 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:15:24,199 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0037_01_000003
2015-03-13 10:15:24,200 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0037_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:15:24,200 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0037_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:15:24,200 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0037	CONTAINERID=container_1426266260362_0037_01_000003
2015-03-13 10:15:24,201 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0037_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:15:24,201 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:15:24,201 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0037_01_000003, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:24,201 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:24,201 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:15:24,201 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0037_000001 released container container_1426266260362_0037_01_000003 on node: host: 10.1.1.144:60711 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:15:24,260 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:24,381 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742271_1447 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60689 
2015-03-13 10:15:24,381 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742272_1448 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60686 127.0.0.1:60693 
2015-03-13 10:15:24,381 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742273_1449 127.0.0.1:60686 127.0.0.1:60693 127.0.0.1:60696 
2015-03-13 10:15:24,382 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742274_1450 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60693 
2015-03-13 10:15:24,382 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742278_1454 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60686 
2015-03-13 10:15:24,382 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742275_1451 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60693 
2015-03-13 10:15:24,382 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0037	dst=null	perm=null
2015-03-13 10:15:24,410 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2	dst=null	perm=null
2015-03-13 10:15:24,410 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/_temporary
2015-03-13 10:15:24,410 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/_temporary	dst=null	perm=null
2015-03-13 10:15:24,418 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:15:24,418 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:15:24,419 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:15:24,420 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2	dst=null	perm=null
2015-03-13 10:15:24,420 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2	dst=null	perm=null
2015-03-13 10:15:24,421 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2	dst=null	perm=null
2015-03-13 10:15:24,422 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:15:24,422 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/part-00000	dst=null	perm=null
2015-03-13 10:15:24,424 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:64155, bytes: 20, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742277_1453, duration: 134000
2015-03-13 10:15:24,425 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/part-00001	dst=null	perm=null
2015-03-13 10:15:24,426 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:64156, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742280_1456, duration: 129000
2015-03-13 10:15:24,427 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/part-00002	dst=null	perm=null
2015-03-13 10:15:24,429 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64157, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742279_1455, duration: 152000
2015-03-13 10:15:24,429 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/part-00003	dst=null	perm=null
2015-03-13 10:15:24,430 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:64155, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742276_1452, duration: 151000
2015-03-13 10:15:24,431 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/part-00004	dst=null	perm=null
2015-03-13 10:15:24,437 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:15:24,437 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:15:24,438 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:15:24,439 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2	dst=null	perm=null
2015-03-13 10:15:24,439 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2	dst=null	perm=null
2015-03-13 10:15:24,440 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2	dst=null	perm=null
2015-03-13 10:15:24,441 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:15:24,441 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/part-00000	dst=null	perm=null
2015-03-13 10:15:24,443 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:64158, bytes: 20, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742277_1453, duration: 182000
2015-03-13 10:15:24,444 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/part-00001	dst=null	perm=null
2015-03-13 10:15:24,445 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:64158, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742280_1456, duration: 150000
2015-03-13 10:15:24,445 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/part-00002	dst=null	perm=null
2015-03-13 10:15:24,446 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:64158, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742279_1455, duration: 142000
2015-03-13 10:15:24,447 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/part-00003	dst=null	perm=null
2015-03-13 10:15:24,448 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:64155, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742276_1452, duration: 149000
2015-03-13 10:15:24,448 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/part-00004	dst=null	perm=null
2015-03-13 10:15:24,448 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/samepipe2
2015-03-13 10:15:24,449 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2	dst=null	perm=null
2015-03-13 10:15:24,449 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2	dst=null	perm=null
2015-03-13 10:15:24,450 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2	dst=null	perm=null
2015-03-13 10:15:24,450 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2	dst=null	perm=null
2015-03-13 10:15:24,451 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/part-00000	dst=null	perm=null
2015-03-13 10:15:24,451 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/part-00000	dst=null	perm=null
2015-03-13 10:15:24,453 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64157, bytes: 20, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742277_1453, duration: 174000
2015-03-13 10:15:24,453 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/part-00001	dst=null	perm=null
2015-03-13 10:15:24,454 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/part-00001	dst=null	perm=null
2015-03-13 10:15:24,455 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:64155, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742280_1456, duration: 162000
2015-03-13 10:15:24,455 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/part-00002	dst=null	perm=null
2015-03-13 10:15:24,456 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/part-00002	dst=null	perm=null
2015-03-13 10:15:24,457 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:64155, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742279_1455, duration: 160000
2015-03-13 10:15:24,457 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/part-00003	dst=null	perm=null
2015-03-13 10:15:24,458 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/part-00003	dst=null	perm=null
2015-03-13 10:15:24,459 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64157, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742276_1452, duration: 159000
2015-03-13 10:15:24,459 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/part-00004	dst=null	perm=null
2015-03-13 10:15:24,460 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe2/part-00004	dst=null	perm=null
2015-03-13 10:15:24,461 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:15:24,470 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:15:24,471 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:15:24,471 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:15:24,477 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3	dst=null	perm=null
2015-03-13 10:15:24,478 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lhs] starting
2015-03-13 10:15:24,478 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lhs]  source: Hfs["TextDelimited[['num', 'char']]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-03-13 10:15:24,478 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lhs]  sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3"]
2015-03-13 10:15:24,478 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lhs]  parallel execution is enabled: true
2015-03-13 10:15:24,478 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lhs]  starting jobs: 1
2015-03-13 10:15:24,478 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lhs]  allocating threads: 1
2015-03-13 10:15:24,479 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lhs] starting step: (1/1) ...edpipesplatform/samepipe3
2015-03-13 10:15:24,487 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:15:24,495 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:15:24,496 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3	dst=null	perm=null
2015-03-13 10:15:24,496 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:15:24,497 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:15:24,499 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 38
2015-03-13 10:15:24,499 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038	dst=null	perm=null
2015-03-13 10:15:24,500 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038	dst=null	perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:15:24,501 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038	dst=null	perm=soberoi:supergroup:rwx------
2015-03-13 10:15:24,502 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.jar	dst=null	perm=null
2015-03-13 10:15:24,503 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:15:24,504 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073742284_1460{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:15:24,505 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742284_1460 src: /127.0.0.1:64160 dest: /127.0.0.1:60689
2015-03-13 10:15:24,506 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742284_1460 src: /127.0.0.1:64161 dest: /127.0.0.1:60693
2015-03-13 10:15:24,507 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742284_1460 src: /127.0.0.1:64162 dest: /127.0.0.1:60686
2015-03-13 10:15:24,519 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64162, dest: /127.0.0.1:60686, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742284_1460, duration: 9414000
2015-03-13 10:15:24,519 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742284_1460, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:15:24,519 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742284_1460{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:15:24,519 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64161, dest: /127.0.0.1:60693, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742284_1460, duration: 9751000
2015-03-13 10:15:24,520 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742284_1460, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:24,520 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742284_1460{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:15:24,520 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64160, dest: /127.0.0.1:60689, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742284_1460, duration: 10638000
2015-03-13 10:15:24,520 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742284_1460, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:24,521 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742284_1460{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:15:24,522 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:15:24,522 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.jar
2015-03-13 10:15:24,523 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.jar	dst=null	perm=null
2015-03-13 10:15:24,524 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:15:24,524 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:15:24,525 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:15:24,525 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:15:24,526 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:15:24,526 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:15:24,527 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:15:24,527 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:15:24,528 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:15:24,528 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:15:24,530 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:15:24,530 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:15:24,530 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:15:24,532 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:15:24,533 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:15:24,534 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.split
2015-03-13 10:15:24,534 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.split	dst=null	perm=null
2015-03-13 10:15:24,535 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073742285_1461{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:15:24,536 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742285_1461 src: /127.0.0.1:64163 dest: /127.0.0.1:60689
2015-03-13 10:15:24,537 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742285_1461 src: /127.0.0.1:64164 dest: /127.0.0.1:60686
2015-03-13 10:15:24,538 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742285_1461 src: /127.0.0.1:64165 dest: /127.0.0.1:60693
2015-03-13 10:15:24,539 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742285_1461 src: /127.0.0.1:64166 dest: /127.0.0.1:60696
2015-03-13 10:15:24,542 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64166, dest: /127.0.0.1:60696, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742285_1461, duration: 1626000
2015-03-13 10:15:24,542 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742285_1461, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:15:24,543 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742285_1461{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:15:24,543 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64165, dest: /127.0.0.1:60693, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742285_1461, duration: 1911000
2015-03-13 10:15:24,543 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742285_1461, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:24,543 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742285_1461{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:15:24,543 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64164, dest: /127.0.0.1:60686, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742285_1461, duration: 2813000
2015-03-13 10:15:24,543 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742285_1461, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:24,544 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742285_1461{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:15:24,544 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64163, dest: /127.0.0.1:60689, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742285_1461, duration: 3456000
2015-03-13 10:15:24,544 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742285_1461, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:24,544 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742285_1461{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:15:24,545 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:15:24,546 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:15:24,548 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:15:24,549 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073742286_1462{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:15:24,550 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742286_1462 src: /127.0.0.1:64167 dest: /127.0.0.1:60693
2015-03-13 10:15:24,551 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742286_1462 src: /127.0.0.1:64168 dest: /127.0.0.1:60689
2015-03-13 10:15:24,552 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742286_1462 src: /127.0.0.1:64169 dest: /127.0.0.1:60686
2015-03-13 10:15:24,554 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64169, dest: /127.0.0.1:60686, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742286_1462, duration: 1222000
2015-03-13 10:15:24,554 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742286_1462, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:15:24,554 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742286_1462{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:15:24,555 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64168, dest: /127.0.0.1:60689, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742286_1462, duration: 1444000
2015-03-13 10:15:24,555 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742286_1462, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:24,555 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742286_1462{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:15:24,555 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64167, dest: /127.0.0.1:60693, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742286_1462, duration: 2168000
2015-03-13 10:15:24,555 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742286_1462, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:24,556 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742286_1462{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:15:24,557 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:15:24,557 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:15:24,558 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:15:24,560 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:15:24,560 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:15:24,561 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:15:24,561 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:15:24,564 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742287_1463{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:15:24,565 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742287_1463 src: /127.0.0.1:64170 dest: /127.0.0.1:60693
2015-03-13 10:15:24,566 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742287_1463 src: /127.0.0.1:64171 dest: /127.0.0.1:60696
2015-03-13 10:15:24,567 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742287_1463 src: /127.0.0.1:64172 dest: /127.0.0.1:60686
2015-03-13 10:15:24,569 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64172, dest: /127.0.0.1:60686, bytes: 96997, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742287_1463, duration: 1352000
2015-03-13 10:15:24,570 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742287_1463, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:15:24,570 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742287_1463{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:15:24,570 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64171, dest: /127.0.0.1:60696, bytes: 96997, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742287_1463, duration: 1591000
2015-03-13 10:15:24,570 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742287_1463, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:24,570 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742287_1463{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:15:24,571 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64170, dest: /127.0.0.1:60693, bytes: 96997, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742287_1463, duration: 2466000
2015-03-13 10:15:24,571 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742287_1463, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:24,572 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742287_1463{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:15:24,573 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:15:24,573 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0038
2015-03-13 10:15:24,574 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038	dst=null	perm=null
2015-03-13 10:15:24,574 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.xml	dst=null	perm=null
2015-03-13 10:15:24,575 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.xml	dst=null	perm=null
2015-03-13 10:15:24,575 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.jar	dst=null	perm=null
2015-03-13 10:15:24,576 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.jar	dst=null	perm=null
2015-03-13 10:15:24,576 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.split	dst=null	perm=null
2015-03-13 10:15:24,576 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.split	dst=null	perm=null
2015-03-13 10:15:24,577 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:15:24,577 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:15:24,579 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:15:24,579 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:15:24,580 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:15:24,580 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:15:24,581 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:15:24,581 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:15:24,582 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 38 submitted by user soberoi
2015-03-13 10:15:24,582 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0038
2015-03-13 10:15:24,582 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	IP=10.1.1.144	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1426266260362_0038
2015-03-13 10:15:24,583 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0038
2015-03-13 10:15:24,583 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0038 State change from NEW to NEW_SAVING
2015-03-13 10:15:24,583 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0038 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:15:24,583 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0038_000001
2015-03-13 10:15:24,583 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0038_000001 State change from NEW to SUBMITTED
2015-03-13 10:15:24,583 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0038 from user: soberoi activated in queue: default
2015-03-13 10:15:24,584 INFO  capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0038 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:15:24,584 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0038 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:15:24,584 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0038 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:15:24,584 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0038_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:15:24,584 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0038_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:15:24,585 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0038 State change from SUBMITTED to ACCEPTED
2015-03-13 10:15:24,586 INFO  mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0038/
2015-03-13 10:15:24,586 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lhs] submitted hadoop job: job_1426266260362_0038
2015-03-13 10:15:24,586 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lhs] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0038/
2015-03-13 10:15:24,870 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0038_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:15:24,870 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0038	CONTAINERID=container_1426266260362_0038_01_000001
2015-03-13 10:15:24,870 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0038_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:15:24,871 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0038 container=Container: [ContainerId: container_1426266260362_0038_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0038_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:24,871 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:15:24,871 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0038_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:15:24,871 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:24,872 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0038 AttemptId: appattempt_1426266260362_0038_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0038_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ]
2015-03-13 10:15:24,872 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0038_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:15:24,872 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0038_000001
2015-03-13 10:15:24,872 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0038_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:15:24,873 INFO  amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0038_000001
2015-03-13 10:15:24,873 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0038_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] for AM appattempt_1426266260362_0038_000001
2015-03-13 10:15:24,873 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0038_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-03-13 10:15:24,875 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0038_000001 (auth:SIMPLE)
2015-03-13 10:15:24,876 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0038_01_000001 by user soberoi
2015-03-13 10:15:24,877 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0038
2015-03-13 10:15:24,877 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0038	CONTAINERID=container_1426266260362_0038_01_000001
2015-03-13 10:15:24,877 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0038 transitioned from NEW to INITING
2015-03-13 10:15:24,877 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0038_01_000001 to application application_1426266260362_0038
2015-03-13 10:15:24,877 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0038 transitioned from INITING to RUNNING
2015-03-13 10:15:24,877 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0038_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] for AM appattempt_1426266260362_0038_000001
2015-03-13 10:15:24,877 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0038_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:15:24,878 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0038_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:15:24,878 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0038
2015-03-13 10:15:24,878 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:15:24,878 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:15:24,878 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:15:24,878 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:15:24,878 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0038_01_000001
2015-03-13 10:15:24,887 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426266260362_0038_01_000001.tokens. Credentials list: 
2015-03-13 10:15:24,902 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:15:24,967 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426266260362_0038_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0038/container_1426266260362_0038_01_000001.tokens
2015-03-13 10:15:24,967 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0038 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0038
2015-03-13 10:15:25,028 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.jar	dst=null	perm=null
2015-03-13 10:15:25,029 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.jar	dst=null	perm=null
2015-03-13 10:15:25,030 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.jar	dst=null	perm=null
2015-03-13 10:15:25,036 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64157, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1512624568_20454, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742284_1460, duration: 472000
2015-03-13 10:15:25,056 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:15:25,072 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:15:25,072 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:15:25,073 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:15:25,078 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64157, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1512624568_20454, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742286_1462, duration: 169000
2015-03-13 10:15:25,090 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:15:25,106 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.split	dst=null	perm=null
2015-03-13 10:15:25,107 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.split	dst=null	perm=null
2015-03-13 10:15:25,107 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.split	dst=null	perm=null
2015-03-13 10:15:25,113 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:64158, bytes: 1798, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1512624568_20454, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742285_1461, duration: 187000
2015-03-13 10:15:25,126 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:15:25,141 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.xml	dst=null	perm=null
2015-03-13 10:15:25,142 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.xml	dst=null	perm=null
2015-03-13 10:15:25,143 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.xml	dst=null	perm=null
2015-03-13 10:15:25,148 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64157, bytes: 97757, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1512624568_20454, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742287_1463, duration: 291000
2015-03-13 10:15:25,160 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:15:25,160 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0038_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:15:25,185 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0038_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:15:25,185 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:15:25,250 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0038/container_1426266260362_0038_01_000001/default_container_executor.sh]
2015-03-13 10:15:25,258 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60686 to replicate blk_1073742284_1460 to datanode(s) 127.0.0.1:60696
2015-03-13 10:15:25,258 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073742272_1448, blk_1073742273_1449, blk_1073742275_1451, blk_1073742278_1454, blk_1073742271_1447]
2015-03-13 10:15:25,258 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073742272_1448, blk_1073742274_1450, blk_1073742278_1454, blk_1073742271_1447]
2015-03-13 10:15:25,264 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:25,760 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742272_1448 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir57/blk_1073742272 for deletion
2015-03-13 10:15:25,760 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742274_1450 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir2/blk_1073742274 for deletion
2015-03-13 10:15:25,760 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742278_1454 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742278 for deletion
2015-03-13 10:15:25,760 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742271_1447 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742271 for deletion
2015-03-13 10:15:25,761 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742272_1448 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir57/blk_1073742272
2015-03-13 10:15:25,761 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742274_1450 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir2/blk_1073742274
2015-03-13 10:15:25,761 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742278_1454 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742278
2015-03-13 10:15:25,761 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742271_1447 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742271
2015-03-13 10:15:25,796 INFO  datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-1907321454-10.1.1.144-60686-1426266259166, infoPort=60687, ipcPort=60688, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073742284_1460 to 127.0.0.1:60696 
2015-03-13 10:15:25,797 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742272_1448 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742272 for deletion
2015-03-13 10:15:25,797 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742273_1449 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742273 for deletion
2015-03-13 10:15:25,797 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742275_1451 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742275 for deletion
2015-03-13 10:15:25,797 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742278_1454 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742278 for deletion
2015-03-13 10:15:25,797 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742271_1447 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742271 for deletion
2015-03-13 10:15:25,798 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742272_1448 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742272
2015-03-13 10:15:25,798 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742275_1451 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742275
2015-03-13 10:15:25,798 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742273_1449 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742273
2015-03-13 10:15:25,798 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742278_1454 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742278
2015-03-13 10:15:25,798 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742271_1447 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742271
2015-03-13 10:15:25,801 INFO  datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073742284_1460 (numBytes=254067) to /127.0.0.1:60696
2015-03-13 10:15:25,801 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742284_1460 src: /127.0.0.1:64176 dest: /127.0.0.1:60696
2015-03-13 10:15:25,803 INFO  datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073742284_1460 src: /127.0.0.1:64176 dest: /127.0.0.1:60696 of size 254067
2015-03-13 10:15:25,804 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742284_1460 size 254067
2015-03-13 10:15:25,871 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:25,872 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0038_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:15:26,268 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:26,611 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742276_1452
2015-03-13 10:15:26,612 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742284_1460
2015-03-13 10:15:26,612 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742279_1455
2015-03-13 10:15:26,613 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742282_1458
2015-03-13 10:15:26,613 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742280_1456
2015-03-13 10:15:26,613 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742285_1461
2015-03-13 10:15:26,613 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742286_1462
2015-03-13 10:15:26,614 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742277_1453
2015-03-13 10:15:26,823 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742283_1459
2015-03-13 10:15:26,864 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:15:26,873 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:26,886 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/COMMIT_STARTED	dst=null	perm=null
2015-03-13 10:15:26,887 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/COMMIT_SUCCESS	dst=null	perm=null
2015-03-13 10:15:26,888 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/COMMIT_FAIL	dst=null	perm=null
2015-03-13 10:15:26,938 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038	dst=null	perm=null
2015-03-13 10:15:26,940 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:15:26,941 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:15:27,217 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:15:27,224 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:15:27,273 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:27,282 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:64178, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_213488155_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742286_1462, duration: 134000
2015-03-13 10:15:27,876 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:27,974 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742284_1460
2015-03-13 10:15:27,975 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742279_1455
2015-03-13 10:15:27,975 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742281_1457
2015-03-13 10:15:27,976 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742283_1459
2015-03-13 10:15:27,976 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742276_1452
2015-03-13 10:15:27,976 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742277_1453
2015-03-13 10:15:27,977 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742287_1463
2015-03-13 10:15:27,977 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742285_1461
2015-03-13 10:15:28,033 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742280_1456
2015-03-13 10:15:28,033 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742285_1461
2015-03-13 10:15:28,035 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742284_1460
2015-03-13 10:15:28,055 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0038_000001 (auth:SIMPLE)
2015-03-13 10:15:28,056 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0038_000001
2015-03-13 10:15:28,056 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi	IP=10.1.1.144	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1426266260362_0038	APPATTEMPTID=appattempt_1426266260362_0038_000001
2015-03-13 10:15:28,056 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0038_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:15:28,056 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0038 State change from ACCEPTED to RUNNING
2015-03-13 10:15:28,076 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job_1426266260362_0038_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:15:28,083 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:15:28,141 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job_1426266260362_0038_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:15:28,174 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742282_1458
2015-03-13 10:15:28,174 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742286_1462
2015-03-13 10:15:28,237 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742282_1458
2015-03-13 10:15:28,237 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742286_1462
2015-03-13 10:15:28,237 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742281_1457
2015-03-13 10:15:28,238 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742287_1463
2015-03-13 10:15:28,238 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742279_1455
2015-03-13 10:15:28,261 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073742272_1448, blk_1073742273_1449, blk_1073742274_1450, blk_1073742275_1451, blk_1073742278_1454, blk_1073742271_1447]
2015-03-13 10:15:28,261 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073742272_1448, blk_1073742273_1449, blk_1073742274_1450, blk_1073742275_1451, blk_1073742271_1447]
2015-03-13 10:15:28,269 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job_1426266260362_0038_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742288_1464{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:15:28,274 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:28,312 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742288_1464 src: /127.0.0.1:64184 dest: /127.0.0.1:60696
2015-03-13 10:15:28,313 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742288_1464 src: /127.0.0.1:64185 dest: /127.0.0.1:60686
2015-03-13 10:15:28,315 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742288_1464 src: /127.0.0.1:64186 dest: /127.0.0.1:60689
2015-03-13 10:15:28,323 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64186, dest: /127.0.0.1:60689, bytes: 89792, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_213488155_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742288_1464, duration: 6053000
2015-03-13 10:15:28,323 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742288_1464, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:15:28,324 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742288_1464{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:15:28,324 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64185, dest: /127.0.0.1:60686, bytes: 89792, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_213488155_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742288_1464, duration: 6823000
2015-03-13 10:15:28,324 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742288_1464, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:28,325 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64184, dest: /127.0.0.1:60696, bytes: 89792, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_213488155_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742288_1464, duration: 8128000
2015-03-13 10:15:28,325 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742288_1464{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:15:28,325 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742288_1464, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:28,327 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742288_1464{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:15:28,331 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job_1426266260362_0038_1_conf.xml is closed by DFSClient_NONMAPREDUCE_213488155_1
2015-03-13 10:15:28,580 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742287_1463
2015-03-13 10:15:28,581 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742285_1461
2015-03-13 10:15:28,581 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742288_1464
2015-03-13 10:15:28,787 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742284_1460
2015-03-13 10:15:28,882 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:28,998 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742272_1448 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742272 for deletion
2015-03-13 10:15:28,998 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742273_1449 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir56/blk_1073742273 for deletion
2015-03-13 10:15:28,998 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742274_1450 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742274 for deletion
2015-03-13 10:15:28,999 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742275_1451 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir56/blk_1073742275 for deletion
2015-03-13 10:15:28,998 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742272_1448 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742272
2015-03-13 10:15:28,999 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742271_1447 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir56/blk_1073742271 for deletion
2015-03-13 10:15:28,999 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742273_1449 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir56/blk_1073742273
2015-03-13 10:15:28,999 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742274_1450 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742274
2015-03-13 10:15:28,999 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742275_1451 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir56/blk_1073742275
2015-03-13 10:15:29,000 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742271_1447 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir56/blk_1073742271
2015-03-13 10:15:29,197 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742272_1448 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir39/blk_1073742272 for deletion
2015-03-13 10:15:29,197 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742273_1449 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742273 for deletion
2015-03-13 10:15:29,197 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742274_1450 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir39/blk_1073742274 for deletion
2015-03-13 10:15:29,198 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742272_1448 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir39/blk_1073742272
2015-03-13 10:15:29,198 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742275_1451 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742275 for deletion
2015-03-13 10:15:29,198 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742278_1454 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742278 for deletion
2015-03-13 10:15:29,198 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742273_1449 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742273
2015-03-13 10:15:29,198 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742274_1450 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir39/blk_1073742274
2015-03-13 10:15:29,198 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742271_1447 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742271 for deletion
2015-03-13 10:15:29,199 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742275_1451 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742275
2015-03-13 10:15:29,199 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742278_1454 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742278
2015-03-13 10:15:29,199 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742271_1447 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742271
2015-03-13 10:15:29,215 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0038_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:15:29,215 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0038	CONTAINERID=container_1426266260362_0038_01_000002
2015-03-13 10:15:29,215 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0038_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:15:29,216 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0038 container=Container: [ContainerId: container_1426266260362_0038_01_000002, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0038_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:29,216 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:15:29,216 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:29,216 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0038_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:15:29,216 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0038	CONTAINERID=container_1426266260362_0038_01_000003
2015-03-13 10:15:29,216 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0038_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:15:29,216 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0038 container=Container: [ContainerId: container_1426266260362_0038_01_000003, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0038_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:29,217 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:15:29,217 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:29,217 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0038_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:15:29,217 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0038	CONTAINERID=container_1426266260362_0038_01_000004
2015-03-13 10:15:29,217 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0038_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:15:29,217 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0038 container=Container: [ContainerId: container_1426266260362_0038_01_000004, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0038_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:29,217 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:15:29,218 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:29,218 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0038_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:15:29,218 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0038	CONTAINERID=container_1426266260362_0038_01_000005
2015-03-13 10:15:29,218 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0038_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:15:29,218 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0038 container=Container: [ContainerId: container_1426266260362_0038_01_000005, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0038_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:29,218 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:15:29,218 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:29,278 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:29,279 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0038_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:15:29,279 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0038	CONTAINERID=container_1426266260362_0038_01_000006
2015-03-13 10:15:29,279 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0038_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:15:29,280 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0038 container=Container: [ContainerId: container_1426266260362_0038_01_000006, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0038_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:29,280 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7
2015-03-13 10:15:29,280 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:29,512 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0037_01_000001 succeeded 
2015-03-13 10:15:29,513 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0037_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:15:29,513 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0037_01_000001
2015-03-13 10:15:29,521 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0037/container_1426266260362_0037_01_000001
2015-03-13 10:15:29,521 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0037	CONTAINERID=container_1426266260362_0037_01_000001
2015-03-13 10:15:29,521 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0037_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:15:29,521 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0037/container_1426266260362_0037_01_000001
2015-03-13 10:15:29,521 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0037/container_1426266260362_0037_01_000001
2015-03-13 10:15:29,521 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0037_01_000001 from application application_1426266260362_0037
2015-03-13 10:15:29,521 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:15:29,521 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0037/container_1426266260362_0037_01_000001
2015-03-13 10:15:29,522 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0037
2015-03-13 10:15:29,888 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:30,093 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0038_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:15:30,093 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0038_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:15:30,093 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0038_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:15:30,094 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0038_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:15:30,094 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0038_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:15:30,120 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.jar	dst=null	perm=null
2015-03-13 10:15:30,121 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.jar	dst=null	perm=null
2015-03-13 10:15:30,129 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.xml	dst=null	perm=null
2015-03-13 10:15:30,130 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.xml	dst=null	perm=null
2015-03-13 10:15:30,133 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:15:30,134 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:15:30,139 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:15:30,140 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:15:30,142 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:15:30,143 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:15:30,217 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0038_000001 (auth:SIMPLE)
2015-03-13 10:15:30,217 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0038_000001 (auth:SIMPLE)
2015-03-13 10:15:30,220 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0038_01_000004 by user soberoi
2015-03-13 10:15:30,221 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0038_01_000006 by user soberoi
2015-03-13 10:15:30,221 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0038
2015-03-13 10:15:30,221 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0038
2015-03-13 10:15:30,221 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0038 transitioned from NEW to INITING
2015-03-13 10:15:30,221 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0038_01_000005 by user soberoi
2015-03-13 10:15:30,221 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0038	CONTAINERID=container_1426266260362_0038_01_000005
2015-03-13 10:15:30,221 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0038	CONTAINERID=container_1426266260362_0038_01_000004
2015-03-13 10:15:30,221 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0038 transitioned from NEW to INITING
2015-03-13 10:15:30,222 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0038_01_000006 to application application_1426266260362_0038
2015-03-13 10:15:30,222 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0038_01_000002 by user soberoi
2015-03-13 10:15:30,222 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0038	CONTAINERID=container_1426266260362_0038_01_000002
2015-03-13 10:15:30,221 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0038_01_000003 by user soberoi
2015-03-13 10:15:30,222 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0038	CONTAINERID=container_1426266260362_0038_01_000003
2015-03-13 10:15:30,221 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0038_01_000004 to application application_1426266260362_0038
2015-03-13 10:15:30,223 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0038_01_000005 to application application_1426266260362_0038
2015-03-13 10:15:30,223 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0038_01_000002 to application application_1426266260362_0038
2015-03-13 10:15:30,223 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0038_01_000003 to application application_1426266260362_0038
2015-03-13 10:15:30,223 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0038 transitioned from INITING to RUNNING
2015-03-13 10:15:30,221 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0038	CONTAINERID=container_1426266260362_0038_01_000006
2015-03-13 10:15:30,223 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0038_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:15:30,223 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0038_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:15:30,222 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0038 transitioned from INITING to RUNNING
2015-03-13 10:15:30,224 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0038_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:15:30,224 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0038_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:15:30,224 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0038
2015-03-13 10:15:30,224 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0038_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:15:30,224 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0038
2015-03-13 10:15:30,224 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0038
2015-03-13 10:15:30,224 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:15:30,224 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0038
2015-03-13 10:15:30,224 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:15:30,224 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0038
2015-03-13 10:15:30,224 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0038
2015-03-13 10:15:30,224 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:15:30,224 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:15:30,224 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:15:30,225 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0038_01_000006
2015-03-13 10:15:30,224 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:15:30,225 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0038
2015-03-13 10:15:30,225 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0038
2015-03-13 10:15:30,225 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:15:30,225 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0038
2015-03-13 10:15:30,225 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0038
2015-03-13 10:15:30,225 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0038
2015-03-13 10:15:30,225 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:15:30,225 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0038
2015-03-13 10:15:30,226 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0038
2015-03-13 10:15:30,226 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0038
2015-03-13 10:15:30,226 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:15:30,226 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0038
2015-03-13 10:15:30,226 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0038_01_000003
2015-03-13 10:15:30,229 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0038_01_000002
2015-03-13 10:15:30,231 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0038_01_000005
2015-03-13 10:15:30,232 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0038_01_000004
2015-03-13 10:15:30,249 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1426266260362_0038_01_000006.tokens. Credentials list: 
2015-03-13 10:15:30,249 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1426266260362_0038_01_000004.tokens. Credentials list: 
2015-03-13 10:15:30,249 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1426266260362_0038_01_000005.tokens. Credentials list: 
2015-03-13 10:15:30,250 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0038_01_000002.tokens. Credentials list: 
2015-03-13 10:15:30,250 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0038_01_000003.tokens. Credentials list: 
2015-03-13 10:15:30,267 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:15:30,267 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:15:30,279 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 37 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:15:30,279 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0037_01_000001
2015-03-13 10:15:30,279 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:30,280 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0038_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:15:30,280 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0037_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:15:30,280 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0037_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:15:30,280 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0037	CONTAINERID=container_1426266260362_0037_01_000001
2015-03-13 10:15:30,280 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0037_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:15:30,280 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:7168, vCores:6> numContainers=6 user=soberoi user-resources=<memory:7168, vCores:6>
2015-03-13 10:15:30,280 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0037_01_000001, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:30,280 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:30,280 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6
2015-03-13 10:15:30,281 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0037_000001 released container container_1426266260362_0037_01_000001 on node: host: 10.1.1.144:60719 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:15:30,280 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0037_000001
2015-03-13 10:15:30,281 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0037_000001 State change from FINISHING to FINISHED
2015-03-13 10:15:30,281 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0037 State change from FINISHING to FINISHED
2015-03-13 10:15:30,281 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1426266260362_0037
2015-03-13 10:15:30,281 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0037,name=[60EF8DB99DB643778E218C05CBD6D765/03EFE4BB2CF14F0FB64A6222933EBA4B] lower/(1/1) ...edpipesplatform/samepipe2,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0037/jobhistory/job/job_1426266260362_0037,appMasterHost=Edinburgh.local,startTime=1426266908181,finishTime=1426266923370,finalStatus=SUCCEEDED
2015-03-13 10:15:30,281 INFO  amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0037_000001
2015-03-13 10:15:30,281 INFO  capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0037_000001 is done. finalState=FINISHED
2015-03-13 10:15:30,282 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0037 requests cleared
2015-03-13 10:15:30,282 INFO  capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0037 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:15:30,282 INFO  capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0037 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:15:30,284 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0037_000001 (auth:SIMPLE)
2015-03-13 10:15:30,285 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0037_01_000001
2015-03-13 10:15:30,348 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1426266260362_0038_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0038/container_1426266260362_0038_01_000006.tokens
2015-03-13 10:15:30,348 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1426266260362_0038_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0038/container_1426266260362_0038_01_000004.tokens
2015-03-13 10:15:30,349 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0038 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0038
2015-03-13 10:15:30,349 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0038 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0038
2015-03-13 10:15:30,418 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.jar	dst=null	perm=null
2015-03-13 10:15:30,418 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.jar	dst=null	perm=null
2015-03-13 10:15:30,419 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.jar	dst=null	perm=null
2015-03-13 10:15:30,419 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.jar	dst=null	perm=null
2015-03-13 10:15:30,420 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.jar	dst=null	perm=null
2015-03-13 10:15:30,420 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.jar	dst=null	perm=null
2015-03-13 10:15:30,427 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:64196, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_712233959_20600, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742284_1460, duration: 370000
2015-03-13 10:15:30,427 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:64195, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_2095253374_20599, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742284_1460, duration: 486000
2015-03-13 10:15:30,446 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:15:30,447 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:15:30,465 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.xml	dst=null	perm=null
2015-03-13 10:15:30,465 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.xml	dst=null	perm=null
2015-03-13 10:15:30,466 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.xml	dst=null	perm=null
2015-03-13 10:15:30,466 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.xml	dst=null	perm=null
2015-03-13 10:15:30,466 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.xml	dst=null	perm=null
2015-03-13 10:15:30,466 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.xml	dst=null	perm=null
2015-03-13 10:15:30,474 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64197, bytes: 97757, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_2095253374_20599, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742287_1463, duration: 274000
2015-03-13 10:15:30,474 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:64198, bytes: 97757, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_712233959_20600, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742287_1463, duration: 258000
2015-03-13 10:15:30,488 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:15:30,488 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0038_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:15:30,488 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0038_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:15:30,488 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0038_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:15:30,488 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:15:30,488 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0038_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:15:30,488 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0038_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:15:30,542 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0038_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:15:30,542 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0038_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:15:30,542 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0038_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:15:30,543 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:15:30,543 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:15:30,543 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:15:30,544 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0038_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:15:30,544 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:15:30,555 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0038_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:15:30,555 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:15:30,675 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0038/container_1426266260362_0038_01_000002/default_container_executor.sh]
2015-03-13 10:15:30,682 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0038/container_1426266260362_0038_01_000005/default_container_executor.sh]
2015-03-13 10:15:30,688 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0038/container_1426266260362_0038_01_000006/default_container_executor.sh]
2015-03-13 10:15:30,693 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0038/container_1426266260362_0038_01_000004/default_container_executor.sh]
2015-03-13 10:15:30,697 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0038/container_1426266260362_0038_01_000003/default_container_executor.sh]
2015-03-13 10:15:30,892 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:30,892 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0037 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:15:30,892 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0037
2015-03-13 10:15:30,892 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0037
2015-03-13 10:15:30,893 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0037
2015-03-13 10:15:30,893 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0037
2015-03-13 10:15:30,893 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0037 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:15:30,893 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0037, with delay of 10800 seconds
2015-03-13 10:15:30,893 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0037
2015-03-13 10:15:31,111 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:15:31,221 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:31,221 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:31,221 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:31,221 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:31,222 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0037 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:15:31,222 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0038_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:15:31,222 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0038_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:15:31,222 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0038_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:15:31,222 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0037
2015-03-13 10:15:31,222 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0037
2015-03-13 10:15:31,222 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0037
2015-03-13 10:15:31,222 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0037
2015-03-13 10:15:31,222 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0037 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:15:31,223 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0037, with delay of 10800 seconds
2015-03-13 10:15:31,222 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0037
2015-03-13 10:15:31,222 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0038_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:15:31,281 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:31,281 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0037 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:15:31,281 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0037
2015-03-13 10:15:31,281 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0037
2015-03-13 10:15:31,282 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0037
2015-03-13 10:15:31,282 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0037 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:15:31,282 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0037, with delay of 10800 seconds
2015-03-13 10:15:31,282 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0037
2015-03-13 10:15:31,282 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0037
2015-03-13 10:15:31,520 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:15:31,635 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0038_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0038/container_1426266260362_0038_01_000003.tokens
2015-03-13 10:15:31,636 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0038 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0038
2015-03-13 10:15:31,766 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:15:31,827 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742288_1464
2015-03-13 10:15:31,881 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0038_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0038/container_1426266260362_0038_01_000002.tokens
2015-03-13 10:15:31,881 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0038 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0038
2015-03-13 10:15:31,896 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:31,989 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:15:32,103 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1426266260362_0038_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0038/container_1426266260362_0038_01_000005.tokens
2015-03-13 10:15:32,103 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0038 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0038
2015-03-13 10:15:32,227 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:32,227 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:32,227 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:32,227 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:32,285 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:32,901 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:33,180 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742288_1464
2015-03-13 10:15:33,228 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:33,228 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:33,228 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:33,228 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:33,286 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:33,906 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:34,229 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:34,229 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:34,229 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:34,229 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:34,289 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:34,911 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:35,235 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:35,235 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:35,235 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:35,235 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:35,292 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:35,914 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:36,239 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:36,239 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:36,239 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:36,240 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:36,298 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:36,918 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:37,244 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:37,244 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:37,244 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:37,244 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:37,303 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:37,920 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:38,247 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:38,248 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:38,248 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:38,248 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:38,306 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:38,548 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.split	dst=null	perm=null
2015-03-13 10:15:38,589 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.split	dst=null	perm=null
2015-03-13 10:15:38,621 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.split	dst=null	perm=null
2015-03-13 10:15:38,734 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.split	dst=null	perm=null
2015-03-13 10:15:38,781 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64210, bytes: 1282, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0038_m_000002_0_-2000356269_1, offset: 512, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742285_1461, duration: 146000
2015-03-13 10:15:38,789 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:64212, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0038_m_000004_0_-1118335345_1, offset: 1024, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742285_1461, duration: 145000
2015-03-13 10:15:38,795 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job.split	dst=null	perm=null
2015-03-13 10:15:38,808 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:64213, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0038_m_000003_0_-903691589_1, offset: 1024, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742285_1461, duration: 175000
2015-03-13 10:15:38,882 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:64215, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0038_m_000001_0_689733545_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742285_1461, duration: 153000
2015-03-13 10:15:38,903 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:15:38,907 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64210, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0038_m_000002_0_-2000356269_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 156000
2015-03-13 10:15:38,922 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:38,922 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:15:38,926 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:64217, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0038_m_000004_0_-1118335345_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 206000
2015-03-13 10:15:38,932 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/_temporary/1/_temporary/attempt_1426266260362_0038_m_000002_0/part-00002	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:15:38,936 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64216, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0038_m_000000_0_-63283770_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742285_1461, duration: 174000
2015-03-13 10:15:38,943 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:15:38,947 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:64218, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0038_m_000003_0_-903691589_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 166000
2015-03-13 10:15:38,951 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/_temporary/1/_temporary/attempt_1426266260362_0038_m_000004_0/part-00004	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:15:38,984 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/_temporary/1/_temporary/attempt_1426266260362_0038_m_000003_0/part-00003	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:15:38,987 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:15:38,990 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:64219, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0038_m_000001_0_689733545_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 172000
2015-03-13 10:15:39,022 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/_temporary/1/_temporary/attempt_1426266260362_0038_m_000001_0/part-00001	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:15:39,086 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:15:39,117 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/_temporary/1/_temporary/attempt_1426266260362_0038_m_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:15:39,250 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:39,250 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:39,250 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:39,250 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:39,310 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/_temporary/1/_temporary/attempt_1426266260362_0038_m_000004_0/part-00004 is closed by DFSClient_attempt_1426266260362_0038_m_000004_0_-1118335345_1
2015-03-13 10:15:39,310 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:39,316 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/_temporary/1/_temporary/attempt_1426266260362_0038_m_000002_0/part-00002. BP-1005356445-10.1.1.144-1426266257849 blk_1073742289_1465{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:15:39,319 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/_temporary/1/_temporary/attempt_1426266260362_0038_m_000004_0	dst=null	perm=null
2015-03-13 10:15:39,328 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/_temporary/1/_temporary/attempt_1426266260362_0038_m_000004_0	dst=null	perm=null
2015-03-13 10:15:39,329 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/_temporary/1/task_1426266260362_0038_m_000004	dst=null	perm=null
2015-03-13 10:15:39,334 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/_temporary/1/_temporary/attempt_1426266260362_0038_m_000004_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/_temporary/1/task_1426266260362_0038_m_000004	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:15:39,355 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0038_01_000006
2015-03-13 10:15:39,355 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0038	CONTAINERID=container_1426266260362_0038_01_000006
2015-03-13 10:15:39,356 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0038_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:15:39,356 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0038_01_000006
2015-03-13 10:15:39,356 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:15:39,367 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0038_01_000006 is : 143
2015-03-13 10:15:39,370 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job_1426266260362_0038_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073742290_1466{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:15:39,371 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742290_1466 src: /127.0.0.1:64221 dest: /127.0.0.1:60686
2015-03-13 10:15:39,373 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742290_1466 src: /127.0.0.1:64222 dest: /127.0.0.1:60696
2015-03-13 10:15:39,374 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742290_1466 src: /127.0.0.1:64223 dest: /127.0.0.1:60693
2015-03-13 10:15:39,378 INFO  hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job_1426266260362_0038_1.jhist for DFSClient_NONMAPREDUCE_213488155_1
2015-03-13 10:15:39,379 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0038_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:15:39,379 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0038/container_1426266260362_0038_01_000006
2015-03-13 10:15:39,379 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0038/container_1426266260362_0038_01_000006
2015-03-13 10:15:39,379 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0038	CONTAINERID=container_1426266260362_0038_01_000006
2015-03-13 10:15:39,379 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0038_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:15:39,379 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0038_01_000006 from application application_1426266260362_0038
2015-03-13 10:15:39,379 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:15:39,379 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0038
2015-03-13 10:15:39,379 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0038/container_1426266260362_0038_01_000006
2015-03-13 10:15:39,379 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0038/container_1426266260362_0038_01_000006
2015-03-13 10:15:39,384 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742289_1465 src: /127.0.0.1:64220 dest: /127.0.0.1:60696
2015-03-13 10:15:39,385 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742289_1465 src: /127.0.0.1:64224 dest: /127.0.0.1:60693
2015-03-13 10:15:39,387 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742289_1465 src: /127.0.0.1:64225 dest: /127.0.0.1:60689
2015-03-13 10:15:39,394 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64225, dest: /127.0.0.1:60689, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0038_m_000002_0_-2000356269_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742289_1465, duration: 6232000
2015-03-13 10:15:39,395 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742289_1465, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:15:39,395 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742289_1465{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:15:39,395 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64224, dest: /127.0.0.1:60693, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0038_m_000002_0_-2000356269_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742289_1465, duration: 6959000
2015-03-13 10:15:39,395 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742289_1465, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:39,396 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742289_1465{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:15:39,396 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64220, dest: /127.0.0.1:60696, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0038_m_000002_0_-2000356269_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742289_1465, duration: 7775000
2015-03-13 10:15:39,396 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742289_1465, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:39,396 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742289_1465{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:15:39,400 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/_temporary/1/_temporary/attempt_1426266260362_0038_m_000002_0/part-00002 is closed by DFSClient_attempt_1426266260362_0038_m_000002_0_-2000356269_1
2015-03-13 10:15:39,410 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/_temporary/1/_temporary/attempt_1426266260362_0038_m_000002_0	dst=null	perm=null
2015-03-13 10:15:39,419 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/_temporary/1/_temporary/attempt_1426266260362_0038_m_000002_0	dst=null	perm=null
2015-03-13 10:15:39,420 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/_temporary/1/task_1426266260362_0038_m_000002	dst=null	perm=null
2015-03-13 10:15:39,424 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/_temporary/1/_temporary/attempt_1426266260362_0038_m_000002_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/_temporary/1/task_1426266260362_0038_m_000002	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:15:39,435 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0038_01_000004
2015-03-13 10:15:39,435 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0038	CONTAINERID=container_1426266260362_0038_01_000004
2015-03-13 10:15:39,435 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0038_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:15:39,435 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0038_01_000004
2015-03-13 10:15:39,435 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:39,435 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:39,436 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:15:39,436 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:39,448 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0038_01_000004 is : 143
2015-03-13 10:15:39,459 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0038_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:15:39,459 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0038/container_1426266260362_0038_01_000004
2015-03-13 10:15:39,459 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0038/container_1426266260362_0038_01_000004
2015-03-13 10:15:39,460 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0038/container_1426266260362_0038_01_000004
2015-03-13 10:15:39,460 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0038/container_1426266260362_0038_01_000004
2015-03-13 10:15:39,461 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0038	CONTAINERID=container_1426266260362_0038_01_000004
2015-03-13 10:15:39,461 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0038_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:15:39,461 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0038_01_000004 from application application_1426266260362_0038
2015-03-13 10:15:39,461 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:15:39,461 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0038
2015-03-13 10:15:39,480 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/_temporary/1/_temporary/attempt_1426266260362_0038_m_000003_0/part-00003. BP-1005356445-10.1.1.144-1426266257849 blk_1073742291_1467{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:15:39,518 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/_temporary/1/_temporary/attempt_1426266260362_0038_m_000001_0/part-00001. BP-1005356445-10.1.1.144-1426266257849 blk_1073742292_1468{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:15:39,524 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742291_1467 src: /127.0.0.1:64226 dest: /127.0.0.1:60693
2015-03-13 10:15:39,525 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742291_1467 src: /127.0.0.1:64228 dest: /127.0.0.1:60686
2015-03-13 10:15:39,526 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742291_1467 src: /127.0.0.1:64229 dest: /127.0.0.1:60696
2015-03-13 10:15:39,534 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64229, dest: /127.0.0.1:60696, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0038_m_000003_0_-903691589_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742291_1467, duration: 6172000
2015-03-13 10:15:39,534 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742291_1467, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:15:39,535 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742291_1467{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:15:39,535 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64228, dest: /127.0.0.1:60686, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0038_m_000003_0_-903691589_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742291_1467, duration: 7038000
2015-03-13 10:15:39,535 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742291_1467, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:39,535 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742291_1467{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:15:39,536 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64226, dest: /127.0.0.1:60693, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0038_m_000003_0_-903691589_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742291_1467, duration: 7817000
2015-03-13 10:15:39,536 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742291_1467, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:39,536 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742291_1467{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:15:39,541 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/_temporary/1/_temporary/attempt_1426266260362_0038_m_000003_0/part-00003 is closed by DFSClient_attempt_1426266260362_0038_m_000003_0_-903691589_1
2015-03-13 10:15:39,554 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/_temporary/1/_temporary/attempt_1426266260362_0038_m_000003_0	dst=null	perm=null
2015-03-13 10:15:39,563 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/_temporary/1/_temporary/attempt_1426266260362_0038_m_000003_0	dst=null	perm=null
2015-03-13 10:15:39,563 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742292_1468 src: /127.0.0.1:64227 dest: /127.0.0.1:60689
2015-03-13 10:15:39,564 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/_temporary/1/task_1426266260362_0038_m_000003	dst=null	perm=null
2015-03-13 10:15:39,565 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742292_1468 src: /127.0.0.1:64230 dest: /127.0.0.1:60686
2015-03-13 10:15:39,566 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742292_1468 src: /127.0.0.1:64231 dest: /127.0.0.1:60696
2015-03-13 10:15:39,569 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/_temporary/1/_temporary/attempt_1426266260362_0038_m_000003_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/_temporary/1/task_1426266260362_0038_m_000003	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:15:39,572 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64216, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0038_m_000000_0_-63283770_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 140000
2015-03-13 10:15:39,575 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64231, dest: /127.0.0.1:60696, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0038_m_000001_0_689733545_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742292_1468, duration: 7055000
2015-03-13 10:15:39,575 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742292_1468, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:15:39,576 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742292_1468{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:15:39,576 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64230, dest: /127.0.0.1:60686, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0038_m_000001_0_689733545_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742292_1468, duration: 7964000
2015-03-13 10:15:39,576 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742292_1468, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:39,576 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742292_1468{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:15:39,577 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64227, dest: /127.0.0.1:60689, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0038_m_000001_0_689733545_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742292_1468, duration: 8910000
2015-03-13 10:15:39,591 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742292_1468, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:39,591 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0038_01_000005
2015-03-13 10:15:39,591 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0038	CONTAINERID=container_1426266260362_0038_01_000005
2015-03-13 10:15:39,591 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:39,591 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:39,592 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742292_1468{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:15:39,592 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:15:39,592 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0038_01_000004
2015-03-13 10:15:39,592 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0038_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:15:39,592 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:15:39,592 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0038_01_000005
2015-03-13 10:15:39,593 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0038_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:15:39,593 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0038_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:15:39,593 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0038	CONTAINERID=container_1426266260362_0038_01_000004
2015-03-13 10:15:39,593 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0038_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:15:39,593 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:15:39,593 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0038_01_000004, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:39,593 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:39,593 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:15:39,593 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0038_000001 released container container_1426266260362_0038_01_000004 on node: host: 10.1.1.144:60711 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:15:39,601 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/_temporary/1/_temporary/attempt_1426266260362_0038_m_000001_0/part-00001 is closed by DFSClient_attempt_1426266260362_0038_m_000001_0_689733545_1
2015-03-13 10:15:39,606 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0038_01_000005 is : 143
2015-03-13 10:15:39,613 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/_temporary/1/_temporary/attempt_1426266260362_0038_m_000001_0	dst=null	perm=null
2015-03-13 10:15:39,617 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0038_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:15:39,618 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0038/container_1426266260362_0038_01_000005
2015-03-13 10:15:39,618 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0038/container_1426266260362_0038_01_000005
2015-03-13 10:15:39,619 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0038/container_1426266260362_0038_01_000005
2015-03-13 10:15:39,619 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0038/container_1426266260362_0038_01_000005
2015-03-13 10:15:39,619 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0038	CONTAINERID=container_1426266260362_0038_01_000005
2015-03-13 10:15:39,619 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0038_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:15:39,619 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0038_01_000005 from application application_1426266260362_0038
2015-03-13 10:15:39,620 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:15:39,620 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0038
2015-03-13 10:15:39,622 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/_temporary/1/_temporary/attempt_1426266260362_0038_m_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073742293_1469{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:15:39,624 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/_temporary/1/_temporary/attempt_1426266260362_0038_m_000001_0	dst=null	perm=null
2015-03-13 10:15:39,625 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/_temporary/1/task_1426266260362_0038_m_000001	dst=null	perm=null
2015-03-13 10:15:39,628 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/_temporary/1/_temporary/attempt_1426266260362_0038_m_000001_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/_temporary/1/task_1426266260362_0038_m_000001	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:15:39,638 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0038_01_000003
2015-03-13 10:15:39,639 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0038	CONTAINERID=container_1426266260362_0038_01_000003
2015-03-13 10:15:39,639 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0038_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:15:39,639 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:39,639 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0038_01_000003
2015-03-13 10:15:39,639 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:15:39,640 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:15:39,640 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0038_01_000005
2015-03-13 10:15:39,640 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0038_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:15:39,640 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0038_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:15:39,640 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0038	CONTAINERID=container_1426266260362_0038_01_000005
2015-03-13 10:15:39,640 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0038_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:15:39,640 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:15:39,640 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0038_01_000005, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:39,641 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:39,641 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:15:39,641 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0038_000001 released container container_1426266260362_0038_01_000005 on node: host: 10.1.1.144:60711 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:15:39,652 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0038_01_000003 is : 143
2015-03-13 10:15:39,664 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0038_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:15:39,664 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0038/container_1426266260362_0038_01_000003
2015-03-13 10:15:39,664 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0038/container_1426266260362_0038_01_000003
2015-03-13 10:15:39,665 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0038/container_1426266260362_0038_01_000003
2015-03-13 10:15:39,665 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0038/container_1426266260362_0038_01_000003
2015-03-13 10:15:39,665 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0038	CONTAINERID=container_1426266260362_0038_01_000003
2015-03-13 10:15:39,665 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0038_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:15:39,665 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0038_01_000003 from application application_1426266260362_0038
2015-03-13 10:15:39,665 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:15:39,665 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0038
2015-03-13 10:15:39,672 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742293_1469 src: /127.0.0.1:64232 dest: /127.0.0.1:60696
2015-03-13 10:15:39,673 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742293_1469 src: /127.0.0.1:64233 dest: /127.0.0.1:60689
2015-03-13 10:15:39,675 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742293_1469 src: /127.0.0.1:64234 dest: /127.0.0.1:60693
2015-03-13 10:15:39,682 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64234, dest: /127.0.0.1:60693, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0038_m_000000_0_-63283770_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742293_1469, duration: 5890000
2015-03-13 10:15:39,682 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742293_1469, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:15:39,682 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742293_1469{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:15:39,682 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64233, dest: /127.0.0.1:60689, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0038_m_000000_0_-63283770_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742293_1469, duration: 6445000
2015-03-13 10:15:39,683 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742293_1469, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:39,683 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742293_1469{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:15:39,683 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64232, dest: /127.0.0.1:60696, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0038_m_000000_0_-63283770_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742293_1469, duration: 7187000
2015-03-13 10:15:39,683 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742293_1469, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:39,684 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742293_1469{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:15:39,688 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/_temporary/1/_temporary/attempt_1426266260362_0038_m_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0038_m_000000_0_-63283770_1
2015-03-13 10:15:39,698 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/_temporary/1/_temporary/attempt_1426266260362_0038_m_000000_0	dst=null	perm=null
2015-03-13 10:15:39,706 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/_temporary/1/_temporary/attempt_1426266260362_0038_m_000000_0	dst=null	perm=null
2015-03-13 10:15:39,707 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/_temporary/1/task_1426266260362_0038_m_000000	dst=null	perm=null
2015-03-13 10:15:39,710 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/_temporary/1/_temporary/attempt_1426266260362_0038_m_000000_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/_temporary/1/task_1426266260362_0038_m_000000	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:15:39,718 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0038_01_000002
2015-03-13 10:15:39,718 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0038	CONTAINERID=container_1426266260362_0038_01_000002
2015-03-13 10:15:39,719 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0038_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:15:39,719 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0038_01_000002
2015-03-13 10:15:39,719 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:15:39,719 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:15:39,719 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0038_01_000003
2015-03-13 10:15:39,720 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0038_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:15:39,720 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0038_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:15:39,720 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0038	CONTAINERID=container_1426266260362_0038_01_000003
2015-03-13 10:15:39,720 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0038_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:15:39,720 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:15:39,720 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0038_01_000003, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:39,720 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:39,720 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:15:39,720 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0038_000001 released container container_1426266260362_0038_01_000003 on node: host: 10.1.1.144:60711 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:15:39,723 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:15:39,725 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_213488155_1
2015-03-13 10:15:39,729 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/_temporary/1	dst=null	perm=null
2015-03-13 10:15:39,731 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0038_01_000002 is : 143
2015-03-13 10:15:39,736 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3	dst=null	perm=null
2015-03-13 10:15:39,737 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3	dst=null	perm=null
2015-03-13 10:15:39,738 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/_temporary/1/task_1426266260362_0038_m_000000	dst=null	perm=null
2015-03-13 10:15:39,740 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/part-00000	dst=null	perm=null
2015-03-13 10:15:39,743 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/_temporary/1/task_1426266260362_0038_m_000000/part-00000	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/part-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:15:39,743 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0038_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:15:39,744 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0038/container_1426266260362_0038_01_000002
2015-03-13 10:15:39,744 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0038/container_1426266260362_0038_01_000002
2015-03-13 10:15:39,744 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0038/container_1426266260362_0038_01_000002
2015-03-13 10:15:39,744 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0038/container_1426266260362_0038_01_000002
2015-03-13 10:15:39,745 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0038	CONTAINERID=container_1426266260362_0038_01_000002
2015-03-13 10:15:39,745 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0038_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:15:39,745 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0038_01_000002 from application application_1426266260362_0038
2015-03-13 10:15:39,745 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:15:39,745 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0038
2015-03-13 10:15:39,746 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3	dst=null	perm=null
2015-03-13 10:15:39,747 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3	dst=null	perm=null
2015-03-13 10:15:39,748 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/_temporary/1/task_1426266260362_0038_m_000001	dst=null	perm=null
2015-03-13 10:15:39,749 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/part-00001	dst=null	perm=null
2015-03-13 10:15:39,750 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/_temporary/1/task_1426266260362_0038_m_000001/part-00001	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/part-00001	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:15:39,751 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3	dst=null	perm=null
2015-03-13 10:15:39,751 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3	dst=null	perm=null
2015-03-13 10:15:39,752 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/_temporary/1/task_1426266260362_0038_m_000002	dst=null	perm=null
2015-03-13 10:15:39,753 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/part-00002	dst=null	perm=null
2015-03-13 10:15:39,755 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/_temporary/1/task_1426266260362_0038_m_000002/part-00002	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/part-00002	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:15:39,756 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3	dst=null	perm=null
2015-03-13 10:15:39,757 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3	dst=null	perm=null
2015-03-13 10:15:39,758 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/_temporary/1/task_1426266260362_0038_m_000003	dst=null	perm=null
2015-03-13 10:15:39,759 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/part-00003	dst=null	perm=null
2015-03-13 10:15:39,761 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/_temporary/1/task_1426266260362_0038_m_000003/part-00003	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/part-00003	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:15:39,762 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3	dst=null	perm=null
2015-03-13 10:15:39,763 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3	dst=null	perm=null
2015-03-13 10:15:39,763 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/_temporary/1/task_1426266260362_0038_m_000004	dst=null	perm=null
2015-03-13 10:15:39,764 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/part-00004	dst=null	perm=null
2015-03-13 10:15:39,766 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/_temporary/1/task_1426266260362_0038_m_000004/part-00004	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/part-00004	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:15:39,769 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/_temporary	dst=null	perm=null
2015-03-13 10:15:39,774 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:15:39,776 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/_SUCCESS is closed by DFSClient_NONMAPREDUCE_213488155_1
2015-03-13 10:15:39,778 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:15:39,780 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_213488155_1
2015-03-13 10:15:39,792 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64223, dest: /127.0.0.1:60693, bytes: 53301, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_213488155_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742290_1466, duration: 416407000
2015-03-13 10:15:39,792 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742290_1466, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:15:39,793 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742290_1466{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:15:39,793 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64222, dest: /127.0.0.1:60696, bytes: 53301, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_213488155_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742290_1466, duration: 417611000
2015-03-13 10:15:39,794 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742290_1466, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:39,795 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742290_1466{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:15:39,795 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64221, dest: /127.0.0.1:60686, bytes: 53301, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_213488155_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742290_1466, duration: 419192000
2015-03-13 10:15:39,795 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742290_1466, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:39,795 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742290_1466{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:15:39,797 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job_1426266260362_0038_1.jhist is closed by DFSClient_NONMAPREDUCE_213488155_1
2015-03-13 10:15:39,800 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0038.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:15:39,804 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0038.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742294_1470{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:15:39,806 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742294_1470 src: /127.0.0.1:64235 dest: /127.0.0.1:60693
2015-03-13 10:15:39,808 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742294_1470 src: /127.0.0.1:64236 dest: /127.0.0.1:60696
2015-03-13 10:15:39,810 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742294_1470 src: /127.0.0.1:64237 dest: /127.0.0.1:60689
2015-03-13 10:15:39,813 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64237, dest: /127.0.0.1:60689, bytes: 432, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_213488155_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742294_1470, duration: 1548000
2015-03-13 10:15:39,813 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742294_1470, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:15:39,813 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742294_1470{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:15:39,813 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64236, dest: /127.0.0.1:60696, bytes: 432, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_213488155_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742294_1470, duration: 1946000
2015-03-13 10:15:39,813 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742294_1470, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:39,814 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742294_1470{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:15:39,814 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64235, dest: /127.0.0.1:60693, bytes: 432, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_213488155_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742294_1470, duration: 2457000
2015-03-13 10:15:39,814 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742294_1470, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:39,815 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742294_1470{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:15:39,816 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0038.summary_tmp is closed by DFSClient_NONMAPREDUCE_213488155_1
2015-03-13 10:15:39,819 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0038.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:15:39,824 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job_1426266260362_0038_1.jhist	dst=null	perm=null
2015-03-13 10:15:39,826 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0038-1426266924582-soberoi-%5BFC79050368284AF1AC994EB228EC647C%2F242AE46A7EE3460A-1426266939781-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:15:39,829 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job_1426266260362_0038_1.jhist	dst=null	perm=null
2015-03-13 10:15:39,830 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0038-1426266924582-soberoi-%5BFC79050368284AF1AC994EB228EC647C%2F242AE46A7EE3460A-1426266939781-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:15:39,831 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job_1426266260362_0038_1.jhist	dst=null	perm=null
2015-03-13 10:15:39,833 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0038-1426266924582-soberoi-%5BFC79050368284AF1AC994EB228EC647C%2F242AE46A7EE3460A-1426266939781-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:15:39,838 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:64238, bytes: 53721, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_213488155_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742290_1466, duration: 175000
2015-03-13 10:15:39,840 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0038-1426266924582-soberoi-%5BFC79050368284AF1AC994EB228EC647C%2F242AE46A7EE3460A-1426266939781-5-0-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742295_1471{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:15:39,842 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742295_1471 src: /127.0.0.1:64239 dest: /127.0.0.1:60693
2015-03-13 10:15:39,843 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742295_1471 src: /127.0.0.1:64240 dest: /127.0.0.1:60696
2015-03-13 10:15:39,844 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742295_1471 src: /127.0.0.1:64241 dest: /127.0.0.1:60689
2015-03-13 10:15:39,847 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64241, dest: /127.0.0.1:60689, bytes: 53301, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_213488155_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742295_1471, duration: 1277000
2015-03-13 10:15:39,847 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742295_1471, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:15:39,847 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742295_1471{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:15:39,847 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64240, dest: /127.0.0.1:60696, bytes: 53301, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_213488155_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742295_1471, duration: 1858000
2015-03-13 10:15:39,848 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742295_1471, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:39,848 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742295_1471{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:15:39,848 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64239, dest: /127.0.0.1:60693, bytes: 53301, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_213488155_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742295_1471, duration: 2563000
2015-03-13 10:15:39,848 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742295_1471, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:39,849 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742295_1471{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:15:39,850 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0038-1426266924582-soberoi-%5BFC79050368284AF1AC994EB228EC647C%2F242AE46A7EE3460A-1426266939781-5-0-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_213488155_1
2015-03-13 10:15:39,852 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0038-1426266924582-soberoi-%5BFC79050368284AF1AC994EB228EC647C%2F242AE46A7EE3460A-1426266939781-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:15:39,853 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job_1426266260362_0038_1_conf.xml	dst=null	perm=null
2015-03-13 10:15:39,854 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0038_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:15:39,855 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job_1426266260362_0038_1_conf.xml	dst=null	perm=null
2015-03-13 10:15:39,856 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0038_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:15:39,856 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038/job_1426266260362_0038_1_conf.xml	dst=null	perm=null
2015-03-13 10:15:39,864 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0038_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:15:39,866 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64242, bytes: 90496, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_213488155_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742288_1464, duration: 251000
2015-03-13 10:15:39,868 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0038_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742296_1472{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:15:39,870 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742296_1472 src: /127.0.0.1:64243 dest: /127.0.0.1:60689
2015-03-13 10:15:39,871 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742296_1472 src: /127.0.0.1:64244 dest: /127.0.0.1:60696
2015-03-13 10:15:39,872 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742296_1472 src: /127.0.0.1:64245 dest: /127.0.0.1:60693
2015-03-13 10:15:39,876 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64245, dest: /127.0.0.1:60693, bytes: 89792, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_213488155_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742296_1472, duration: 1821000
2015-03-13 10:15:39,876 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742296_1472, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:15:39,876 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742296_1472{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:15:39,876 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64244, dest: /127.0.0.1:60696, bytes: 89792, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_213488155_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742296_1472, duration: 2334000
2015-03-13 10:15:39,876 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742296_1472, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:39,877 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742296_1472{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:15:39,877 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64243, dest: /127.0.0.1:60689, bytes: 89792, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_213488155_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742296_1472, duration: 3150000
2015-03-13 10:15:39,877 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742296_1472, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:39,878 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742296_1472{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:15:39,879 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0038_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_213488155_1
2015-03-13 10:15:39,881 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0038_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:15:39,882 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0038.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0038.summary	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:15:39,884 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0038_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0038_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:15:39,885 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0038-1426266924582-soberoi-%5BFC79050368284AF1AC994EB228EC647C%2F242AE46A7EE3460A-1426266939781-5-0-SUCCEEDED-default.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0038-1426266924582-soberoi-%5BFC79050368284AF1AC994EB228EC647C%2F242AE46A7EE3460A-1426266939781-5-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:15:39,890 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0038_000001 State change from RUNNING to FINISHING
2015-03-13 10:15:39,891 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0038
2015-03-13 10:15:39,891 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0038 State change from RUNNING to REMOVING
2015-03-13 10:15:39,891 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0038
2015-03-13 10:15:39,891 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0038 State change from REMOVING to FINISHING
2015-03-13 10:15:39,924 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:40,360 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:15:40,361 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0038_01_000006
2015-03-13 10:15:40,361 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0038_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:15:40,361 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0038_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:15:40,361 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0038	CONTAINERID=container_1426266260362_0038_01_000006
2015-03-13 10:15:40,361 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0038_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:15:40,362 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:15:40,362 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0038_01_000006, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:40,362 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:40,362 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:15:40,362 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0038_000001 released container container_1426266260362_0038_01_000006 on node: host: 10.1.1.144:60719 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:15:40,725 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:15:40,725 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0038_01_000002
2015-03-13 10:15:40,726 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0038_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:15:40,726 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0038_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:15:40,726 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0038	CONTAINERID=container_1426266260362_0038_01_000002
2015-03-13 10:15:40,726 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0038_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:15:40,726 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:15:40,727 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0038_01_000002, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:40,727 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:40,727 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:15:40,727 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0038_000001 released container container_1426266260362_0038_01_000002 on node: host: 10.1.1.144:60711 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:15:40,896 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742284_1460 127.0.0.1:60689 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60696 
2015-03-13 10:15:40,897 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742285_1461 127.0.0.1:60689 127.0.0.1:60686 127.0.0.1:60693 127.0.0.1:60696 
2015-03-13 10:15:40,897 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742286_1462 127.0.0.1:60693 127.0.0.1:60689 127.0.0.1:60686 
2015-03-13 10:15:40,897 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742287_1463 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60686 
2015-03-13 10:15:40,897 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742290_1466 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60693 
2015-03-13 10:15:40,897 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742288_1464 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60689 
2015-03-13 10:15:40,897 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0038	dst=null	perm=null
2015-03-13 10:15:40,925 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:40,933 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3	dst=null	perm=null
2015-03-13 10:15:40,934 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/_temporary
2015-03-13 10:15:40,934 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/_temporary	dst=null	perm=null
2015-03-13 10:15:40,941 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:15:40,941 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:15:40,941 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:15:40,942 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3	dst=null	perm=null
2015-03-13 10:15:40,943 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3	dst=null	perm=null
2015-03-13 10:15:40,943 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3	dst=null	perm=null
2015-03-13 10:15:40,944 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:15:40,945 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/part-00000	dst=null	perm=null
2015-03-13 10:15:40,947 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:64247, bytes: 20, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742293_1469, duration: 171000
2015-03-13 10:15:40,947 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/part-00001	dst=null	perm=null
2015-03-13 10:15:40,948 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:64247, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742292_1468, duration: 150000
2015-03-13 10:15:40,949 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/part-00002	dst=null	perm=null
2015-03-13 10:15:40,950 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:64248, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742289_1465, duration: 158000
2015-03-13 10:15:40,951 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/part-00003	dst=null	perm=null
2015-03-13 10:15:40,952 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:64249, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742291_1467, duration: 128000
2015-03-13 10:15:40,953 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/part-00004	dst=null	perm=null
2015-03-13 10:15:40,959 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:15:40,959 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:15:40,960 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:15:40,961 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3	dst=null	perm=null
2015-03-13 10:15:40,961 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3	dst=null	perm=null
2015-03-13 10:15:40,962 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3	dst=null	perm=null
2015-03-13 10:15:40,963 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:15:40,963 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/part-00000	dst=null	perm=null
2015-03-13 10:15:40,964 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:64247, bytes: 20, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742293_1469, duration: 117000
2015-03-13 10:15:40,965 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/part-00001	dst=null	perm=null
2015-03-13 10:15:40,966 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:64248, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742292_1468, duration: 131000
2015-03-13 10:15:40,967 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/part-00002	dst=null	perm=null
2015-03-13 10:15:40,968 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:64247, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742289_1465, duration: 116000
2015-03-13 10:15:40,969 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/part-00003	dst=null	perm=null
2015-03-13 10:15:40,970 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64250, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742291_1467, duration: 125000
2015-03-13 10:15:40,971 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/part-00004	dst=null	perm=null
2015-03-13 10:15:40,971 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/samepipe3
2015-03-13 10:15:40,972 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3	dst=null	perm=null
2015-03-13 10:15:40,972 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3	dst=null	perm=null
2015-03-13 10:15:40,973 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3	dst=null	perm=null
2015-03-13 10:15:40,973 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3	dst=null	perm=null
2015-03-13 10:15:40,974 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/part-00000	dst=null	perm=null
2015-03-13 10:15:40,974 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/part-00000	dst=null	perm=null
2015-03-13 10:15:40,976 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:64247, bytes: 20, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742293_1469, duration: 157000
2015-03-13 10:15:40,976 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/part-00001	dst=null	perm=null
2015-03-13 10:15:40,977 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/part-00001	dst=null	perm=null
2015-03-13 10:15:40,978 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64250, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742292_1468, duration: 163000
2015-03-13 10:15:40,978 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/part-00002	dst=null	perm=null
2015-03-13 10:15:40,978 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/part-00002	dst=null	perm=null
2015-03-13 10:15:40,980 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:64247, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742289_1465, duration: 159000
2015-03-13 10:15:40,980 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/part-00003	dst=null	perm=null
2015-03-13 10:15:40,981 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/part-00003	dst=null	perm=null
2015-03-13 10:15:40,982 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64250, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742291_1467, duration: 163000
2015-03-13 10:15:40,982 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/part-00004	dst=null	perm=null
2015-03-13 10:15:40,983 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe3/part-00004	dst=null	perm=null
2015-03-13 10:15:40,984 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:15:40,985 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:15:40,993 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:15:40,994 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:15:40,994 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:15:41,003 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupby	dst=null	perm=null
2015-03-13 10:15:41,007 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting
2015-03-13 10:15:41,007 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt"]
2015-03-13 10:15:41,007 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-03-13 10:15:41,007 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupby"]
2015-03-13 10:15:41,007 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  parallel execution is enabled: true
2015-03-13 10:15:41,007 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  starting jobs: 1
2015-03-13 10:15:41,007 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  allocating threads: 1
2015-03-13 10:15:41,008 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (1/1) ...pipesplatform/joingroupby
2015-03-13 10:15:41,016 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:15:41,030 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:15:41,032 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupby	dst=null	perm=null
2015-03-13 10:15:41,032 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:15:41,033 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:15:41,035 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 39
2015-03-13 10:15:41,035 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039	dst=null	perm=null
2015-03-13 10:15:41,036 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039	dst=null	perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:15:41,037 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039	dst=null	perm=soberoi:supergroup:rwx------
2015-03-13 10:15:41,038 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.jar	dst=null	perm=null
2015-03-13 10:15:41,039 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:15:41,040 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073742297_1473{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:15:41,041 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742297_1473 src: /127.0.0.1:64252 dest: /127.0.0.1:60686
2015-03-13 10:15:41,042 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742297_1473 src: /127.0.0.1:64253 dest: /127.0.0.1:60689
2015-03-13 10:15:41,043 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742297_1473 src: /127.0.0.1:64254 dest: /127.0.0.1:60696
2015-03-13 10:15:41,047 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64254, dest: /127.0.0.1:60696, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742297_1473, duration: 2599000
2015-03-13 10:15:41,047 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742297_1473, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:15:41,048 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742297_1473{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:15:41,048 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64253, dest: /127.0.0.1:60689, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742297_1473, duration: 2445000
2015-03-13 10:15:41,048 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742297_1473, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:41,048 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742297_1473{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:15:41,049 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64252, dest: /127.0.0.1:60686, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742297_1473, duration: 3798000
2015-03-13 10:15:41,049 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742297_1473, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:41,050 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742297_1473{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:15:41,050 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:15:41,051 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.jar
2015-03-13 10:15:41,051 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.jar	dst=null	perm=null
2015-03-13 10:15:41,052 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:15:41,053 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:15:41,053 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:15:41,054 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:15:41,054 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:15:41,055 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:15:41,055 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:15:41,056 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:15:41,056 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:15:41,057 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:15:41,058 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:15:41,058 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:15:41,059 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:15:41,060 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:15:41,061 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:15:41,061 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.split
2015-03-13 10:15:41,062 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.split	dst=null	perm=null
2015-03-13 10:15:41,063 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073742298_1474{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:15:41,064 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742298_1474 src: /127.0.0.1:64255 dest: /127.0.0.1:60689
2015-03-13 10:15:41,065 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742298_1474 src: /127.0.0.1:64256 dest: /127.0.0.1:60696
2015-03-13 10:15:41,066 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742298_1474 src: /127.0.0.1:64257 dest: /127.0.0.1:60693
2015-03-13 10:15:41,067 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742298_1474 src: /127.0.0.1:64258 dest: /127.0.0.1:60686
2015-03-13 10:15:41,073 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64258, dest: /127.0.0.1:60686, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742298_1474, duration: 1424000
2015-03-13 10:15:41,074 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742298_1474, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:15:41,074 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742298_1474{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:15:41,074 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64257, dest: /127.0.0.1:60693, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742298_1474, duration: 5256000
2015-03-13 10:15:41,074 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742298_1474, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:41,075 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742298_1474{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:15:41,075 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64256, dest: /127.0.0.1:60696, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742298_1474, duration: 6230000
2015-03-13 10:15:41,075 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742298_1474, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:41,075 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742298_1474{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:15:41,076 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64255, dest: /127.0.0.1:60689, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742298_1474, duration: 6746000
2015-03-13 10:15:41,076 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742298_1474, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:41,076 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742298_1474{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:15:41,078 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:15:41,079 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:15:41,080 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:15:41,081 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073742299_1475{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:15:41,082 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742299_1475 src: /127.0.0.1:64259 dest: /127.0.0.1:60689
2015-03-13 10:15:41,083 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742299_1475 src: /127.0.0.1:64260 dest: /127.0.0.1:60696
2015-03-13 10:15:41,084 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742299_1475 src: /127.0.0.1:64261 dest: /127.0.0.1:60686
2015-03-13 10:15:41,087 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64261, dest: /127.0.0.1:60686, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742299_1475, duration: 1020000
2015-03-13 10:15:41,087 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742299_1475, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:15:41,087 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742299_1475{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:15:41,087 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64260, dest: /127.0.0.1:60696, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742299_1475, duration: 1652000
2015-03-13 10:15:41,087 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742299_1475, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:41,088 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742299_1475{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:15:41,088 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64259, dest: /127.0.0.1:60689, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742299_1475, duration: 2196000
2015-03-13 10:15:41,088 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742299_1475, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:41,088 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742299_1475{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:15:41,089 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:15:41,089 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:15:41,090 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:15:41,092 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:15:41,092 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:15:41,093 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:15:41,093 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:15:41,096 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742300_1476{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:15:41,097 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742300_1476 src: /127.0.0.1:64262 dest: /127.0.0.1:60696
2015-03-13 10:15:41,098 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742300_1476 src: /127.0.0.1:64263 dest: /127.0.0.1:60693
2015-03-13 10:15:41,099 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742300_1476 src: /127.0.0.1:64264 dest: /127.0.0.1:60686
2015-03-13 10:15:41,102 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64264, dest: /127.0.0.1:60686, bytes: 98629, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742300_1476, duration: 1568000
2015-03-13 10:15:41,102 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742300_1476, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:15:41,102 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742300_1476{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:15:41,102 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64263, dest: /127.0.0.1:60693, bytes: 98629, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742300_1476, duration: 1945000
2015-03-13 10:15:41,103 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742300_1476, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:41,103 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742300_1476{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:15:41,103 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64262, dest: /127.0.0.1:60696, bytes: 98629, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742300_1476, duration: 2645000
2015-03-13 10:15:41,103 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742300_1476, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:41,104 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742300_1476{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:15:41,104 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:15:41,105 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0039
2015-03-13 10:15:41,105 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039	dst=null	perm=null
2015-03-13 10:15:41,106 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.xml	dst=null	perm=null
2015-03-13 10:15:41,106 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.xml	dst=null	perm=null
2015-03-13 10:15:41,107 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.jar	dst=null	perm=null
2015-03-13 10:15:41,108 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.jar	dst=null	perm=null
2015-03-13 10:15:41,108 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.split	dst=null	perm=null
2015-03-13 10:15:41,109 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.split	dst=null	perm=null
2015-03-13 10:15:41,109 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:15:41,110 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:15:41,111 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:15:41,111 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:15:41,112 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:15:41,112 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:15:41,113 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:15:41,114 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:15:41,114 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 39 submitted by user soberoi
2015-03-13 10:15:41,114 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0039
2015-03-13 10:15:41,115 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	IP=10.1.1.144	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1426266260362_0039
2015-03-13 10:15:41,115 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0039
2015-03-13 10:15:41,115 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0039 State change from NEW to NEW_SAVING
2015-03-13 10:15:41,115 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0039 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:15:41,115 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0039_000001
2015-03-13 10:15:41,115 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0039_000001 State change from NEW to SUBMITTED
2015-03-13 10:15:41,116 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0039 from user: soberoi activated in queue: default
2015-03-13 10:15:41,116 INFO  capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0039 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:15:41,116 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0039 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:15:41,116 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0039 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:15:41,116 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0039_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:15:41,116 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0039_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:15:41,117 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0039 State change from SUBMITTED to ACCEPTED
2015-03-13 10:15:41,118 INFO  mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0039/
2015-03-13 10:15:41,118 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1426266260362_0039
2015-03-13 10:15:41,118 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0039/
2015-03-13 10:15:41,338 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0039_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:15:41,338 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0039	CONTAINERID=container_1426266260362_0039_01_000001
2015-03-13 10:15:41,338 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0039_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:15:41,339 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0039 container=Container: [ContainerId: container_1426266260362_0039_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0039_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:41,339 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:15:41,339 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0039_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:15:41,339 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:41,340 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0039 AttemptId: appattempt_1426266260362_0039_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0039_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ]
2015-03-13 10:15:41,340 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0039_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:15:41,340 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0039_000001
2015-03-13 10:15:41,340 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0039_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:15:41,341 INFO  amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0039_000001
2015-03-13 10:15:41,341 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0039_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] for AM appattempt_1426266260362_0039_000001
2015-03-13 10:15:41,341 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0039_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-03-13 10:15:41,343 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0039_000001 (auth:SIMPLE)
2015-03-13 10:15:41,345 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0039_01_000001 by user soberoi
2015-03-13 10:15:41,345 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0039
2015-03-13 10:15:41,345 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0039	CONTAINERID=container_1426266260362_0039_01_000001
2015-03-13 10:15:41,345 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0039 transitioned from NEW to INITING
2015-03-13 10:15:41,345 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0039_01_000001 to application application_1426266260362_0039
2015-03-13 10:15:41,345 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0039 transitioned from INITING to RUNNING
2015-03-13 10:15:41,345 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0039_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] for AM appattempt_1426266260362_0039_000001
2015-03-13 10:15:41,346 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0039_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:15:41,346 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0039_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:15:41,346 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0039
2015-03-13 10:15:41,346 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:15:41,346 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:15:41,346 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:15:41,346 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:15:41,346 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0039_01_000001
2015-03-13 10:15:41,356 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1426266260362_0039_01_000001.tokens. Credentials list: 
2015-03-13 10:15:41,371 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:15:41,437 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1426266260362_0039_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0039/container_1426266260362_0039_01_000001.tokens
2015-03-13 10:15:41,437 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0039 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0039
2015-03-13 10:15:41,497 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.jar	dst=null	perm=null
2015-03-13 10:15:41,498 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.jar	dst=null	perm=null
2015-03-13 10:15:41,499 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.jar	dst=null	perm=null
2015-03-13 10:15:41,504 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:64248, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-695853655_20999, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742297_1473, duration: 502000
2015-03-13 10:15:41,525 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:15:41,540 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:15:41,541 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:15:41,542 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:15:41,547 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:64248, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-695853655_20999, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742299_1475, duration: 170000
2015-03-13 10:15:41,559 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:15:41,576 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.split	dst=null	perm=null
2015-03-13 10:15:41,576 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.split	dst=null	perm=null
2015-03-13 10:15:41,577 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.split	dst=null	perm=null
2015-03-13 10:15:41,582 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:64247, bytes: 1798, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-695853655_20999, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742298_1474, duration: 187000
2015-03-13 10:15:41,594 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:15:41,610 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.xml	dst=null	perm=null
2015-03-13 10:15:41,610 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.xml	dst=null	perm=null
2015-03-13 10:15:41,611 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.xml	dst=null	perm=null
2015-03-13 10:15:41,616 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64250, bytes: 99401, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-695853655_20999, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742300_1476, duration: 286000
2015-03-13 10:15:41,628 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:15:41,628 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0039_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:15:41,652 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0039_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:15:41,652 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:15:41,723 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0039/container_1426266260362_0039_01_000001/default_container_executor.sh]
2015-03-13 10:15:41,835 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742299_1475
2015-03-13 10:15:41,836 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742289_1465
2015-03-13 10:15:41,836 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742292_1468
2015-03-13 10:15:41,836 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742295_1471
2015-03-13 10:15:41,837 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742296_1472
2015-03-13 10:15:41,930 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:42,040 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742297_1473
2015-03-13 10:15:42,040 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742293_1469
2015-03-13 10:15:42,041 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742294_1470
2015-03-13 10:15:42,041 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742298_1474
2015-03-13 10:15:42,342 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:42,343 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0039_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:15:42,931 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:43,191 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742297_1473
2015-03-13 10:15:43,191 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742298_1474
2015-03-13 10:15:43,253 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742300_1476
2015-03-13 10:15:43,254 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742298_1474
2015-03-13 10:15:43,254 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742290_1466
2015-03-13 10:15:43,254 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742291_1467
2015-03-13 10:15:43,255 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742294_1470
2015-03-13 10:15:43,255 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742293_1469
2015-03-13 10:15:43,255 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742296_1472
2015-03-13 10:15:43,256 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742289_1465
2015-03-13 10:15:43,270 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:15:43,281 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60689 to replicate blk_1073742297_1473 to datanode(s) 127.0.0.1:60693
2015-03-13 10:15:43,281 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073742288_1464, blk_1073742284_1460, blk_1073742285_1461, blk_1073742286_1462]
2015-03-13 10:15:43,281 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073742288_1464, blk_1073742290_1466, blk_1073742284_1460, blk_1073742285_1461, blk_1073742287_1463]
2015-03-13 10:15:43,294 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/COMMIT_STARTED	dst=null	perm=null
2015-03-13 10:15:43,295 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/COMMIT_SUCCESS	dst=null	perm=null
2015-03-13 10:15:43,296 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/COMMIT_FAIL	dst=null	perm=null
2015-03-13 10:15:43,346 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:43,346 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039	dst=null	perm=null
2015-03-13 10:15:43,348 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:15:43,349 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:15:43,392 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742290_1466
2015-03-13 10:15:43,393 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742292_1468
2015-03-13 10:15:43,394 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742300_1476
2015-03-13 10:15:43,394 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742299_1475
2015-03-13 10:15:43,394 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742291_1467
2015-03-13 10:15:43,456 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742295_1471
2015-03-13 10:15:43,632 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:15:43,638 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:15:43,692 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:64269, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1913258026_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742299_1475, duration: 134000
2015-03-13 10:15:43,787 INFO  datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-1172757413-10.1.1.144-60689-1426266259165, infoPort=60690, ipcPort=60692, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073742297_1473 to 127.0.0.1:60693 
2015-03-13 10:15:43,788 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742288_1464 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir2/blk_1073742288 for deletion
2015-03-13 10:15:43,788 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742284_1460 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir57/blk_1073742284 for deletion
2015-03-13 10:15:43,788 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742285_1461 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir2/blk_1073742285 for deletion
2015-03-13 10:15:43,788 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742286_1462 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir57/blk_1073742286 for deletion
2015-03-13 10:15:43,788 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742288_1464 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir2/blk_1073742288
2015-03-13 10:15:43,788 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742285_1461 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir2/blk_1073742285
2015-03-13 10:15:43,788 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742284_1460 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir57/blk_1073742284
2015-03-13 10:15:43,788 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742297_1473 src: /127.0.0.1:64271 dest: /127.0.0.1:60693
2015-03-13 10:15:43,789 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742286_1462 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir57/blk_1073742286
2015-03-13 10:15:43,789 INFO  datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073742297_1473 (numBytes=254067) to /127.0.0.1:60693
2015-03-13 10:15:43,790 INFO  datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073742297_1473 src: /127.0.0.1:64271 dest: /127.0.0.1:60693 of size 254067
2015-03-13 10:15:43,790 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742297_1473 size 254067
2015-03-13 10:15:43,798 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742298_1474
2015-03-13 10:15:43,798 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742291_1467
2015-03-13 10:15:43,799 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742290_1466
2015-03-13 10:15:43,800 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742296_1472
2015-03-13 10:15:43,932 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:44,001 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742297_1473
2015-03-13 10:15:44,002 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742292_1468
2015-03-13 10:15:44,002 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742299_1475
2015-03-13 10:15:44,002 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742293_1469
2015-03-13 10:15:44,003 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742300_1476
2015-03-13 10:15:44,003 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742295_1471
2015-03-13 10:15:44,003 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742294_1470
2015-03-13 10:15:44,003 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742289_1465
2015-03-13 10:15:44,219 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742288_1464 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir39/blk_1073742288 for deletion
2015-03-13 10:15:44,220 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742290_1466 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742290 for deletion
2015-03-13 10:15:44,220 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742284_1460 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742284 for deletion
2015-03-13 10:15:44,220 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742285_1461 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742285 for deletion
2015-03-13 10:15:44,220 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742287_1463 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir39/blk_1073742287 for deletion
2015-03-13 10:15:44,220 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742288_1464 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir39/blk_1073742288
2015-03-13 10:15:44,220 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742290_1466 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742290
2015-03-13 10:15:44,220 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742287_1463 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir39/blk_1073742287
2015-03-13 10:15:44,220 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742284_1460 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742284
2015-03-13 10:15:44,220 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742285_1461 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742285
2015-03-13 10:15:44,349 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:44,488 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0039_000001 (auth:SIMPLE)
2015-03-13 10:15:44,489 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0039_000001
2015-03-13 10:15:44,489 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi	IP=10.1.1.144	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1426266260362_0039	APPATTEMPTID=appattempt_1426266260362_0039_000001
2015-03-13 10:15:44,490 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0039_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:15:44,490 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0039 State change from ACCEPTED to RUNNING
2015-03-13 10:15:44,509 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job_1426266260362_0039_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:15:44,510 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupby/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:15:44,570 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job_1426266260362_0039_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:15:44,696 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job_1426266260362_0039_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742301_1477{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:15:44,739 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742301_1477 src: /127.0.0.1:64276 dest: /127.0.0.1:60689
2015-03-13 10:15:44,740 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742301_1477 src: /127.0.0.1:64277 dest: /127.0.0.1:60686
2015-03-13 10:15:44,742 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742301_1477 src: /127.0.0.1:64278 dest: /127.0.0.1:60693
2015-03-13 10:15:44,749 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64278, dest: /127.0.0.1:60693, bytes: 91237, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1913258026_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742301_1477, duration: 5685000
2015-03-13 10:15:44,749 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742301_1477, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:15:44,750 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742301_1477{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:15:44,750 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64277, dest: /127.0.0.1:60686, bytes: 91237, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1913258026_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742301_1477, duration: 6185000
2015-03-13 10:15:44,750 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742301_1477, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:44,750 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742301_1477{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:15:44,751 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64276, dest: /127.0.0.1:60689, bytes: 91237, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1913258026_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742301_1477, duration: 7116000
2015-03-13 10:15:44,751 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742301_1477, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:15:44,751 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742301_1477{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:15:44,755 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job_1426266260362_0039_1_conf.xml is closed by DFSClient_NONMAPREDUCE_1913258026_1
2015-03-13 10:15:44,934 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:45,353 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:45,732 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0039_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:15:45,732 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0039	CONTAINERID=container_1426266260362_0039_01_000002
2015-03-13 10:15:45,732 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0039_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:15:45,733 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0039 container=Container: [ContainerId: container_1426266260362_0039_01_000002, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0039_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:45,733 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:15:45,733 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:45,734 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0039_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:15:45,734 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0039	CONTAINERID=container_1426266260362_0039_01_000003
2015-03-13 10:15:45,734 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0039_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:15:45,734 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0039 container=Container: [ContainerId: container_1426266260362_0039_01_000003, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0039_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:45,734 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:15:45,734 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:45,735 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0039_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:15:45,735 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0039	CONTAINERID=container_1426266260362_0039_01_000004
2015-03-13 10:15:45,735 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0039_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:15:45,735 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0039 container=Container: [ContainerId: container_1426266260362_0039_01_000004, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0039_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:45,735 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:15:45,735 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:45,736 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0039_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:15:45,736 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0039	CONTAINERID=container_1426266260362_0039_01_000005
2015-03-13 10:15:45,736 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0039_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:15:45,736 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0039 container=Container: [ContainerId: container_1426266260362_0039_01_000005, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0039_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:45,736 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:15:45,736 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:45,940 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:45,941 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0039_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:15:45,941 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0039	CONTAINERID=container_1426266260362_0039_01_000006
2015-03-13 10:15:45,941 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0039_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:15:45,941 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0039 container=Container: [ContainerId: container_1426266260362_0039_01_000006, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0039_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:45,941 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7
2015-03-13 10:15:45,942 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:46,031 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0038_01_000001 succeeded 
2015-03-13 10:15:46,031 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0038_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:15:46,031 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0038_01_000001
2015-03-13 10:15:46,038 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0038/container_1426266260362_0038_01_000001
2015-03-13 10:15:46,038 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0038/container_1426266260362_0038_01_000001
2015-03-13 10:15:46,038 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0038/container_1426266260362_0038_01_000001
2015-03-13 10:15:46,038 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0038	CONTAINERID=container_1426266260362_0038_01_000001
2015-03-13 10:15:46,038 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0038_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:15:46,038 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0038_01_000001 from application application_1426266260362_0038
2015-03-13 10:15:46,039 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:15:46,039 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0038
2015-03-13 10:15:46,039 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0038/container_1426266260362_0038_01_000001
2015-03-13 10:15:46,286 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073742290_1466, blk_1073742284_1460, blk_1073742285_1461, blk_1073742286_1462, blk_1073742287_1463]
2015-03-13 10:15:46,286 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073742288_1464, blk_1073742290_1466, blk_1073742284_1460, blk_1073742285_1461, blk_1073742286_1462, blk_1073742287_1463]
2015-03-13 10:15:46,358 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:46,519 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0039_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:15:46,520 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0039_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:15:46,520 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0039_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:15:46,520 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0039_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:15:46,520 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0039_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:15:46,545 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.jar	dst=null	perm=null
2015-03-13 10:15:46,546 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.jar	dst=null	perm=null
2015-03-13 10:15:46,554 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.xml	dst=null	perm=null
2015-03-13 10:15:46,555 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.xml	dst=null	perm=null
2015-03-13 10:15:46,557 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:15:46,558 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:15:46,563 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:15:46,564 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:15:46,565 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:15:46,566 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:15:46,640 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0039_000001 (auth:SIMPLE)
2015-03-13 10:15:46,640 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0039_000001 (auth:SIMPLE)
2015-03-13 10:15:46,643 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0039_01_000004 by user soberoi
2015-03-13 10:15:46,644 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0039
2015-03-13 10:15:46,644 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0039	CONTAINERID=container_1426266260362_0039_01_000004
2015-03-13 10:15:46,644 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0039 transitioned from NEW to INITING
2015-03-13 10:15:46,644 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0039_01_000004 to application application_1426266260362_0039
2015-03-13 10:15:46,644 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0039 transitioned from INITING to RUNNING
2015-03-13 10:15:46,645 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0039_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:15:46,645 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0039
2015-03-13 10:15:46,645 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0039
2015-03-13 10:15:46,645 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:15:46,645 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0039
2015-03-13 10:15:46,645 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0039_01_000005 by user soberoi
2015-03-13 10:15:46,645 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:15:46,645 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:15:46,645 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0039_01_000004
2015-03-13 10:15:46,644 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0039_01_000002 by user soberoi
2015-03-13 10:15:46,646 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0039	CONTAINERID=container_1426266260362_0039_01_000002
2015-03-13 10:15:46,646 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0039_01_000003 by user soberoi
2015-03-13 10:15:46,645 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0039	CONTAINERID=container_1426266260362_0039_01_000005
2015-03-13 10:15:46,646 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0039	CONTAINERID=container_1426266260362_0039_01_000003
2015-03-13 10:15:46,646 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0039_01_000005 to application application_1426266260362_0039
2015-03-13 10:15:46,646 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0039_01_000002 to application application_1426266260362_0039
2015-03-13 10:15:46,647 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0039_01_000003 to application application_1426266260362_0039
2015-03-13 10:15:46,647 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0039_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:15:46,647 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0039_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:15:46,645 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0039_01_000006 by user soberoi
2015-03-13 10:15:46,647 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0039_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:15:46,647 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0039
2015-03-13 10:15:46,647 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0039
2015-03-13 10:15:46,647 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:15:46,647 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0039
2015-03-13 10:15:46,647 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0039
2015-03-13 10:15:46,648 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0039
2015-03-13 10:15:46,648 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:15:46,648 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0039
2015-03-13 10:15:46,648 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0039
2015-03-13 10:15:46,648 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0039
2015-03-13 10:15:46,648 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:15:46,648 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0039
2015-03-13 10:15:46,648 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0039_01_000005
2015-03-13 10:15:46,647 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0039
2015-03-13 10:15:46,650 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0039	CONTAINERID=container_1426266260362_0039_01_000006
2015-03-13 10:15:46,650 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0039 transitioned from NEW to INITING
2015-03-13 10:15:46,650 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0039_01_000006 to application application_1426266260362_0039
2015-03-13 10:15:46,650 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0039 transitioned from INITING to RUNNING
2015-03-13 10:15:46,651 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0039_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:15:46,651 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0039
2015-03-13 10:15:46,651 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0039
2015-03-13 10:15:46,651 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:15:46,651 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0039
2015-03-13 10:15:46,651 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:15:46,651 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:15:46,651 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0039_01_000006
2015-03-13 10:15:46,650 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0039_01_000002
2015-03-13 10:15:46,652 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0039_01_000003
2015-03-13 10:15:46,668 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1426266260362_0039_01_000004.tokens. Credentials list: 
2015-03-13 10:15:46,671 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0039_01_000005.tokens. Credentials list: 
2015-03-13 10:15:46,675 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0039_01_000002.tokens. Credentials list: 
2015-03-13 10:15:46,675 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426266260362_0039_01_000006.tokens. Credentials list: 
2015-03-13 10:15:46,675 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1426266260362_0039_01_000003.tokens. Credentials list: 
2015-03-13 10:15:46,687 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:15:46,691 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:15:46,732 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:46,732 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:46,732 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:46,732 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:46,733 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0039_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:15:46,733 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0039_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:15:46,733 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0039_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:15:46,733 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0039_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:15:46,760 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1426266260362_0039_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0039/container_1426266260362_0039_01_000004.tokens
2015-03-13 10:15:46,760 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0039 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0039
2015-03-13 10:15:46,764 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426266260362_0039_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0039/container_1426266260362_0039_01_000006.tokens
2015-03-13 10:15:46,764 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0039 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0039
2015-03-13 10:15:46,816 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742288_1464 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742288 for deletion
2015-03-13 10:15:46,817 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742290_1466 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742290 for deletion
2015-03-13 10:15:46,817 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742284_1460 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742284 for deletion
2015-03-13 10:15:46,817 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742285_1461 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742285 for deletion
2015-03-13 10:15:46,817 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742288_1464 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742288
2015-03-13 10:15:46,817 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742286_1462 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742286 for deletion
2015-03-13 10:15:46,817 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742287_1463 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742287 for deletion
2015-03-13 10:15:46,817 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742284_1460 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742284
2015-03-13 10:15:46,817 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742290_1466 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742290
2015-03-13 10:15:46,817 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742286_1462 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742286
2015-03-13 10:15:46,818 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742285_1461 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742285
2015-03-13 10:15:46,818 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742287_1463 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742287
2015-03-13 10:15:46,833 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.jar	dst=null	perm=null
2015-03-13 10:15:46,834 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.jar	dst=null	perm=null
2015-03-13 10:15:46,835 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.jar	dst=null	perm=null
2015-03-13 10:15:46,839 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.jar	dst=null	perm=null
2015-03-13 10:15:46,841 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.jar	dst=null	perm=null
2015-03-13 10:15:46,841 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.jar	dst=null	perm=null
2015-03-13 10:15:46,843 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64285, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-791119468_21142, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742297_1473, duration: 470000
2015-03-13 10:15:46,849 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:64286, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1832589361_21145, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742297_1473, duration: 505000
2015-03-13 10:15:46,865 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:15:46,871 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:15:46,884 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.xml	dst=null	perm=null
2015-03-13 10:15:46,884 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.xml	dst=null	perm=null
2015-03-13 10:15:46,885 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.xml	dst=null	perm=null
2015-03-13 10:15:46,892 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:64286, bytes: 99401, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-791119468_21142, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742300_1476, duration: 281000
2015-03-13 10:15:46,893 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.xml	dst=null	perm=null
2015-03-13 10:15:46,894 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.xml	dst=null	perm=null
2015-03-13 10:15:46,894 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.xml	dst=null	perm=null
2015-03-13 10:15:46,901 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:64286, bytes: 99401, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1832589361_21145, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742300_1476, duration: 245000
2015-03-13 10:15:46,907 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:15:46,908 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0039_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:15:46,908 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0039_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:15:46,908 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0039_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:15:46,908 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0039_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:15:46,924 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:15:46,924 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0039_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:15:46,944 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 38 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:15:46,945 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0038_01_000001
2015-03-13 10:15:46,945 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:46,946 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0039_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:15:46,946 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0038_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:15:46,946 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0038_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:15:46,946 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0038	CONTAINERID=container_1426266260362_0038_01_000001
2015-03-13 10:15:46,946 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0038_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:15:46,946 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:7168, vCores:6> numContainers=6 user=soberoi user-resources=<memory:7168, vCores:6>
2015-03-13 10:15:46,946 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0038_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:46,946 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:46,946 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6
2015-03-13 10:15:46,946 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0038_000001 released container container_1426266260362_0038_01_000001 on node: host: 10.1.1.144:60723 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:15:46,946 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0038_000001
2015-03-13 10:15:46,947 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0038_000001 State change from FINISHING to FINISHED
2015-03-13 10:15:46,947 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0038 State change from FINISHING to FINISHED
2015-03-13 10:15:46,947 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1426266260362_0038
2015-03-13 10:15:46,947 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0038,name=[FC79050368284AF1AC994EB228EC647C/242AE46A7EE3460A8532FA8CFD175492] lhs/(1/1) ...edpipesplatform/samepipe3,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0038/jobhistory/job/job_1426266260362_0038,appMasterHost=Edinburgh.local,startTime=1426266924582,finishTime=1426266939891,finalStatus=SUCCEEDED
2015-03-13 10:15:46,947 INFO  capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0038_000001 is done. finalState=FINISHED
2015-03-13 10:15:46,947 INFO  amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0038_000001
2015-03-13 10:15:46,947 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0038 requests cleared
2015-03-13 10:15:46,947 INFO  capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0038 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:15:46,947 INFO  capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0038 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:15:46,951 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0038_000001 (auth:SIMPLE)
2015-03-13 10:15:46,954 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0038_01_000001
2015-03-13 10:15:46,960 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0039_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:15:46,961 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:15:46,962 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0039_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:15:46,962 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0039_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:15:46,962 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0039_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:15:46,962 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:15:46,962 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:15:46,962 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:15:46,977 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0039_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:15:46,977 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:15:47,003 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742290_1466 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir56/blk_1073742290 for deletion
2015-03-13 10:15:47,003 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742284_1460 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir56/blk_1073742284 for deletion
2015-03-13 10:15:47,003 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742285_1461 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742285 for deletion
2015-03-13 10:15:47,003 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742286_1462 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir56/blk_1073742286 for deletion
2015-03-13 10:15:47,003 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742287_1463 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742287 for deletion
2015-03-13 10:15:47,004 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742285_1461 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742285
2015-03-13 10:15:47,003 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742290_1466 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir56/blk_1073742290
2015-03-13 10:15:47,004 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742287_1463 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742287
2015-03-13 10:15:47,004 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742284_1460 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir56/blk_1073742284
2015-03-13 10:15:47,004 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742286_1462 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir56/blk_1073742286
2015-03-13 10:15:47,045 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742301_1477
2015-03-13 10:15:47,118 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0039/container_1426266260362_0039_01_000004/default_container_executor.sh]
2015-03-13 10:15:47,118 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0039/container_1426266260362_0039_01_000005/default_container_executor.sh]
2015-03-13 10:15:47,119 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0039/container_1426266260362_0039_01_000002/default_container_executor.sh]
2015-03-13 10:15:47,119 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0039/container_1426266260362_0039_01_000003/default_container_executor.sh]
2015-03-13 10:15:47,157 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0039/container_1426266260362_0039_01_000006/default_container_executor.sh]
2015-03-13 10:15:47,359 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:47,375 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0038 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:15:47,376 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0038
2015-03-13 10:15:47,376 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0038
2015-03-13 10:15:47,376 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0038 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:15:47,376 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0038
2015-03-13 10:15:47,376 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0038
2015-03-13 10:15:47,376 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0038
2015-03-13 10:15:47,376 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0038, with delay of 10800 seconds
2015-03-13 10:15:47,535 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:15:47,735 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:47,735 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:47,736 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:47,736 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:47,736 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0038 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:15:47,736 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0038
2015-03-13 10:15:47,736 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0038
2015-03-13 10:15:47,737 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0038
2015-03-13 10:15:47,737 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0038
2015-03-13 10:15:47,737 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0038
2015-03-13 10:15:47,737 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0038 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:15:47,737 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0038, with delay of 10800 seconds
2015-03-13 10:15:47,938 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:15:47,948 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:47,948 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0038 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:15:47,948 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0038
2015-03-13 10:15:47,948 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0038
2015-03-13 10:15:47,949 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0038
2015-03-13 10:15:47,949 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0038 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:15:47,949 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0038, with delay of 10800 seconds
2015-03-13 10:15:47,949 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0038
2015-03-13 10:15:47,949 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0038
2015-03-13 10:15:48,060 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1426266260362_0039_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0039/container_1426266260362_0039_01_000003.tokens
2015-03-13 10:15:48,060 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0039 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0039
2015-03-13 10:15:48,174 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:15:48,289 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0039_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0039/container_1426266260362_0039_01_000002.tokens
2015-03-13 10:15:48,290 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0039 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0039
2015-03-13 10:15:48,360 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:48,389 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:15:48,399 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742301_1477
2015-03-13 10:15:48,463 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742301_1477
2015-03-13 10:15:48,464 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742297_1473
2015-03-13 10:15:48,535 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0039_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0039/container_1426266260362_0039_01_000005.tokens
2015-03-13 10:15:48,535 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0039 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0039
2015-03-13 10:15:48,741 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:48,741 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:48,741 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:48,741 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:48,950 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:49,365 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:49,743 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:49,743 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:49,743 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:49,743 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:49,951 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:50,369 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:50,749 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:50,749 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:50,749 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:50,749 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:50,955 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:51,370 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:51,753 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:51,753 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:51,753 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:51,754 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:51,956 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:52,375 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:52,759 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:52,759 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:52,759 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:52,760 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:52,958 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:53,377 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:53,764 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:53,765 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:53,765 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:53,765 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:53,960 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:54,378 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:54,769 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:54,769 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:54,769 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:54,769 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:54,965 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:55,008 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.split	dst=null	perm=null
2015-03-13 10:15:55,015 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.split	dst=null	perm=null
2015-03-13 10:15:55,194 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.split	dst=null	perm=null
2015-03-13 10:15:55,206 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.split	dst=null	perm=null
2015-03-13 10:15:55,236 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:64299, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0039_m_000000_0_-519787827_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742298_1474, duration: 154000
2015-03-13 10:15:55,249 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64298, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0039_m_000003_0_-649879333_1, offset: 1024, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742298_1474, duration: 149000
2015-03-13 10:15:55,343 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job.split	dst=null	perm=null
2015-03-13 10:15:55,373 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:64303, bytes: 1282, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0039_m_000002_0_1030992535_1, offset: 512, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742298_1474, duration: 149000
2015-03-13 10:15:55,377 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:64302, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0039_m_000001_0_-1523368582_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742298_1474, duration: 151000
2015-03-13 10:15:55,381 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:55,390 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:15:55,395 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:64305, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0039_m_000003_0_-649879333_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 151000
2015-03-13 10:15:55,397 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:15:55,486 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64306, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0039_m_000004_0_499101343_1, offset: 1024, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742298_1474, duration: 158000
2015-03-13 10:15:55,502 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:15:55,506 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64307, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0039_m_000002_0_1030992535_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 154000
2015-03-13 10:15:55,511 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:15:55,517 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64308, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0039_m_000001_0_-1523368582_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 143000
2015-03-13 10:15:55,587 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:15:55,591 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:64309, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0039_m_000004_0_499101343_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 163000
2015-03-13 10:15:55,773 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:55,774 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:55,774 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:55,774 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:55,918 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:15:55,922 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:15:55,935 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:15:55,938 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:15:55,942 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64298, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0039_m_000003_0_-649879333_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 151000
2015-03-13 10:15:55,947 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:15:55,950 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:15:55,954 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:64299, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0039_m_000000_0_-519787827_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 140000
2015-03-13 10:15:55,968 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64310, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0039_m_000000_0_-519787827_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 147000
2015-03-13 10:15:55,969 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:55,992 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupby/_temporary/1/_temporary/attempt_1426266260362_0039_m_000003_0	dst=null	perm=null
2015-03-13 10:15:56,003 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupby/_temporary/1/_temporary/attempt_1426266260362_0039_m_000000_0	dst=null	perm=null
2015-03-13 10:15:56,012 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0039_01_000005
2015-03-13 10:15:56,012 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0039	CONTAINERID=container_1426266260362_0039_01_000005
2015-03-13 10:15:56,012 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0039_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:15:56,012 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0039_01_000005
2015-03-13 10:15:56,012 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:56,012 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:56,012 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:56,013 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:15:56,017 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0039_01_000002
2015-03-13 10:15:56,018 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0039	CONTAINERID=container_1426266260362_0039_01_000002
2015-03-13 10:15:56,018 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:56,018 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:56,018 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:56,018 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:15:56,025 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0039_01_000005 is : 143
2015-03-13 10:15:56,027 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job_1426266260362_0039_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073742302_1478{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:15:56,029 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742302_1478 src: /127.0.0.1:64311 dest: /127.0.0.1:60686
2015-03-13 10:15:56,030 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742302_1478 src: /127.0.0.1:64312 dest: /127.0.0.1:60693
2015-03-13 10:15:56,032 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742302_1478 src: /127.0.0.1:64313 dest: /127.0.0.1:60696
2015-03-13 10:15:56,036 INFO  hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job_1426266260362_0039_1.jhist for DFSClient_NONMAPREDUCE_1913258026_1
2015-03-13 10:15:56,037 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0039_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:15:56,037 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0039_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:15:56,037 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0039_01_000002
2015-03-13 10:15:56,050 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0039_01_000002 is : 143
2015-03-13 10:15:56,055 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:15:56,062 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0039/container_1426266260362_0039_01_000005
2015-03-13 10:15:56,062 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0039/container_1426266260362_0039_01_000005
2015-03-13 10:15:56,062 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0039/container_1426266260362_0039_01_000005
2015-03-13 10:15:56,062 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0039/container_1426266260362_0039_01_000005
2015-03-13 10:15:56,063 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0039_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:15:56,063 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0039	CONTAINERID=container_1426266260362_0039_01_000005
2015-03-13 10:15:56,063 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0039_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:15:56,064 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0039/container_1426266260362_0039_01_000002
2015-03-13 10:15:56,064 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0039/container_1426266260362_0039_01_000002
2015-03-13 10:15:56,064 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0039/container_1426266260362_0039_01_000002
2015-03-13 10:15:56,064 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0039/container_1426266260362_0039_01_000002
2015-03-13 10:15:56,065 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0039_01_000005 from application application_1426266260362_0039
2015-03-13 10:15:56,065 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:15:56,065 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0039
2015-03-13 10:15:56,065 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0039	CONTAINERID=container_1426266260362_0039_01_000002
2015-03-13 10:15:56,066 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0039_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:15:56,066 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0039_01_000002 from application application_1426266260362_0039
2015-03-13 10:15:56,066 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:15:56,066 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0039
2015-03-13 10:15:56,075 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:15:56,078 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:15:56,081 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:15:56,082 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64314, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0039_m_000002_0_1030992535_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 186000
2015-03-13 10:15:56,096 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:15:56,100 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:15:56,104 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64315, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0039_m_000001_0_-1523368582_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 161000
2015-03-13 10:15:56,108 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupby/_temporary/1/_temporary/attempt_1426266260362_0039_m_000002_0	dst=null	perm=null
2015-03-13 10:15:56,117 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0039_01_000004
2015-03-13 10:15:56,117 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0039	CONTAINERID=container_1426266260362_0039_01_000004
2015-03-13 10:15:56,118 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0039_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:15:56,118 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:15:56,118 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0039_01_000002
2015-03-13 10:15:56,118 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0039_01_000004
2015-03-13 10:15:56,118 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:56,118 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:15:56,119 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:15:56,119 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0039_01_000005
2015-03-13 10:15:56,119 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0039_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:15:56,119 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0039_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:15:56,119 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0039	CONTAINERID=container_1426266260362_0039_01_000002
2015-03-13 10:15:56,119 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0039_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:15:56,119 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:15:56,120 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0039_01_000002, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:56,120 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:56,120 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:15:56,120 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0039_000001 released container container_1426266260362_0039_01_000002 on node: host: 10.1.1.144:60711 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:15:56,120 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0039_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:15:56,120 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0039_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:15:56,120 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0039	CONTAINERID=container_1426266260362_0039_01_000005
2015-03-13 10:15:56,120 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0039_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:15:56,120 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:15:56,120 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0039_01_000005, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:56,120 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:56,121 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:15:56,121 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0039_000001 released container container_1426266260362_0039_01_000005 on node: host: 10.1.1.144:60711 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:15:56,132 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:15:56,133 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0039_01_000004 is : 143
2015-03-13 10:15:56,144 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0039_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:15:56,145 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0039/container_1426266260362_0039_01_000004
2015-03-13 10:15:56,145 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0039/container_1426266260362_0039_01_000004
2015-03-13 10:15:56,146 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0039/container_1426266260362_0039_01_000004
2015-03-13 10:15:56,146 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0039/container_1426266260362_0039_01_000004
2015-03-13 10:15:56,147 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0039	CONTAINERID=container_1426266260362_0039_01_000004
2015-03-13 10:15:56,147 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0039_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:15:56,147 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0039_01_000004 from application application_1426266260362_0039
2015-03-13 10:15:56,148 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:15:56,148 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0039
2015-03-13 10:15:56,148 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupby/_temporary/1/_temporary/attempt_1426266260362_0039_m_000001_0	dst=null	perm=null
2015-03-13 10:15:56,150 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:15:56,154 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:15:56,156 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0039_01_000003
2015-03-13 10:15:56,157 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0039	CONTAINERID=container_1426266260362_0039_01_000003
2015-03-13 10:15:56,157 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0039_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:15:56,157 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0039_01_000003
2015-03-13 10:15:56,157 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:15:56,157 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:15:56,157 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0039_01_000004
2015-03-13 10:15:56,158 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0039_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:15:56,158 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0039_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:15:56,158 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0039	CONTAINERID=container_1426266260362_0039_01_000004
2015-03-13 10:15:56,158 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0039_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:15:56,158 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:15:56,158 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0039_01_000004, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:56,158 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:56,158 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:15:56,159 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0039_000001 released container container_1426266260362_0039_01_000004 on node: host: 10.1.1.144:60711 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:15:56,160 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:64316, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0039_m_000004_0_499101343_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 143000
2015-03-13 10:15:56,168 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0039_01_000003 is : 143
2015-03-13 10:15:56,181 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0039_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:15:56,181 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0039/container_1426266260362_0039_01_000003
2015-03-13 10:15:56,181 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0039/container_1426266260362_0039_01_000003
2015-03-13 10:15:56,181 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0039/container_1426266260362_0039_01_000003
2015-03-13 10:15:56,182 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0039/container_1426266260362_0039_01_000003
2015-03-13 10:15:56,183 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0039	CONTAINERID=container_1426266260362_0039_01_000003
2015-03-13 10:15:56,183 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0039_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:15:56,183 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0039_01_000003 from application application_1426266260362_0039
2015-03-13 10:15:56,183 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:15:56,183 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0039
2015-03-13 10:15:56,188 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupby/_temporary/1/_temporary/attempt_1426266260362_0039_m_000004_0	dst=null	perm=null
2015-03-13 10:15:56,197 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0039_01_000006
2015-03-13 10:15:56,197 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0039	CONTAINERID=container_1426266260362_0039_01_000006
2015-03-13 10:15:56,197 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0039_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:15:56,197 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0039_01_000006
2015-03-13 10:15:56,198 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:15:56,209 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0039_01_000006 is : 143
2015-03-13 10:15:56,217 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0039_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:15:56,218 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0039/container_1426266260362_0039_01_000006
2015-03-13 10:15:56,218 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0039/container_1426266260362_0039_01_000006
2015-03-13 10:15:56,218 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0039	CONTAINERID=container_1426266260362_0039_01_000006
2015-03-13 10:15:56,218 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0039_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:15:56,218 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0039/container_1426266260362_0039_01_000006
2015-03-13 10:15:56,218 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0039/container_1426266260362_0039_01_000006
2015-03-13 10:15:56,218 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0039_01_000006 from application application_1426266260362_0039
2015-03-13 10:15:56,219 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:15:56,219 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0039
2015-03-13 10:15:56,385 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:57,161 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:15:57,162 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0039_01_000003
2015-03-13 10:15:57,162 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0039_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:15:57,162 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0039_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:15:57,162 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0039	CONTAINERID=container_1426266260362_0039_01_000003
2015-03-13 10:15:57,163 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0039_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:15:57,163 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:15:57,163 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0039_01_000003, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:57,163 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:57,163 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:15:57,163 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0039_000001 released container container_1426266260362_0039_01_000003 on node: host: 10.1.1.144:60711 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:15:57,198 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:15:57,199 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0039_01_000006
2015-03-13 10:15:57,199 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0039_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:15:57,199 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0039_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:15:57,199 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0039	CONTAINERID=container_1426266260362_0039_01_000006
2015-03-13 10:15:57,200 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0039_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:15:57,200 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:15:57,200 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0039_01_000006, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:57,200 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:57,200 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:15:57,200 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0039_000001 released container container_1426266260362_0039_01_000006 on node: host: 10.1.1.144:60723 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:15:57,386 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:58,166 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0039_01_000007 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:15:58,166 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0039	CONTAINERID=container_1426266260362_0039_01_000007
2015-03-13 10:15:58,166 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0039_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:15:58,167 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0039 container=Container: [ContainerId: container_1426266260362_0039_01_000007, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0039_01_000007 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:58,167 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:15:58,167 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:15:58,391 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:58,576 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0039_01_000007 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:15:58,583 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0039_01_000007 by user soberoi
2015-03-13 10:15:58,583 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0039	CONTAINERID=container_1426266260362_0039_01_000007
2015-03-13 10:15:58,584 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0039_01_000007 to application application_1426266260362_0039
2015-03-13 10:15:58,584 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0039_01_000007 transitioned from NEW to LOCALIZING
2015-03-13 10:15:58,584 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0039
2015-03-13 10:15:58,584 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0039
2015-03-13 10:15:58,584 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:15:58,584 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0039
2015-03-13 10:15:58,585 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0039_01_000007 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:15:58,611 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0039_01_000007 transitioned from LOCALIZED to RUNNING
2015-03-13 10:15:58,611 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:15:58,675 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0039/container_1426266260362_0039_01_000007/default_container_executor.sh]
2015-03-13 10:15:59,169 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:59,170 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0039_01_000007 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:15:59,393 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:15:59,579 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:16:00,171 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:00,398 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:00,984 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupby/_temporary/1/_temporary/attempt_1426266260362_0039_r_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:16:01,024 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupby/_temporary/1/_temporary/attempt_1426266260362_0039_r_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073742303_1479{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:16:01,081 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742303_1479 src: /127.0.0.1:64322 dest: /127.0.0.1:60693
2015-03-13 10:16:01,082 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742303_1479 src: /127.0.0.1:64323 dest: /127.0.0.1:60686
2015-03-13 10:16:01,083 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742303_1479 src: /127.0.0.1:64324 dest: /127.0.0.1:60689
2015-03-13 10:16:01,093 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64324, dest: /127.0.0.1:60689, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0039_r_000000_0_467299046_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742303_1479, duration: 8256000
2015-03-13 10:16:01,093 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742303_1479, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:16:01,093 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742303_1479{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:16:01,094 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64323, dest: /127.0.0.1:60686, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0039_r_000000_0_467299046_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742303_1479, duration: 8648000
2015-03-13 10:16:01,094 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742303_1479, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:01,094 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742303_1479{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:16:01,094 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64322, dest: /127.0.0.1:60693, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0039_r_000000_0_467299046_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742303_1479, duration: 9599000
2015-03-13 10:16:01,094 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742303_1479, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:01,095 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742303_1479{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:16:01,097 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupby/_temporary/1/_temporary/attempt_1426266260362_0039_r_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0039_r_000000_0_467299046_1
2015-03-13 10:16:01,104 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupby/_temporary/1/_temporary/attempt_1426266260362_0039_r_000000_0	dst=null	perm=null
2015-03-13 10:16:01,110 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupby/_temporary/1/_temporary/attempt_1426266260362_0039_r_000000_0	dst=null	perm=null
2015-03-13 10:16:01,110 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupby/_temporary/1/task_1426266260362_0039_r_000000	dst=null	perm=null
2015-03-13 10:16:01,113 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupby/_temporary/1/_temporary/attempt_1426266260362_0039_r_000000_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupby/_temporary/1/task_1426266260362_0039_r_000000	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:16:01,121 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0039_01_000007
2015-03-13 10:16:01,121 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0039	CONTAINERID=container_1426266260362_0039_01_000007
2015-03-13 10:16:01,121 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0039_01_000007 transitioned from RUNNING to KILLING
2015-03-13 10:16:01,121 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0039_01_000007
2015-03-13 10:16:01,121 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:16:01,125 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:16:01,127 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_1913258026_1
2015-03-13 10:16:01,131 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0039_01_000007 is : 143
2015-03-13 10:16:01,131 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupby/_temporary/1	dst=null	perm=null
2015-03-13 10:16:01,136 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupby	dst=null	perm=null
2015-03-13 10:16:01,136 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupby	dst=null	perm=null
2015-03-13 10:16:01,137 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupby/_temporary/1/task_1426266260362_0039_r_000000	dst=null	perm=null
2015-03-13 10:16:01,138 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupby/part-00000	dst=null	perm=null
2015-03-13 10:16:01,139 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0039_01_000007 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:16:01,140 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0039/container_1426266260362_0039_01_000007
2015-03-13 10:16:01,140 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0039/container_1426266260362_0039_01_000007
2015-03-13 10:16:01,140 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0039/container_1426266260362_0039_01_000007
2015-03-13 10:16:01,140 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0039	CONTAINERID=container_1426266260362_0039_01_000007
2015-03-13 10:16:01,140 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0039_01_000007 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:16:01,140 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0039_01_000007 from application application_1426266260362_0039
2015-03-13 10:16:01,140 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:16:01,140 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0039
2015-03-13 10:16:01,140 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0039/container_1426266260362_0039_01_000007
2015-03-13 10:16:01,141 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupby/_temporary/1/task_1426266260362_0039_r_000000/part-00000	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupby/part-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:16:01,145 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupby/_temporary	dst=null	perm=null
2015-03-13 10:16:01,148 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupby/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:16:01,150 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupby/_SUCCESS is closed by DFSClient_NONMAPREDUCE_1913258026_1
2015-03-13 10:16:01,151 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:16:01,153 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_1913258026_1
2015-03-13 10:16:01,165 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64313, dest: /127.0.0.1:60696, bytes: 66925, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1913258026_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742302_1478, duration: 5132289000
2015-03-13 10:16:01,165 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742302_1478, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:16:01,168 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742302_1478{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:16:01,168 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64312, dest: /127.0.0.1:60693, bytes: 66925, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1913258026_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742302_1478, duration: 5135018000
2015-03-13 10:16:01,168 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742302_1478, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:01,169 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742302_1478{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:16:01,169 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64311, dest: /127.0.0.1:60686, bytes: 66925, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1913258026_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742302_1478, duration: 5135995000
2015-03-13 10:16:01,169 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742302_1478, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:01,170 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742302_1478{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:16:01,171 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job_1426266260362_0039_1.jhist is closed by DFSClient_NONMAPREDUCE_1913258026_1
2015-03-13 10:16:01,172 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0039.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:16:01,174 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0039.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742304_1480{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:16:01,176 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742304_1480 src: /127.0.0.1:64325 dest: /127.0.0.1:60696
2015-03-13 10:16:01,177 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742304_1480 src: /127.0.0.1:64326 dest: /127.0.0.1:60693
2015-03-13 10:16:01,179 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742304_1480 src: /127.0.0.1:64327 dest: /127.0.0.1:60686
2015-03-13 10:16:01,181 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64327, dest: /127.0.0.1:60686, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1913258026_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742304_1480, duration: 1114000
2015-03-13 10:16:01,181 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742304_1480, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:16:01,182 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742304_1480{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:16:01,182 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64326, dest: /127.0.0.1:60693, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1913258026_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742304_1480, duration: 1426000
2015-03-13 10:16:01,182 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742304_1480, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:01,182 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742304_1480{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:16:01,182 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64325, dest: /127.0.0.1:60696, bytes: 455, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1913258026_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742304_1480, duration: 2253000
2015-03-13 10:16:01,183 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742304_1480, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:01,183 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742304_1480{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:16:01,184 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0039.summary_tmp is closed by DFSClient_NONMAPREDUCE_1913258026_1
2015-03-13 10:16:01,187 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0039.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:16:01,191 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job_1426266260362_0039_1.jhist	dst=null	perm=null
2015-03-13 10:16:01,192 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0039-1426266941114-soberoi-%5BFA8781853FB04941B8AA098B1F63BAFB%2F18DEFF8DBE634837-1426266961154-5-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:16:01,195 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job_1426266260362_0039_1.jhist	dst=null	perm=null
2015-03-13 10:16:01,195 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0039-1426266941114-soberoi-%5BFA8781853FB04941B8AA098B1F63BAFB%2F18DEFF8DBE634837-1426266961154-5-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:16:01,196 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job_1426266260362_0039_1.jhist	dst=null	perm=null
2015-03-13 10:16:01,198 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0039-1426266941114-soberoi-%5BFA8781853FB04941B8AA098B1F63BAFB%2F18DEFF8DBE634837-1426266961154-5-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:16:01,200 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:64328, bytes: 67449, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1913258026_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742302_1478, duration: 232000
2015-03-13 10:16:01,201 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0039-1426266941114-soberoi-%5BFA8781853FB04941B8AA098B1F63BAFB%2F18DEFF8DBE634837-1426266961154-5-1-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742305_1481{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:16:01,203 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742305_1481 src: /127.0.0.1:64329 dest: /127.0.0.1:60689
2015-03-13 10:16:01,204 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742305_1481 src: /127.0.0.1:64330 dest: /127.0.0.1:60696
2015-03-13 10:16:01,205 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742305_1481 src: /127.0.0.1:64331 dest: /127.0.0.1:60693
2015-03-13 10:16:01,208 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64331, dest: /127.0.0.1:60693, bytes: 66925, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1913258026_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742305_1481, duration: 1822000
2015-03-13 10:16:01,208 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742305_1481, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:16:01,208 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742305_1481{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:16:01,208 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64330, dest: /127.0.0.1:60696, bytes: 66925, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1913258026_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742305_1481, duration: 2297000
2015-03-13 10:16:01,208 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742305_1481, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:01,209 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742305_1481{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:16:01,209 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64329, dest: /127.0.0.1:60689, bytes: 66925, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1913258026_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742305_1481, duration: 3090000
2015-03-13 10:16:01,209 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742305_1481, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:01,210 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742305_1481{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:16:01,211 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0039-1426266941114-soberoi-%5BFA8781853FB04941B8AA098B1F63BAFB%2F18DEFF8DBE634837-1426266961154-5-1-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_1913258026_1
2015-03-13 10:16:01,212 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0039-1426266941114-soberoi-%5BFA8781853FB04941B8AA098B1F63BAFB%2F18DEFF8DBE634837-1426266961154-5-1-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:16:01,213 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job_1426266260362_0039_1_conf.xml	dst=null	perm=null
2015-03-13 10:16:01,214 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0039_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:16:01,214 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job_1426266260362_0039_1_conf.xml	dst=null	perm=null
2015-03-13 10:16:01,215 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0039_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:16:01,216 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039/job_1426266260362_0039_1_conf.xml	dst=null	perm=null
2015-03-13 10:16:01,217 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0039_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:16:01,219 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:64332, bytes: 91953, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1913258026_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742301_1477, duration: 250000
2015-03-13 10:16:01,221 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0039_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742306_1482{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:16:01,223 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742306_1482 src: /127.0.0.1:64333 dest: /127.0.0.1:60696
2015-03-13 10:16:01,224 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742306_1482 src: /127.0.0.1:64334 dest: /127.0.0.1:60689
2015-03-13 10:16:01,226 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742306_1482 src: /127.0.0.1:64335 dest: /127.0.0.1:60693
2015-03-13 10:16:01,233 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64335, dest: /127.0.0.1:60693, bytes: 91237, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1913258026_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742306_1482, duration: 1873000
2015-03-13 10:16:01,233 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742306_1482, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:16:01,234 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64334, dest: /127.0.0.1:60689, bytes: 91237, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1913258026_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742306_1482, duration: 6291000
2015-03-13 10:16:01,234 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742306_1482, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:01,234 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742306_1482{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:16:01,234 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742306_1482{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:16:01,234 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64333, dest: /127.0.0.1:60696, bytes: 91237, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1913258026_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742306_1482, duration: 7083000
2015-03-13 10:16:01,235 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742306_1482, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:01,235 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742306_1482{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:16:01,236 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0039_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_1913258026_1
2015-03-13 10:16:01,238 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0039_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:16:01,240 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0039.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0039.summary	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:16:01,242 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0039_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0039_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:16:01,244 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0039-1426266941114-soberoi-%5BFA8781853FB04941B8AA098B1F63BAFB%2F18DEFF8DBE634837-1426266961154-5-1-SUCCEEDED-default.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0039-1426266941114-soberoi-%5BFA8781853FB04941B8AA098B1F63BAFB%2F18DEFF8DBE634837-1426266961154-5-1-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:16:01,249 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0039_000001 State change from RUNNING to FINISHING
2015-03-13 10:16:01,249 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0039
2015-03-13 10:16:01,249 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0039 State change from RUNNING to REMOVING
2015-03-13 10:16:01,250 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0039
2015-03-13 10:16:01,250 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0039 State change from REMOVING to FINISHING
2015-03-13 10:16:01,400 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:02,058 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742305_1481
2015-03-13 10:16:02,059 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742303_1479
2015-03-13 10:16:02,059 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742306_1482
2015-03-13 10:16:02,127 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:16:02,127 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0039_01_000007
2015-03-13 10:16:02,128 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0039_01_000007 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:16:02,128 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0039_01_000007 in state: COMPLETED event:FINISHED
2015-03-13 10:16:02,128 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0039	CONTAINERID=container_1426266260362_0039_01_000007
2015-03-13 10:16:02,128 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0039_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:16:02,128 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:16:02,128 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0039_01_000007, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:02,129 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:02,129 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:16:02,129 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0039_000001 released container container_1426266260362_0039_01_000007 on node: host: 10.1.1.144:60711 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:16:02,254 INFO  namenode.FSEditLog (FSEditLog.java:printStatistics(663)) - Number of transactions: 4050 Total time for transactions(ms): 164 Number of transactions batched in Syncs: 14 Number of syncs: 2310 SyncTimes(ms): 657 525 
2015-03-13 10:16:02,255 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742297_1473 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60696 127.0.0.1:60693 
2015-03-13 10:16:02,255 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742298_1474 127.0.0.1:60689 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60686 
2015-03-13 10:16:02,256 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742299_1475 127.0.0.1:60689 127.0.0.1:60696 127.0.0.1:60686 
2015-03-13 10:16:02,256 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742300_1476 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60686 
2015-03-13 10:16:02,256 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742302_1478 127.0.0.1:60686 127.0.0.1:60693 127.0.0.1:60696 
2015-03-13 10:16:02,256 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742301_1477 127.0.0.1:60689 127.0.0.1:60686 127.0.0.1:60693 
2015-03-13 10:16:02,256 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0039	dst=null	perm=null
2015-03-13 10:16:02,290 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupby	dst=null	perm=null
2015-03-13 10:16:02,291 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupby/_temporary
2015-03-13 10:16:02,291 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupby/_temporary	dst=null	perm=null
2015-03-13 10:16:02,298 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:16:02,298 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:16:02,299 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:16:02,300 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupby	dst=null	perm=null
2015-03-13 10:16:02,300 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupby	dst=null	perm=null
2015-03-13 10:16:02,301 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupby	dst=null	perm=null
2015-03-13 10:16:02,302 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:16:02,302 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupby/part-00000	dst=null	perm=null
2015-03-13 10:16:02,304 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:64337, bytes: 44, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742303_1479, duration: 171000
2015-03-13 10:16:02,311 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:16:02,311 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:16:02,311 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:16:02,312 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupby	dst=null	perm=null
2015-03-13 10:16:02,313 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupby	dst=null	perm=null
2015-03-13 10:16:02,313 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupby	dst=null	perm=null
2015-03-13 10:16:02,314 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:16:02,314 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupby/part-00000	dst=null	perm=null
2015-03-13 10:16:02,315 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:64337, bytes: 44, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742303_1479, duration: 166000
2015-03-13 10:16:02,315 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/joingroupby
2015-03-13 10:16:02,316 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupby	dst=null	perm=null
2015-03-13 10:16:02,316 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupby	dst=null	perm=null
2015-03-13 10:16:02,317 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupby	dst=null	perm=null
2015-03-13 10:16:02,317 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupby	dst=null	perm=null
2015-03-13 10:16:02,318 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupby/part-00000	dst=null	perm=null
2015-03-13 10:16:02,318 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupby/part-00000	dst=null	perm=null
2015-03-13 10:16:02,319 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:64337, bytes: 44, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742303_1479, duration: 173000
2015-03-13 10:16:02,320 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:16:02,329 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:16:02,330 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:16:02,330 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:16:02,338 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe	dst=null	perm=null
2015-03-13 10:16:02,339 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower] starting
2015-03-13 10:16:02,339 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-03-13 10:16:02,340 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower]  sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe"]
2015-03-13 10:16:02,340 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower]  parallel execution is enabled: true
2015-03-13 10:16:02,340 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower]  starting jobs: 1
2015-03-13 10:16:02,340 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower]  allocating threads: 1
2015-03-13 10:16:02,341 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower] starting step: (1/1) ...dedpipesplatform/samepipe
2015-03-13 10:16:02,348 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:16:02,356 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:16:02,357 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe	dst=null	perm=null
2015-03-13 10:16:02,357 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:16:02,358 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:16:02,360 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 40
2015-03-13 10:16:02,360 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040	dst=null	perm=null
2015-03-13 10:16:02,361 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040	dst=null	perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:16:02,362 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040	dst=null	perm=soberoi:supergroup:rwx------
2015-03-13 10:16:02,363 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.jar	dst=null	perm=null
2015-03-13 10:16:02,364 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:16:02,365 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073742307_1483{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:16:02,367 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742307_1483 src: /127.0.0.1:64339 dest: /127.0.0.1:60686
2015-03-13 10:16:02,375 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742307_1483 src: /127.0.0.1:64340 dest: /127.0.0.1:60689
2015-03-13 10:16:02,376 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742307_1483 src: /127.0.0.1:64341 dest: /127.0.0.1:60696
2015-03-13 10:16:02,380 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64341, dest: /127.0.0.1:60696, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742307_1483, duration: 2788000
2015-03-13 10:16:02,380 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742307_1483, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:16:02,381 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742307_1483{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:16:02,381 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64340, dest: /127.0.0.1:60689, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742307_1483, duration: 2666000
2015-03-13 10:16:02,381 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742307_1483, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:02,381 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742307_1483{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:16:02,382 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64339, dest: /127.0.0.1:60686, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742307_1483, duration: 3662000
2015-03-13 10:16:02,382 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742307_1483, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:02,383 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742307_1483{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:16:02,383 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:16:02,384 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.jar
2015-03-13 10:16:02,384 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.jar	dst=null	perm=null
2015-03-13 10:16:02,385 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:16:02,386 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:16:02,387 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:16:02,387 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:16:02,388 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:16:02,388 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:16:02,389 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:16:02,389 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:16:02,390 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:16:02,390 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:16:02,391 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:16:02,392 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:16:02,392 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:16:02,394 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:16:02,395 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:16:02,395 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.split
2015-03-13 10:16:02,396 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.split	dst=null	perm=null
2015-03-13 10:16:02,397 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073742308_1484{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:16:02,398 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742308_1484 src: /127.0.0.1:64342 dest: /127.0.0.1:60693
2015-03-13 10:16:02,399 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742308_1484 src: /127.0.0.1:64343 dest: /127.0.0.1:60686
2015-03-13 10:16:02,400 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742308_1484 src: /127.0.0.1:64344 dest: /127.0.0.1:60689
2015-03-13 10:16:02,401 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:02,401 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742308_1484 src: /127.0.0.1:64345 dest: /127.0.0.1:60696
2015-03-13 10:16:02,404 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64345, dest: /127.0.0.1:60696, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742308_1484, duration: 1387000
2015-03-13 10:16:02,404 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742308_1484, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:16:02,404 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742308_1484{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:16:02,404 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64344, dest: /127.0.0.1:60689, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742308_1484, duration: 1762000
2015-03-13 10:16:02,405 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742308_1484, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:02,405 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742308_1484{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:16:02,405 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64343, dest: /127.0.0.1:60686, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742308_1484, duration: 2618000
2015-03-13 10:16:02,405 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742308_1484, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:02,406 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742308_1484{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:16:02,406 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64342, dest: /127.0.0.1:60693, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742308_1484, duration: 3111000
2015-03-13 10:16:02,406 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742308_1484, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:02,407 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742308_1484{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:16:02,408 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:16:02,409 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:16:02,411 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:16:02,412 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073742309_1485{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:16:02,413 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742309_1485 src: /127.0.0.1:64346 dest: /127.0.0.1:60693
2015-03-13 10:16:02,415 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742309_1485 src: /127.0.0.1:64347 dest: /127.0.0.1:60686
2015-03-13 10:16:02,415 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742309_1485 src: /127.0.0.1:64348 dest: /127.0.0.1:60689
2015-03-13 10:16:02,418 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64348, dest: /127.0.0.1:60689, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742309_1485, duration: 1061000
2015-03-13 10:16:02,418 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742309_1485, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:16:02,418 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742309_1485{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:16:02,418 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64347, dest: /127.0.0.1:60686, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742309_1485, duration: 1372000
2015-03-13 10:16:02,418 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742309_1485, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:02,419 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742309_1485{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:16:02,419 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64346, dest: /127.0.0.1:60693, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742309_1485, duration: 2035000
2015-03-13 10:16:02,419 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742309_1485, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:02,420 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742309_1485{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:16:02,420 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:16:02,421 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:16:02,422 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:16:02,423 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:16:02,424 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:16:02,425 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:16:02,425 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:16:02,429 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742310_1486{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:16:02,431 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742310_1486 src: /127.0.0.1:64349 dest: /127.0.0.1:60696
2015-03-13 10:16:02,432 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742310_1486 src: /127.0.0.1:64350 dest: /127.0.0.1:60693
2015-03-13 10:16:02,433 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742310_1486 src: /127.0.0.1:64351 dest: /127.0.0.1:60689
2015-03-13 10:16:02,436 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64351, dest: /127.0.0.1:60689, bytes: 96799, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742310_1486, duration: 1310000
2015-03-13 10:16:02,436 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742310_1486, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:16:02,437 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742310_1486{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:16:02,437 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64350, dest: /127.0.0.1:60693, bytes: 96799, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742310_1486, duration: 1861000
2015-03-13 10:16:02,437 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742310_1486, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:02,437 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742310_1486{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:16:02,437 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64349, dest: /127.0.0.1:60696, bytes: 96799, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742310_1486, duration: 2716000
2015-03-13 10:16:02,438 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742310_1486, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:02,438 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742310_1486{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:16:02,439 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:16:02,439 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0040
2015-03-13 10:16:02,440 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040	dst=null	perm=null
2015-03-13 10:16:02,441 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.xml	dst=null	perm=null
2015-03-13 10:16:02,441 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.xml	dst=null	perm=null
2015-03-13 10:16:02,442 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.jar	dst=null	perm=null
2015-03-13 10:16:02,443 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.jar	dst=null	perm=null
2015-03-13 10:16:02,444 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.split	dst=null	perm=null
2015-03-13 10:16:02,444 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.split	dst=null	perm=null
2015-03-13 10:16:02,445 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:16:02,445 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:16:02,447 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:16:02,447 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:16:02,448 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:16:02,448 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:16:02,449 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:16:02,449 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:16:02,450 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 40 submitted by user soberoi
2015-03-13 10:16:02,450 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0040
2015-03-13 10:16:02,450 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	IP=10.1.1.144	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1426266260362_0040
2015-03-13 10:16:02,450 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0040
2015-03-13 10:16:02,450 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0040 State change from NEW to NEW_SAVING
2015-03-13 10:16:02,451 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0040 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:16:02,451 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0040_000001
2015-03-13 10:16:02,451 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0040_000001 State change from NEW to SUBMITTED
2015-03-13 10:16:02,451 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0040 from user: soberoi activated in queue: default
2015-03-13 10:16:02,451 INFO  capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0040 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:16:02,451 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0040 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:16:02,451 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0040 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:16:02,452 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0040_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:16:02,452 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0040_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:16:02,454 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0040 State change from SUBMITTED to ACCEPTED
2015-03-13 10:16:02,454 INFO  mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0040/
2015-03-13 10:16:02,454 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower] submitted hadoop job: job_1426266260362_0040
2015-03-13 10:16:02,455 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0040/
2015-03-13 10:16:03,130 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0040_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:16:03,130 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0040	CONTAINERID=container_1426266260362_0040_01_000001
2015-03-13 10:16:03,131 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0040_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:16:03,131 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0040 container=Container: [ContainerId: container_1426266260362_0040_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0040_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:03,131 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:16:03,131 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0040_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:16:03,131 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:03,132 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0040 AttemptId: appattempt_1426266260362_0040_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0040_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ]
2015-03-13 10:16:03,132 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0040_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:16:03,132 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0040_000001
2015-03-13 10:16:03,133 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0040_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:16:03,133 INFO  amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0040_000001
2015-03-13 10:16:03,133 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0040_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] for AM appattempt_1426266260362_0040_000001
2015-03-13 10:16:03,134 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0040_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-03-13 10:16:03,135 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0040_000001 (auth:SIMPLE)
2015-03-13 10:16:03,137 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0040_01_000001 by user soberoi
2015-03-13 10:16:03,137 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0040
2015-03-13 10:16:03,137 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0040	CONTAINERID=container_1426266260362_0040_01_000001
2015-03-13 10:16:03,137 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0040 transitioned from NEW to INITING
2015-03-13 10:16:03,137 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0040_01_000001 to application application_1426266260362_0040
2015-03-13 10:16:03,137 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0040 transitioned from INITING to RUNNING
2015-03-13 10:16:03,137 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0040_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] for AM appattempt_1426266260362_0040_000001
2015-03-13 10:16:03,138 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0040_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:16:03,138 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0040_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:16:03,138 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0040
2015-03-13 10:16:03,138 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:16:03,138 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:16:03,138 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:16:03,138 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:16:03,138 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0040_01_000001
2015-03-13 10:16:03,147 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1426266260362_0040_01_000001.tokens. Credentials list: 
2015-03-13 10:16:03,161 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:16:03,230 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1426266260362_0040_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0040/container_1426266260362_0040_01_000001.tokens
2015-03-13 10:16:03,231 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0040 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0040
2015-03-13 10:16:03,288 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.jar	dst=null	perm=null
2015-03-13 10:16:03,288 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.jar	dst=null	perm=null
2015-03-13 10:16:03,289 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.jar	dst=null	perm=null
2015-03-13 10:16:03,295 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:64355, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_171879314_21552, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742307_1483, duration: 478000
2015-03-13 10:16:03,313 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:16:03,329 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:16:03,330 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:16:03,330 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:16:03,336 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:64356, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_171879314_21552, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742309_1485, duration: 170000
2015-03-13 10:16:03,348 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:16:03,363 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.split	dst=null	perm=null
2015-03-13 10:16:03,364 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.split	dst=null	perm=null
2015-03-13 10:16:03,364 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.split	dst=null	perm=null
2015-03-13 10:16:03,370 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:64356, bytes: 1798, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_171879314_21552, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742308_1484, duration: 127000
2015-03-13 10:16:03,383 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:16:03,399 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.xml	dst=null	perm=null
2015-03-13 10:16:03,400 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.xml	dst=null	perm=null
2015-03-13 10:16:03,400 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.xml	dst=null	perm=null
2015-03-13 10:16:03,402 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:03,403 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742307_1483
2015-03-13 10:16:03,404 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742302_1478
2015-03-13 10:16:03,404 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742304_1480
2015-03-13 10:16:03,404 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742303_1479
2015-03-13 10:16:03,404 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742308_1484
2015-03-13 10:16:03,404 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742309_1485
2015-03-13 10:16:03,407 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:64357, bytes: 97559, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_171879314_21552, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742310_1486, duration: 294000
2015-03-13 10:16:03,421 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:16:03,421 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0040_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:16:03,448 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0040_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:16:03,448 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:16:03,473 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742302_1478
2015-03-13 10:16:03,474 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742308_1484
2015-03-13 10:16:03,475 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742306_1482
2015-03-13 10:16:03,475 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742309_1485
2015-03-13 10:16:03,476 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742305_1481
2015-03-13 10:16:03,476 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742304_1480
2015-03-13 10:16:03,476 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742303_1479
2015-03-13 10:16:03,523 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0040/container_1426266260362_0040_01_000001/default_container_executor.sh]
2015-03-13 10:16:03,673 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742310_1486
2015-03-13 10:16:04,017 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742308_1484
2015-03-13 10:16:04,018 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742310_1486
2015-03-13 10:16:04,018 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742302_1478
2015-03-13 10:16:04,133 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:04,133 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0040_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:16:04,221 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742307_1483
2015-03-13 10:16:04,300 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60686 to replicate blk_1073742307_1483 to datanode(s) 127.0.0.1:60693
2015-03-13 10:16:04,300 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073742297_1473, blk_1073742298_1474, blk_1073742299_1475, blk_1073742300_1476, blk_1073742301_1477, blk_1073742302_1478]
2015-03-13 10:16:04,300 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073742297_1473, blk_1073742298_1474, blk_1073742299_1475, blk_1073742301_1477]
2015-03-13 10:16:04,407 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:04,421 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742305_1481
2015-03-13 10:16:04,422 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742306_1482
2015-03-13 10:16:04,423 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742304_1480
2015-03-13 10:16:04,803 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742297_1473 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir57/blk_1073742297 for deletion
2015-03-13 10:16:04,804 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742298_1474 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir2/blk_1073742298 for deletion
2015-03-13 10:16:04,804 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742299_1475 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir57/blk_1073742299 for deletion
2015-03-13 10:16:04,804 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742301_1477 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir2/blk_1073742301 for deletion
2015-03-13 10:16:04,804 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742297_1473 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir57/blk_1073742297
2015-03-13 10:16:04,804 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742298_1474 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir2/blk_1073742298
2015-03-13 10:16:04,804 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742299_1475 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir57/blk_1073742299
2015-03-13 10:16:04,805 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742301_1477 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir2/blk_1073742301
2015-03-13 10:16:04,828 INFO  datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-1907321454-10.1.1.144-60686-1426266259166, infoPort=60687, ipcPort=60688, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073742307_1483 to 127.0.0.1:60693 
2015-03-13 10:16:04,829 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742297_1473 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742297 for deletion
2015-03-13 10:16:04,829 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742298_1474 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir58/blk_1073742298 for deletion
2015-03-13 10:16:04,829 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742299_1475 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742299 for deletion
2015-03-13 10:16:04,829 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742300_1476 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir58/blk_1073742300 for deletion
2015-03-13 10:16:04,829 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742301_1477 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742301 for deletion
2015-03-13 10:16:04,829 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742302_1478 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742302 for deletion
2015-03-13 10:16:04,833 INFO  datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073742307_1483 (numBytes=254067) to /127.0.0.1:60693
2015-03-13 10:16:04,834 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742297_1473 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742297
2015-03-13 10:16:04,834 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742299_1475 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742299
2015-03-13 10:16:04,834 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742301_1477 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742301
2015-03-13 10:16:04,834 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742298_1474 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir58/blk_1073742298
2015-03-13 10:16:04,834 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742300_1476 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir58/blk_1073742300
2015-03-13 10:16:04,835 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742302_1478 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742302
2015-03-13 10:16:04,835 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742307_1483 src: /127.0.0.1:64358 dest: /127.0.0.1:60693
2015-03-13 10:16:04,837 INFO  datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073742307_1483 src: /127.0.0.1:64358 dest: /127.0.0.1:60693 of size 254067
2015-03-13 10:16:04,838 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742307_1483 size 254067
2015-03-13 10:16:05,092 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:16:05,112 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/COMMIT_STARTED	dst=null	perm=null
2015-03-13 10:16:05,114 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/COMMIT_SUCCESS	dst=null	perm=null
2015-03-13 10:16:05,114 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/COMMIT_FAIL	dst=null	perm=null
2015-03-13 10:16:05,134 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:05,166 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040	dst=null	perm=null
2015-03-13 10:16:05,168 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:16:05,169 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:16:05,413 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:05,444 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:16:05,451 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:16:05,507 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64360, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-151799678_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742309_1485, duration: 186000
2015-03-13 10:16:06,136 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:06,267 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0040_000001 (auth:SIMPLE)
2015-03-13 10:16:06,268 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0040_000001
2015-03-13 10:16:06,268 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi	IP=10.1.1.144	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1426266260362_0040	APPATTEMPTID=appattempt_1426266260362_0040_000001
2015-03-13 10:16:06,269 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0040_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:16:06,269 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0040 State change from ACCEPTED to RUNNING
2015-03-13 10:16:06,291 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job_1426266260362_0040_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:16:06,293 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:16:06,382 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job_1426266260362_0040_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:16:06,416 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:06,523 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job_1426266260362_0040_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742311_1487{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:16:06,567 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742311_1487 src: /127.0.0.1:64366 dest: /127.0.0.1:60689
2015-03-13 10:16:06,569 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742311_1487 src: /127.0.0.1:64367 dest: /127.0.0.1:60693
2015-03-13 10:16:06,570 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742311_1487 src: /127.0.0.1:64368 dest: /127.0.0.1:60686
2015-03-13 10:16:06,576 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64368, dest: /127.0.0.1:60686, bytes: 89593, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-151799678_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742311_1487, duration: 5059000
2015-03-13 10:16:06,577 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742311_1487, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:16:06,577 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742311_1487{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:16:06,577 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64367, dest: /127.0.0.1:60693, bytes: 89593, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-151799678_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742311_1487, duration: 5480000
2015-03-13 10:16:06,577 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742311_1487, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:06,577 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742311_1487{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:16:06,578 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64366, dest: /127.0.0.1:60689, bytes: 89593, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-151799678_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742311_1487, duration: 6269000
2015-03-13 10:16:06,578 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742311_1487, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:06,578 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742311_1487{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:16:06,582 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job_1426266260362_0040_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-151799678_1
2015-03-13 10:16:07,064 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742308_1484
2015-03-13 10:16:07,065 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742309_1485
2015-03-13 10:16:07,065 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742310_1486
2015-03-13 10:16:07,142 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:07,270 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742307_1483
2015-03-13 10:16:07,305 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073742297_1473, blk_1073742298_1474, blk_1073742300_1476, blk_1073742301_1477, blk_1073742302_1478]
2015-03-13 10:16:07,305 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073742297_1473, blk_1073742298_1474, blk_1073742299_1475, blk_1073742300_1476, blk_1073742302_1478]
2015-03-13 10:16:07,392 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0039_01_000001 succeeded 
2015-03-13 10:16:07,392 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0039_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:16:07,392 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0039_01_000001
2015-03-13 10:16:07,400 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0039/container_1426266260362_0039_01_000001
2015-03-13 10:16:07,400 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0039/container_1426266260362_0039_01_000001
2015-03-13 10:16:07,400 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0039/container_1426266260362_0039_01_000001
2015-03-13 10:16:07,400 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0039	CONTAINERID=container_1426266260362_0039_01_000001
2015-03-13 10:16:07,400 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0039_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:16:07,400 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0039_01_000001 from application application_1426266260362_0039
2015-03-13 10:16:07,400 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:16:07,400 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0039
2015-03-13 10:16:07,400 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0039/container_1426266260362_0039_01_000001
2015-03-13 10:16:07,420 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 39 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:16:07,420 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0039_01_000001
2015-03-13 10:16:07,421 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0039_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:16:07,421 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0039_000001
2015-03-13 10:16:07,421 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0039_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:16:07,421 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0039_000001 State change from FINISHING to FINISHED
2015-03-13 10:16:07,421 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0039	CONTAINERID=container_1426266260362_0039_01_000001
2015-03-13 10:16:07,421 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0039 State change from FINISHING to FINISHED
2015-03-13 10:16:07,421 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0039_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60715, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:16:07,421 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:16:07,421 INFO  amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0039_000001
2015-03-13 10:16:07,421 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0039_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:07,421 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1426266260362_0039
2015-03-13 10:16:07,422 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0039,name=[FA8781853FB04941B8AA098B1F63BAFB/18DEFF8DBE63483784F9BD9728EB5657] lower*upper/(1/1) ...pipesplatform/joingroupby,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0039/jobhistory/job/job_1426266260362_0039,appMasterHost=Edinburgh.local,startTime=1426266941114,finishTime=1426266961250,finalStatus=SUCCEEDED
2015-03-13 10:16:07,422 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:07,422 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1
2015-03-13 10:16:07,422 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0039_000001 released container container_1426266260362_0039_01_000001 on node: host: 10.1.1.144:60715 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:16:07,422 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0040_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:16:07,423 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0040	CONTAINERID=container_1426266260362_0040_01_000002
2015-03-13 10:16:07,423 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0040_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:16:07,423 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0040 container=Container: [ContainerId: container_1426266260362_0040_01_000002, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0040_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:07,423 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=2, numContainers=2
2015-03-13 10:16:07,423 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:07,424 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0040_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:16:07,424 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0040	CONTAINERID=container_1426266260362_0040_01_000003
2015-03-13 10:16:07,424 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0040_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:16:07,424 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0040 container=Container: [ContainerId: container_1426266260362_0040_01_000003, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0040_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=2, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:07,424 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=3
2015-03-13 10:16:07,424 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:07,424 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0039_000001 (auth:SIMPLE)
2015-03-13 10:16:07,424 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0040_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:16:07,425 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0040	CONTAINERID=container_1426266260362_0040_01_000004
2015-03-13 10:16:07,425 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0040_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:16:07,425 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0040 container=Container: [ContainerId: container_1426266260362_0040_01_000004, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0040_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:07,425 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=4
2015-03-13 10:16:07,425 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:07,425 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0040_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:16:07,425 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0040	CONTAINERID=container_1426266260362_0040_01_000005
2015-03-13 10:16:07,426 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0040_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:16:07,426 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0040 container=Container: [ContainerId: container_1426266260362_0040_01_000005, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0040_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:07,426 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=5
2015-03-13 10:16:07,426 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:07,426 INFO  capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0039_000001 is done. finalState=FINISHED
2015-03-13 10:16:07,426 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0039 requests cleared
2015-03-13 10:16:07,426 INFO  capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0039 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:16:07,426 INFO  capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0039 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:16:07,426 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0039_01_000001
2015-03-13 10:16:07,427 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0040_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:16:07,427 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0040	CONTAINERID=container_1426266260362_0040_01_000006
2015-03-13 10:16:07,427 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0040_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:16:07,427 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0040 container=Container: [ContainerId: container_1426266260362_0040_01_000006, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0040_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:07,427 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=1, numContainers=6
2015-03-13 10:16:07,427 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:07,470 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742311_1487
2015-03-13 10:16:08,021 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742297_1473 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742297 for deletion
2015-03-13 10:16:08,021 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742298_1474 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742298 for deletion
2015-03-13 10:16:08,021 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742300_1476 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir56/blk_1073742300 for deletion
2015-03-13 10:16:08,022 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742297_1473 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742297
2015-03-13 10:16:08,022 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742301_1477 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir56/blk_1073742301 for deletion
2015-03-13 10:16:08,022 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742298_1474 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742298
2015-03-13 10:16:08,022 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742300_1476 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir56/blk_1073742300
2015-03-13 10:16:08,022 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742302_1478 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742302 for deletion
2015-03-13 10:16:08,023 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742301_1477 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir56/blk_1073742301
2015-03-13 10:16:08,023 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742302_1478 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742302
2015-03-13 10:16:08,144 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:08,144 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0039 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:16:08,145 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0039
2015-03-13 10:16:08,145 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0039
2015-03-13 10:16:08,145 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0039 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:16:08,145 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0039, with delay of 10800 seconds
2015-03-13 10:16:08,145 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0039
2015-03-13 10:16:08,146 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0039
2015-03-13 10:16:08,145 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0039
2015-03-13 10:16:08,226 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0039 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:16:08,226 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0039
2015-03-13 10:16:08,227 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0039
2015-03-13 10:16:08,227 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0039 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:16:08,227 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0039
2015-03-13 10:16:08,227 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0039
2015-03-13 10:16:08,227 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0039, with delay of 10800 seconds
2015-03-13 10:16:08,228 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0039
2015-03-13 10:16:08,239 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742297_1473 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742297 for deletion
2015-03-13 10:16:08,239 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742298_1474 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir39/blk_1073742298 for deletion
2015-03-13 10:16:08,239 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742299_1475 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742299 for deletion
2015-03-13 10:16:08,240 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742297_1473 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742297
2015-03-13 10:16:08,240 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742300_1476 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir39/blk_1073742300 for deletion
2015-03-13 10:16:08,240 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742298_1474 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir39/blk_1073742298
2015-03-13 10:16:08,240 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742299_1475 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742299
2015-03-13 10:16:08,240 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742302_1478 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742302 for deletion
2015-03-13 10:16:08,240 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742300_1476 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir39/blk_1073742300
2015-03-13 10:16:08,240 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742302_1478 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742302
2015-03-13 10:16:08,300 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0040_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:16:08,300 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0040_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:16:08,300 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0040_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:16:08,300 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0040_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:16:08,301 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0040_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:16:08,326 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.jar	dst=null	perm=null
2015-03-13 10:16:08,327 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.jar	dst=null	perm=null
2015-03-13 10:16:08,336 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.xml	dst=null	perm=null
2015-03-13 10:16:08,336 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.xml	dst=null	perm=null
2015-03-13 10:16:08,339 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:16:08,340 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:16:08,345 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:16:08,347 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:16:08,348 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:16:08,349 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:16:08,404 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0040_000001 (auth:SIMPLE)
2015-03-13 10:16:08,405 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0040_000001 (auth:SIMPLE)
2015-03-13 10:16:08,408 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0040_01_000004 by user soberoi
2015-03-13 10:16:08,408 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0040
2015-03-13 10:16:08,408 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742311_1487
2015-03-13 10:16:08,408 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0040	CONTAINERID=container_1426266260362_0040_01_000004
2015-03-13 10:16:08,409 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0040_01_000002 by user soberoi
2015-03-13 10:16:08,409 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0040_01_000005 by user soberoi
2015-03-13 10:16:08,409 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0040 transitioned from NEW to INITING
2015-03-13 10:16:08,408 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0040_01_000006 by user soberoi
2015-03-13 10:16:08,409 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0040
2015-03-13 10:16:08,409 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0040_01_000004 to application application_1426266260362_0040
2015-03-13 10:16:08,409 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0040	CONTAINERID=container_1426266260362_0040_01_000006
2015-03-13 10:16:08,409 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0040	CONTAINERID=container_1426266260362_0040_01_000005
2015-03-13 10:16:08,410 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0040 transitioned from NEW to INITING
2015-03-13 10:16:08,410 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0040_01_000006 to application application_1426266260362_0040
2015-03-13 10:16:08,409 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0040	CONTAINERID=container_1426266260362_0040_01_000002
2015-03-13 10:16:08,410 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0040 transitioned from INITING to RUNNING
2015-03-13 10:16:08,410 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0040_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:16:08,410 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0040
2015-03-13 10:16:08,410 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0040
2015-03-13 10:16:08,410 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:16:08,410 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0040
2015-03-13 10:16:08,410 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:16:08,411 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:16:08,411 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0040_01_000006
2015-03-13 10:16:08,408 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0040_01_000003 by user soberoi
2015-03-13 10:16:08,411 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0040	CONTAINERID=container_1426266260362_0040_01_000003
2015-03-13 10:16:08,409 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0040_01_000002 to application application_1426266260362_0040
2015-03-13 10:16:08,412 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0040_01_000005 to application application_1426266260362_0040
2015-03-13 10:16:08,412 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0040_01_000003 to application application_1426266260362_0040
2015-03-13 10:16:08,412 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0040 transitioned from INITING to RUNNING
2015-03-13 10:16:08,412 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0040_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:16:08,412 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0040_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:16:08,413 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0040_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:16:08,413 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0040_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:16:08,413 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0040
2015-03-13 10:16:08,413 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0040
2015-03-13 10:16:08,413 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:16:08,413 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0040
2015-03-13 10:16:08,413 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:16:08,413 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:16:08,414 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0040
2015-03-13 10:16:08,414 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0040
2015-03-13 10:16:08,414 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:16:08,414 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0040
2015-03-13 10:16:08,414 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0040
2015-03-13 10:16:08,414 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0040
2015-03-13 10:16:08,414 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:16:08,414 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0040
2015-03-13 10:16:08,414 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0040
2015-03-13 10:16:08,414 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0040
2015-03-13 10:16:08,414 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:16:08,414 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0040
2015-03-13 10:16:08,415 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0040_01_000002
2015-03-13 10:16:08,415 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0040_01_000003
2015-03-13 10:16:08,416 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0040_01_000005
2015-03-13 10:16:08,417 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0040_01_000004
2015-03-13 10:16:08,421 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:08,422 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:08,422 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:08,422 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:08,423 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0039 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:16:08,423 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0040_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:16:08,423 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0040_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:16:08,423 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0040_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:16:08,424 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0040_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:16:08,424 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0039
2015-03-13 10:16:08,424 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0039
2015-03-13 10:16:08,425 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0039
2015-03-13 10:16:08,428 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0039
2015-03-13 10:16:08,424 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0039
2015-03-13 10:16:08,431 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0039 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:16:08,431 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0039, with delay of 10800 seconds
2015-03-13 10:16:08,431 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:08,432 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0040_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:16:08,441 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0040_01_000004.tokens. Credentials list: 
2015-03-13 10:16:08,441 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426266260362_0040_01_000002.tokens. Credentials list: 
2015-03-13 10:16:08,441 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0040_01_000005.tokens. Credentials list: 
2015-03-13 10:16:08,442 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0040_01_000003.tokens. Credentials list: 
2015-03-13 10:16:08,442 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1426266260362_0040_01_000006.tokens. Credentials list: 
2015-03-13 10:16:08,462 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:16:08,463 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:16:08,541 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1426266260362_0040_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0040/container_1426266260362_0040_01_000006.tokens
2015-03-13 10:16:08,542 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0040_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0040/container_1426266260362_0040_01_000004.tokens
2015-03-13 10:16:08,542 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0040 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0040
2015-03-13 10:16:08,542 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0040 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0040
2015-03-13 10:16:08,617 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.jar	dst=null	perm=null
2015-03-13 10:16:08,617 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.jar	dst=null	perm=null
2015-03-13 10:16:08,618 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.jar	dst=null	perm=null
2015-03-13 10:16:08,619 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.jar	dst=null	perm=null
2015-03-13 10:16:08,619 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.jar	dst=null	perm=null
2015-03-13 10:16:08,620 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.jar	dst=null	perm=null
2015-03-13 10:16:08,627 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:64377, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1165342035_21701, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742307_1483, duration: 378000
2015-03-13 10:16:08,627 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:64376, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1898719076_21700, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742307_1483, duration: 539000
2015-03-13 10:16:08,650 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:16:08,650 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:16:08,668 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.xml	dst=null	perm=null
2015-03-13 10:16:08,668 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.xml	dst=null	perm=null
2015-03-13 10:16:08,668 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.xml	dst=null	perm=null
2015-03-13 10:16:08,668 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.xml	dst=null	perm=null
2015-03-13 10:16:08,669 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.xml	dst=null	perm=null
2015-03-13 10:16:08,669 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.xml	dst=null	perm=null
2015-03-13 10:16:08,675 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:64377, bytes: 97559, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1898719076_21700, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742310_1486, duration: 295000
2015-03-13 10:16:08,676 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:64378, bytes: 97559, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1165342035_21701, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742310_1486, duration: 249000
2015-03-13 10:16:08,679 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742307_1483
2015-03-13 10:16:08,679 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742311_1487
2015-03-13 10:16:08,692 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:16:08,692 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0040_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:16:08,692 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0040_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:16:08,692 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0040_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:16:08,692 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0040_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:16:08,692 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0040_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:16:08,692 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:16:08,734 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0040_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:16:08,734 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:16:08,736 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0040_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:16:08,736 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:16:08,742 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0040_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:16:08,742 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:16:08,754 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0040_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:16:08,754 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:16:08,756 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0040_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:16:08,756 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:16:08,872 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0040/container_1426266260362_0040_01_000005/default_container_executor.sh]
2015-03-13 10:16:08,874 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0040/container_1426266260362_0040_01_000003/default_container_executor.sh]
2015-03-13 10:16:08,882 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0040/container_1426266260362_0040_01_000002/default_container_executor.sh]
2015-03-13 10:16:08,902 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0040/container_1426266260362_0040_01_000004/default_container_executor.sh]
2015-03-13 10:16:08,915 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0040/container_1426266260362_0040_01_000006/default_container_executor.sh]
2015-03-13 10:16:09,145 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:09,317 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:16:09,424 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:09,424 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:09,424 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:09,425 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:09,434 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:09,722 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:16:09,859 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0040_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0040/container_1426266260362_0040_01_000003.tokens
2015-03-13 10:16:09,859 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0040 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0040
2015-03-13 10:16:09,965 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:16:10,098 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0040_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0040/container_1426266260362_0040_01_000005.tokens
2015-03-13 10:16:10,098 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0040 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0040
2015-03-13 10:16:10,149 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:10,206 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:16:10,346 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426266260362_0040_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0040/container_1426266260362_0040_01_000002.tokens
2015-03-13 10:16:10,346 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0040 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0040
2015-03-13 10:16:10,425 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:10,425 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:10,426 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:10,426 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:10,435 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:11,154 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:11,426 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:11,426 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:11,427 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:11,427 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:11,437 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:12,158 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:12,429 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:12,430 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:12,430 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:12,430 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:12,438 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:13,161 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:13,430 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:13,431 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:13,431 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:13,431 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:13,439 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:14,166 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:14,435 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:14,435 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:14,435 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:14,435 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:14,444 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:15,170 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:15,441 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:15,441 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:15,441 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:15,441 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:15,445 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:16,171 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:16,444 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:16,444 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:16,444 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:16,444 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:16,450 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:16,456 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.split	dst=null	perm=null
2015-03-13 10:16:16,646 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.split	dst=null	perm=null
2015-03-13 10:16:16,666 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.split	dst=null	perm=null
2015-03-13 10:16:16,693 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.split	dst=null	perm=null
2015-03-13 10:16:16,703 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job.split	dst=null	perm=null
2015-03-13 10:16:16,731 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:64392, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0040_m_000001_0_-2117799446_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742308_1484, duration: 157000
2015-03-13 10:16:16,813 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64393, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0040_m_000003_0_-560688602_1, offset: 1024, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742308_1484, duration: 152000
2015-03-13 10:16:16,836 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:64394, bytes: 1282, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0040_m_000002_0_-1070795371_1, offset: 512, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742308_1484, duration: 157000
2015-03-13 10:16:16,860 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64395, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0040_m_000000_0_545617637_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742308_1484, duration: 177000
2015-03-13 10:16:16,863 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:64396, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0040_m_000004_0_1879122464_1, offset: 1024, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742308_1484, duration: 164000
2015-03-13 10:16:16,881 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:16:16,885 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:64397, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0040_m_000001_0_-2117799446_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 152000
2015-03-13 10:16:16,909 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/_temporary/1/_temporary/attempt_1426266260362_0040_m_000001_0/part-00001	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:16:16,939 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:16:16,944 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:64398, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0040_m_000003_0_-560688602_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 164000
2015-03-13 10:16:16,946 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:16:16,950 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64399, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0040_m_000002_0_-1070795371_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 175000
2015-03-13 10:16:16,960 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/_temporary/1/_temporary/attempt_1426266260362_0040_m_000003_0/part-00003	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:16:16,966 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/_temporary/1/_temporary/attempt_1426266260362_0040_m_000002_0/part-00002	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:16:16,979 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:16:16,982 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:16:16,983 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64400, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0040_m_000004_0_1879122464_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 198000
2015-03-13 10:16:17,006 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/_temporary/1/_temporary/attempt_1426266260362_0040_m_000004_0/part-00004	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:16:17,020 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/_temporary/1/_temporary/attempt_1426266260362_0040_m_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:16:17,172 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:17,298 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/_temporary/1/_temporary/attempt_1426266260362_0040_m_000001_0/part-00001. BP-1005356445-10.1.1.144-1426266257849 blk_1073742312_1488{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:16:17,343 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742312_1488 src: /127.0.0.1:64401 dest: /127.0.0.1:60693
2015-03-13 10:16:17,345 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742312_1488 src: /127.0.0.1:64402 dest: /127.0.0.1:60686
2015-03-13 10:16:17,346 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742312_1488 src: /127.0.0.1:64403 dest: /127.0.0.1:60689
2015-03-13 10:16:17,355 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64403, dest: /127.0.0.1:60689, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0040_m_000001_0_-2117799446_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742312_1488, duration: 7243000
2015-03-13 10:16:17,355 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742312_1488, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:16:17,356 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742312_1488{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:16:17,356 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64402, dest: /127.0.0.1:60686, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0040_m_000001_0_-2117799446_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742312_1488, duration: 7908000
2015-03-13 10:16:17,356 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742312_1488, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:17,356 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742312_1488{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:16:17,357 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64401, dest: /127.0.0.1:60693, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0040_m_000001_0_-2117799446_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742312_1488, duration: 8674000
2015-03-13 10:16:17,357 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742312_1488, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:17,357 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742312_1488{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:16:17,362 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/_temporary/1/_temporary/attempt_1426266260362_0040_m_000001_0/part-00001 is closed by DFSClient_attempt_1426266260362_0040_m_000001_0_-2117799446_1
2015-03-13 10:16:17,365 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/_temporary/1/_temporary/attempt_1426266260362_0040_m_000003_0/part-00003. BP-1005356445-10.1.1.144-1426266257849 blk_1073742313_1489{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:16:17,376 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/_temporary/1/_temporary/attempt_1426266260362_0040_m_000001_0	dst=null	perm=null
2015-03-13 10:16:17,384 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/_temporary/1/_temporary/attempt_1426266260362_0040_m_000001_0	dst=null	perm=null
2015-03-13 10:16:17,386 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/_temporary/1/task_1426266260362_0040_m_000001	dst=null	perm=null
2015-03-13 10:16:17,391 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/_temporary/1/_temporary/attempt_1426266260362_0040_m_000001_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/_temporary/1/task_1426266260362_0040_m_000001	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:16:17,409 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/_temporary/1/_temporary/attempt_1426266260362_0040_m_000002_0/part-00002. BP-1005356445-10.1.1.144-1426266257849 blk_1073742314_1490{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:16:17,411 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742313_1489 src: /127.0.0.1:64404 dest: /127.0.0.1:60689
2015-03-13 10:16:17,412 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0040_01_000003
2015-03-13 10:16:17,412 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0040	CONTAINERID=container_1426266260362_0040_01_000003
2015-03-13 10:16:17,412 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0040_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:16:17,412 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0040_01_000003
2015-03-13 10:16:17,412 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:17,412 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:16:17,412 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:17,412 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:17,413 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742313_1489 src: /127.0.0.1:64405 dest: /127.0.0.1:60696
2015-03-13 10:16:17,414 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742313_1489 src: /127.0.0.1:64406 dest: /127.0.0.1:60686
2015-03-13 10:16:17,425 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0040_01_000003 is : 143
2015-03-13 10:16:17,427 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job_1426266260362_0040_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073742315_1491{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:16:17,429 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742315_1491 src: /127.0.0.1:64408 dest: /127.0.0.1:60686
2015-03-13 10:16:17,430 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742315_1491 src: /127.0.0.1:64409 dest: /127.0.0.1:60689
2015-03-13 10:16:17,432 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742315_1491 src: /127.0.0.1:64410 dest: /127.0.0.1:60693
2015-03-13 10:16:17,437 INFO  hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job_1426266260362_0040_1.jhist for DFSClient_NONMAPREDUCE_-151799678_1
2015-03-13 10:16:17,438 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0040_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:16:17,438 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0040/container_1426266260362_0040_01_000003
2015-03-13 10:16:17,439 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0040	CONTAINERID=container_1426266260362_0040_01_000003
2015-03-13 10:16:17,439 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0040/container_1426266260362_0040_01_000003
2015-03-13 10:16:17,439 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0040/container_1426266260362_0040_01_000003
2015-03-13 10:16:17,439 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0040/container_1426266260362_0040_01_000003
2015-03-13 10:16:17,439 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0040_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:16:17,439 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0040_01_000003 from application application_1426266260362_0040
2015-03-13 10:16:17,439 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:16:17,440 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0040
2015-03-13 10:16:17,450 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64406, dest: /127.0.0.1:60686, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0040_m_000003_0_-560688602_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742313_1489, duration: 34068000
2015-03-13 10:16:17,450 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742313_1489, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:16:17,450 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:17,451 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742313_1489{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:16:17,451 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64405, dest: /127.0.0.1:60696, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0040_m_000003_0_-560688602_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742313_1489, duration: 34725000
2015-03-13 10:16:17,451 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742313_1489, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:17,451 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742313_1489{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:16:17,452 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64404, dest: /127.0.0.1:60689, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0040_m_000003_0_-560688602_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742313_1489, duration: 35596000
2015-03-13 10:16:17,452 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742313_1489, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:17,452 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742313_1489{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:16:17,461 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/_temporary/1/_temporary/attempt_1426266260362_0040_m_000003_0/part-00003 is closed by DFSClient_attempt_1426266260362_0040_m_000003_0_-560688602_1
2015-03-13 10:16:17,474 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/_temporary/1/_temporary/attempt_1426266260362_0040_m_000003_0	dst=null	perm=null
2015-03-13 10:16:17,476 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742314_1490 src: /127.0.0.1:64407 dest: /127.0.0.1:60689
2015-03-13 10:16:17,476 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742312_1488
2015-03-13 10:16:17,476 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742313_1489
2015-03-13 10:16:17,477 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742314_1490 src: /127.0.0.1:64411 dest: /127.0.0.1:60693
2015-03-13 10:16:17,478 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742314_1490 src: /127.0.0.1:64412 dest: /127.0.0.1:60686
2015-03-13 10:16:17,486 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64412, dest: /127.0.0.1:60686, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0040_m_000002_0_-1070795371_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742314_1490, duration: 6153000
2015-03-13 10:16:17,486 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742314_1490, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:16:17,486 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742314_1490{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:16:17,486 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64411, dest: /127.0.0.1:60693, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0040_m_000002_0_-1070795371_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742314_1490, duration: 6769000
2015-03-13 10:16:17,486 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742314_1490, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:17,487 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742314_1490{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:16:17,487 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64407, dest: /127.0.0.1:60689, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0040_m_000002_0_-1070795371_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742314_1490, duration: 7551000
2015-03-13 10:16:17,487 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742314_1490, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:17,488 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742314_1490{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:16:17,488 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/_temporary/1/_temporary/attempt_1426266260362_0040_m_000003_0	dst=null	perm=null
2015-03-13 10:16:17,489 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/_temporary/1/task_1426266260362_0040_m_000003	dst=null	perm=null
2015-03-13 10:16:17,493 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/_temporary/1/_temporary/attempt_1426266260362_0040_m_000003_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/_temporary/1/task_1426266260362_0040_m_000003	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:16:17,496 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/_temporary/1/_temporary/attempt_1426266260362_0040_m_000002_0/part-00002 is closed by DFSClient_attempt_1426266260362_0040_m_000002_0_-1070795371_1
2015-03-13 10:16:17,501 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/_temporary/1/_temporary/attempt_1426266260362_0040_m_000004_0/part-00004 is closed by DFSClient_attempt_1426266260362_0040_m_000004_0_1879122464_1
2015-03-13 10:16:17,506 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0040_01_000005
2015-03-13 10:16:17,506 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0040	CONTAINERID=container_1426266260362_0040_01_000005
2015-03-13 10:16:17,506 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0040_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:16:17,506 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0040_01_000005
2015-03-13 10:16:17,506 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:17,507 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:16:17,507 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0040_01_000003
2015-03-13 10:16:17,507 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:17,507 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:16:17,507 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0040_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:16:17,507 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0040_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:16:17,507 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0040	CONTAINERID=container_1426266260362_0040_01_000003
2015-03-13 10:16:17,508 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0040_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:16:17,508 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:16:17,508 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0040_01_000003, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:17,508 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:17,508 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:16:17,508 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0040_000001 released container container_1426266260362_0040_01_000003 on node: host: 10.1.1.144:60715 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:16:17,519 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0040_01_000005 is : 143
2015-03-13 10:16:17,521 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/_temporary/1/_temporary/attempt_1426266260362_0040_m_000002_0	dst=null	perm=null
2015-03-13 10:16:17,527 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/_temporary/1/_temporary/attempt_1426266260362_0040_m_000004_0	dst=null	perm=null
2015-03-13 10:16:17,529 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/_temporary/1/_temporary/attempt_1426266260362_0040_m_000002_0	dst=null	perm=null
2015-03-13 10:16:17,530 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/_temporary/1/task_1426266260362_0040_m_000002	dst=null	perm=null
2015-03-13 10:16:17,532 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0040_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:16:17,533 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0040/container_1426266260362_0040_01_000005
2015-03-13 10:16:17,533 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0040/container_1426266260362_0040_01_000005
2015-03-13 10:16:17,533 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0040/container_1426266260362_0040_01_000005
2015-03-13 10:16:17,533 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0040/container_1426266260362_0040_01_000005
2015-03-13 10:16:17,533 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0040	CONTAINERID=container_1426266260362_0040_01_000005
2015-03-13 10:16:17,533 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0040_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:16:17,534 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0040_01_000005 from application application_1426266260362_0040
2015-03-13 10:16:17,534 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:16:17,534 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0040
2015-03-13 10:16:17,535 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/_temporary/1/_temporary/attempt_1426266260362_0040_m_000002_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/_temporary/1/task_1426266260362_0040_m_000002	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:16:17,543 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64395, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0040_m_000000_0_545617637_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 187000
2015-03-13 10:16:17,544 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/_temporary/1/_temporary/attempt_1426266260362_0040_m_000004_0	dst=null	perm=null
2015-03-13 10:16:17,545 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/_temporary/1/task_1426266260362_0040_m_000004	dst=null	perm=null
2015-03-13 10:16:17,546 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0040_01_000004
2015-03-13 10:16:17,546 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0040	CONTAINERID=container_1426266260362_0040_01_000004
2015-03-13 10:16:17,546 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0040_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:16:17,547 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:17,547 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0040_01_000004
2015-03-13 10:16:17,547 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:16:17,547 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:16:17,547 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0040_01_000005
2015-03-13 10:16:17,547 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0040_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:16:17,547 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0040_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:16:17,548 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0040	CONTAINERID=container_1426266260362_0040_01_000005
2015-03-13 10:16:17,548 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0040_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:16:17,548 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:16:17,548 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0040_01_000005, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:17,548 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:17,548 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:16:17,548 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0040_000001 released container container_1426266260362_0040_01_000005 on node: host: 10.1.1.144:60715 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:16:17,550 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/_temporary/1/_temporary/attempt_1426266260362_0040_m_000004_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/_temporary/1/task_1426266260362_0040_m_000004	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:16:17,559 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0040_01_000004 is : 143
2015-03-13 10:16:17,561 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0040_01_000006
2015-03-13 10:16:17,562 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0040	CONTAINERID=container_1426266260362_0040_01_000006
2015-03-13 10:16:17,562 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0040_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:16:17,562 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0040_01_000006
2015-03-13 10:16:17,562 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:16:17,571 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/_temporary/1/_temporary/attempt_1426266260362_0040_m_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073742316_1492{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:16:17,574 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0040_01_000006 is : 143
2015-03-13 10:16:17,579 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0040_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:16:17,580 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0040/container_1426266260362_0040_01_000004
2015-03-13 10:16:17,580 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0040/container_1426266260362_0040_01_000004
2015-03-13 10:16:17,581 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0040/container_1426266260362_0040_01_000004
2015-03-13 10:16:17,582 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0040/container_1426266260362_0040_01_000004
2015-03-13 10:16:17,582 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0040	CONTAINERID=container_1426266260362_0040_01_000004
2015-03-13 10:16:17,582 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0040_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:16:17,582 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0040_01_000004 from application application_1426266260362_0040
2015-03-13 10:16:17,583 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:16:17,583 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0040
2015-03-13 10:16:17,585 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0040_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:16:17,585 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0040/container_1426266260362_0040_01_000006
2015-03-13 10:16:17,586 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0040/container_1426266260362_0040_01_000006
2015-03-13 10:16:17,586 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0040/container_1426266260362_0040_01_000006
2015-03-13 10:16:17,586 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0040/container_1426266260362_0040_01_000006
2015-03-13 10:16:17,586 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0040	CONTAINERID=container_1426266260362_0040_01_000006
2015-03-13 10:16:17,586 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0040_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:16:17,586 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0040_01_000006 from application application_1426266260362_0040
2015-03-13 10:16:17,586 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:16:17,586 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0040
2015-03-13 10:16:17,611 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742316_1492 src: /127.0.0.1:64413 dest: /127.0.0.1:60693
2015-03-13 10:16:17,613 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742316_1492 src: /127.0.0.1:64414 dest: /127.0.0.1:60696
2015-03-13 10:16:17,614 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742316_1492 src: /127.0.0.1:64415 dest: /127.0.0.1:60686
2015-03-13 10:16:17,621 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64415, dest: /127.0.0.1:60686, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0040_m_000000_0_545617637_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742316_1492, duration: 5433000
2015-03-13 10:16:17,621 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742316_1492, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:16:17,622 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742316_1492{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:16:17,622 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64414, dest: /127.0.0.1:60696, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0040_m_000000_0_545617637_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742316_1492, duration: 6093000
2015-03-13 10:16:17,622 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742316_1492, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:17,622 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742316_1492{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:16:17,622 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64413, dest: /127.0.0.1:60693, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0040_m_000000_0_545617637_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742316_1492, duration: 6777000
2015-03-13 10:16:17,623 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742316_1492, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:17,623 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742316_1492{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:16:17,627 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/_temporary/1/_temporary/attempt_1426266260362_0040_m_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0040_m_000000_0_545617637_1
2015-03-13 10:16:17,637 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/_temporary/1/_temporary/attempt_1426266260362_0040_m_000000_0	dst=null	perm=null
2015-03-13 10:16:17,645 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/_temporary/1/_temporary/attempt_1426266260362_0040_m_000000_0	dst=null	perm=null
2015-03-13 10:16:17,646 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/_temporary/1/task_1426266260362_0040_m_000000	dst=null	perm=null
2015-03-13 10:16:17,649 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/_temporary/1/_temporary/attempt_1426266260362_0040_m_000000_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/_temporary/1/task_1426266260362_0040_m_000000	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:16:17,657 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0040_01_000002
2015-03-13 10:16:17,657 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0040	CONTAINERID=container_1426266260362_0040_01_000002
2015-03-13 10:16:17,658 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0040_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:16:17,658 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0040_01_000002
2015-03-13 10:16:17,658 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:16:17,658 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:16:17,658 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0040_01_000004
2015-03-13 10:16:17,658 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0040_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:16:17,659 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0040_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:16:17,659 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0040	CONTAINERID=container_1426266260362_0040_01_000004
2015-03-13 10:16:17,659 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0040_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:16:17,659 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:16:17,659 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0040_01_000004, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:17,659 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:17,659 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:16:17,659 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0040_000001 released container container_1426266260362_0040_01_000004 on node: host: 10.1.1.144:60715 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:16:17,662 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:16:17,664 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-151799678_1
2015-03-13 10:16:17,667 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/_temporary/1	dst=null	perm=null
2015-03-13 10:16:17,668 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0040_01_000002 is : 143
2015-03-13 10:16:17,674 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe	dst=null	perm=null
2015-03-13 10:16:17,675 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe	dst=null	perm=null
2015-03-13 10:16:17,676 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/_temporary/1/task_1426266260362_0040_m_000000	dst=null	perm=null
2015-03-13 10:16:17,677 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/part-00000	dst=null	perm=null
2015-03-13 10:16:17,680 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/_temporary/1/task_1426266260362_0040_m_000000/part-00000	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/part-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:16:17,681 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0040_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:16:17,683 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0040/container_1426266260362_0040_01_000002
2015-03-13 10:16:17,683 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0040/container_1426266260362_0040_01_000002
2015-03-13 10:16:17,684 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe	dst=null	perm=null
2015-03-13 10:16:17,684 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0040/container_1426266260362_0040_01_000002
2015-03-13 10:16:17,685 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe	dst=null	perm=null
2015-03-13 10:16:17,686 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/_temporary/1/task_1426266260362_0040_m_000001	dst=null	perm=null
2015-03-13 10:16:17,687 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0040/container_1426266260362_0040_01_000002
2015-03-13 10:16:17,687 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0040	CONTAINERID=container_1426266260362_0040_01_000002
2015-03-13 10:16:17,687 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0040_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:16:17,687 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0040_01_000002 from application application_1426266260362_0040
2015-03-13 10:16:17,687 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:16:17,687 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0040
2015-03-13 10:16:17,688 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/part-00001	dst=null	perm=null
2015-03-13 10:16:17,689 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/_temporary/1/task_1426266260362_0040_m_000001/part-00001	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/part-00001	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:16:17,690 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe	dst=null	perm=null
2015-03-13 10:16:17,691 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe	dst=null	perm=null
2015-03-13 10:16:17,692 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/_temporary/1/task_1426266260362_0040_m_000002	dst=null	perm=null
2015-03-13 10:16:17,694 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/part-00002	dst=null	perm=null
2015-03-13 10:16:17,696 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/_temporary/1/task_1426266260362_0040_m_000002/part-00002	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/part-00002	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:16:17,698 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe	dst=null	perm=null
2015-03-13 10:16:17,699 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe	dst=null	perm=null
2015-03-13 10:16:17,701 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/_temporary/1/task_1426266260362_0040_m_000003	dst=null	perm=null
2015-03-13 10:16:17,702 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/part-00003	dst=null	perm=null
2015-03-13 10:16:17,703 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/_temporary/1/task_1426266260362_0040_m_000003/part-00003	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/part-00003	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:16:17,704 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe	dst=null	perm=null
2015-03-13 10:16:17,705 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe	dst=null	perm=null
2015-03-13 10:16:17,706 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/_temporary/1/task_1426266260362_0040_m_000004	dst=null	perm=null
2015-03-13 10:16:17,706 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/part-00004	dst=null	perm=null
2015-03-13 10:16:17,708 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/_temporary/1/task_1426266260362_0040_m_000004/part-00004	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/part-00004	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:16:17,711 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/_temporary	dst=null	perm=null
2015-03-13 10:16:17,714 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:16:17,715 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-151799678_1
2015-03-13 10:16:17,717 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:16:17,719 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-151799678_1
2015-03-13 10:16:17,734 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64410, dest: /127.0.0.1:60693, bytes: 53304, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-151799678_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742315_1491, duration: 299753000
2015-03-13 10:16:17,734 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742315_1491, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:16:17,735 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742315_1491{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:16:17,735 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64409, dest: /127.0.0.1:60689, bytes: 53304, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-151799678_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742315_1491, duration: 300950000
2015-03-13 10:16:17,735 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742315_1491, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:17,736 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742315_1491{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:16:17,736 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64408, dest: /127.0.0.1:60686, bytes: 53304, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-151799678_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742315_1491, duration: 302541000
2015-03-13 10:16:17,737 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742315_1491, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:17,737 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742315_1491{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:16:17,738 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job_1426266260362_0040_1.jhist is closed by DFSClient_NONMAPREDUCE_-151799678_1
2015-03-13 10:16:17,741 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0040.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:16:17,743 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0040.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742317_1493{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:16:17,745 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742317_1493 src: /127.0.0.1:64416 dest: /127.0.0.1:60686
2015-03-13 10:16:17,746 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742317_1493 src: /127.0.0.1:64417 dest: /127.0.0.1:60693
2015-03-13 10:16:17,747 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742317_1493 src: /127.0.0.1:64418 dest: /127.0.0.1:60689
2015-03-13 10:16:17,750 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64418, dest: /127.0.0.1:60689, bytes: 434, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-151799678_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742317_1493, duration: 1047000
2015-03-13 10:16:17,750 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742317_1493, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:16:17,750 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64417, dest: /127.0.0.1:60693, bytes: 434, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-151799678_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742317_1493, duration: 1611000
2015-03-13 10:16:17,750 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742317_1493{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:16:17,750 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742317_1493, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:17,751 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64416, dest: /127.0.0.1:60686, bytes: 434, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-151799678_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742317_1493, duration: 2320000
2015-03-13 10:16:17,751 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742317_1493, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:17,751 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742317_1493{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:16:17,752 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742317_1493{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:16:17,753 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0040.summary_tmp is closed by DFSClient_NONMAPREDUCE_-151799678_1
2015-03-13 10:16:17,756 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0040.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:16:17,761 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job_1426266260362_0040_1.jhist	dst=null	perm=null
2015-03-13 10:16:17,761 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0040-1426266962450-soberoi-%5B5AEBF4A4F39C4981A72307A2E47929FB%2F93F21464717B4FE5-1426266977720-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:16:17,765 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job_1426266260362_0040_1.jhist	dst=null	perm=null
2015-03-13 10:16:17,766 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0040-1426266962450-soberoi-%5B5AEBF4A4F39C4981A72307A2E47929FB%2F93F21464717B4FE5-1426266977720-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:16:17,766 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job_1426266260362_0040_1.jhist	dst=null	perm=null
2015-03-13 10:16:17,769 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0040-1426266962450-soberoi-%5B5AEBF4A4F39C4981A72307A2E47929FB%2F93F21464717B4FE5-1426266977720-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:16:17,771 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:64419, bytes: 53724, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-151799678_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742315_1491, duration: 189000
2015-03-13 10:16:17,772 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0040-1426266962450-soberoi-%5B5AEBF4A4F39C4981A72307A2E47929FB%2F93F21464717B4FE5-1426266977720-5-0-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742318_1494{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:16:17,774 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742318_1494 src: /127.0.0.1:64420 dest: /127.0.0.1:60693
2015-03-13 10:16:17,776 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742318_1494 src: /127.0.0.1:64421 dest: /127.0.0.1:60696
2015-03-13 10:16:17,777 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742318_1494 src: /127.0.0.1:64422 dest: /127.0.0.1:60689
2015-03-13 10:16:17,781 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64422, dest: /127.0.0.1:60689, bytes: 53304, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-151799678_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742318_1494, duration: 2721000
2015-03-13 10:16:17,781 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742318_1494, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:16:17,782 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742318_1494{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:16:17,782 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64421, dest: /127.0.0.1:60696, bytes: 53304, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-151799678_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742318_1494, duration: 3552000
2015-03-13 10:16:17,782 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742318_1494, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:17,782 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742318_1494{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:16:17,783 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64420, dest: /127.0.0.1:60693, bytes: 53304, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-151799678_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742318_1494, duration: 4132000
2015-03-13 10:16:17,783 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742318_1494, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:17,783 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742318_1494{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:16:17,785 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0040-1426266962450-soberoi-%5B5AEBF4A4F39C4981A72307A2E47929FB%2F93F21464717B4FE5-1426266977720-5-0-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-151799678_1
2015-03-13 10:16:17,786 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0040-1426266962450-soberoi-%5B5AEBF4A4F39C4981A72307A2E47929FB%2F93F21464717B4FE5-1426266977720-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:16:17,788 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job_1426266260362_0040_1_conf.xml	dst=null	perm=null
2015-03-13 10:16:17,789 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0040_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:16:17,790 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job_1426266260362_0040_1_conf.xml	dst=null	perm=null
2015-03-13 10:16:17,791 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0040_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:16:17,792 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040/job_1426266260362_0040_1_conf.xml	dst=null	perm=null
2015-03-13 10:16:17,794 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0040_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:16:17,799 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64423, bytes: 90293, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-151799678_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742311_1487, duration: 268000
2015-03-13 10:16:17,801 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0040_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742319_1495{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:16:17,802 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742319_1495 src: /127.0.0.1:64424 dest: /127.0.0.1:60693
2015-03-13 10:16:17,804 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742319_1495 src: /127.0.0.1:64425 dest: /127.0.0.1:60686
2015-03-13 10:16:17,805 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742319_1495 src: /127.0.0.1:64426 dest: /127.0.0.1:60696
2015-03-13 10:16:17,816 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64426, dest: /127.0.0.1:60696, bytes: 89593, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-151799678_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742319_1495, duration: 1567000
2015-03-13 10:16:17,817 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742319_1495, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:16:17,818 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742319_1495{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:16:17,818 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64425, dest: /127.0.0.1:60686, bytes: 89593, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-151799678_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742319_1495, duration: 3078000
2015-03-13 10:16:17,818 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742319_1495, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:17,819 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64424, dest: /127.0.0.1:60693, bytes: 89593, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-151799678_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742319_1495, duration: 3774000
2015-03-13 10:16:17,819 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742319_1495, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:17,819 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742319_1495{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:16:17,821 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742319_1495 size 89593
2015-03-13 10:16:17,821 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0040_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-151799678_1
2015-03-13 10:16:17,823 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0040_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:16:17,824 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0040.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0040.summary	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:16:17,826 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0040_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0040_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:16:17,829 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0040-1426266962450-soberoi-%5B5AEBF4A4F39C4981A72307A2E47929FB%2F93F21464717B4FE5-1426266977720-5-0-SUCCEEDED-default.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0040-1426266962450-soberoi-%5B5AEBF4A4F39C4981A72307A2E47929FB%2F93F21464717B4FE5-1426266977720-5-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:16:17,836 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0040_000001 State change from RUNNING to FINISHING
2015-03-13 10:16:17,836 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0040
2015-03-13 10:16:17,836 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0040 State change from RUNNING to REMOVING
2015-03-13 10:16:17,836 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0040
2015-03-13 10:16:17,836 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0040 State change from REMOVING to FINISHING
2015-03-13 10:16:18,174 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:18,419 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742317_1493
2015-03-13 10:16:18,420 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742315_1491
2015-03-13 10:16:18,420 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742313_1489
2015-03-13 10:16:18,421 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742319_1495
2015-03-13 10:16:18,421 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742316_1492
2015-03-13 10:16:18,421 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742312_1488
2015-03-13 10:16:18,421 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742314_1490
2015-03-13 10:16:18,567 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:16:18,567 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0040_01_000006
2015-03-13 10:16:18,567 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0040_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:16:18,567 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0040_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:16:18,568 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0040	CONTAINERID=container_1426266260362_0040_01_000006
2015-03-13 10:16:18,568 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0040_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:16:18,568 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:16:18,568 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0040_01_000006, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:18,568 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:18,568 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:16:18,568 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0040_000001 released container container_1426266260362_0040_01_000006 on node: host: 10.1.1.144:60719 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:16:18,664 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:16:18,664 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0040_01_000002
2015-03-13 10:16:18,664 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0040_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:16:18,664 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0040_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:16:18,664 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0040	CONTAINERID=container_1426266260362_0040_01_000002
2015-03-13 10:16:18,665 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0040_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:16:18,665 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:16:18,665 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0040_01_000002, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:18,665 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:18,665 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:16:18,665 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0040_000001 released container container_1426266260362_0040_01_000002 on node: host: 10.1.1.144:60715 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:16:18,690 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742314_1490
2015-03-13 10:16:18,691 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742319_1495
2015-03-13 10:16:18,692 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742315_1491
2015-03-13 10:16:18,692 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742312_1488
2015-03-13 10:16:18,692 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742318_1494
2015-03-13 10:16:18,693 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742317_1493
2015-03-13 10:16:18,693 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742316_1492
2015-03-13 10:16:18,848 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742307_1483 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60696 127.0.0.1:60693 
2015-03-13 10:16:18,848 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742308_1484 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60696 
2015-03-13 10:16:18,848 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742309_1485 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60689 
2015-03-13 10:16:18,849 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742310_1486 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60689 
2015-03-13 10:16:18,849 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742315_1491 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60693 
2015-03-13 10:16:18,849 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742311_1487 127.0.0.1:60689 127.0.0.1:60693 127.0.0.1:60686 
2015-03-13 10:16:18,849 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0040	dst=null	perm=null
2015-03-13 10:16:18,876 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe	dst=null	perm=null
2015-03-13 10:16:18,877 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/_temporary
2015-03-13 10:16:18,877 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/_temporary	dst=null	perm=null
2015-03-13 10:16:18,884 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:16:18,884 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:16:18,885 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:16:18,886 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe	dst=null	perm=null
2015-03-13 10:16:18,886 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe	dst=null	perm=null
2015-03-13 10:16:18,887 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe	dst=null	perm=null
2015-03-13 10:16:18,888 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:16:18,889 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/part-00000	dst=null	perm=null
2015-03-13 10:16:18,890 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:64428, bytes: 20, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742316_1492, duration: 184000
2015-03-13 10:16:18,891 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/part-00001	dst=null	perm=null
2015-03-13 10:16:18,893 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:64429, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742312_1488, duration: 172000
2015-03-13 10:16:18,893 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/part-00002	dst=null	perm=null
2015-03-13 10:16:18,895 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:64430, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742314_1490, duration: 179000
2015-03-13 10:16:18,895 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/part-00003	dst=null	perm=null
2015-03-13 10:16:18,897 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64431, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742313_1489, duration: 168000
2015-03-13 10:16:18,898 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/part-00004	dst=null	perm=null
2015-03-13 10:16:18,904 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:16:18,905 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:16:18,905 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:16:18,906 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe	dst=null	perm=null
2015-03-13 10:16:18,907 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe	dst=null	perm=null
2015-03-13 10:16:18,907 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe	dst=null	perm=null
2015-03-13 10:16:18,908 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:16:18,909 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/part-00000	dst=null	perm=null
2015-03-13 10:16:18,910 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:64429, bytes: 20, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742316_1492, duration: 191000
2015-03-13 10:16:18,911 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/part-00001	dst=null	perm=null
2015-03-13 10:16:18,911 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:64430, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742312_1488, duration: 133000
2015-03-13 10:16:18,912 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/part-00002	dst=null	perm=null
2015-03-13 10:16:18,913 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:64429, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742314_1490, duration: 168000
2015-03-13 10:16:18,913 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/part-00003	dst=null	perm=null
2015-03-13 10:16:18,914 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:64430, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742313_1489, duration: 150000
2015-03-13 10:16:18,915 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/part-00004	dst=null	perm=null
2015-03-13 10:16:18,915 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/samepipe
2015-03-13 10:16:18,916 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe	dst=null	perm=null
2015-03-13 10:16:18,916 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe	dst=null	perm=null
2015-03-13 10:16:18,917 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe	dst=null	perm=null
2015-03-13 10:16:18,917 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe	dst=null	perm=null
2015-03-13 10:16:18,918 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/part-00000	dst=null	perm=null
2015-03-13 10:16:18,919 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/part-00000	dst=null	perm=null
2015-03-13 10:16:18,920 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:64429, bytes: 20, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742316_1492, duration: 173000
2015-03-13 10:16:18,920 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/part-00001	dst=null	perm=null
2015-03-13 10:16:18,921 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/part-00001	dst=null	perm=null
2015-03-13 10:16:18,922 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:64429, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742312_1488, duration: 180000
2015-03-13 10:16:18,923 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/part-00002	dst=null	perm=null
2015-03-13 10:16:18,923 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/part-00002	dst=null	perm=null
2015-03-13 10:16:18,924 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:64430, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742314_1490, duration: 176000
2015-03-13 10:16:18,925 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/part-00003	dst=null	perm=null
2015-03-13 10:16:18,925 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/part-00003	dst=null	perm=null
2015-03-13 10:16:18,926 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:64430, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742313_1489, duration: 160000
2015-03-13 10:16:18,927 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/part-00004	dst=null	perm=null
2015-03-13 10:16:18,927 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipe/part-00004	dst=null	perm=null
2015-03-13 10:16:18,929 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs-sparse.txt	dst=null	perm=null
2015-03-13 10:16:18,930 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs-sparse.txt	dst=null	perm=null
2015-03-13 10:16:18,942 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:16:18,944 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:16:18,944 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:16:18,953 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter	dst=null	perm=null
2015-03-13 10:16:18,954 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting
2015-03-13 10:16:18,954 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  source: Hfs["TextDelimited[['num', 'char' | Integer, String]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs-sparse.txt"]
2015-03-13 10:16:18,954 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  source: Hfs["TextDelimited[['num', 'char' | Integer, String]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs-sparse.txt"]
2015-03-13 10:16:18,954 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  sink: Hfs["TextDelimited[[0:3]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter"]
2015-03-13 10:16:18,954 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  parallel execution is enabled: true
2015-03-13 10:16:18,954 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  starting jobs: 1
2015-03-13 10:16:18,954 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  allocating threads: 1
2015-03-13 10:16:18,957 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (1/1) ...esplatform/joininnerouter
2015-03-13 10:16:18,964 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:16:18,976 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:16:18,977 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter	dst=null	perm=null
2015-03-13 10:16:18,978 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:16:18,978 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:16:18,980 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 41
2015-03-13 10:16:18,981 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041	dst=null	perm=null
2015-03-13 10:16:18,982 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041	dst=null	perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:16:18,983 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041	dst=null	perm=soberoi:supergroup:rwx------
2015-03-13 10:16:18,983 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.jar	dst=null	perm=null
2015-03-13 10:16:18,985 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:16:18,986 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073742320_1496{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:16:18,987 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742320_1496 src: /127.0.0.1:64433 dest: /127.0.0.1:60686
2015-03-13 10:16:18,988 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742320_1496 src: /127.0.0.1:64434 dest: /127.0.0.1:60696
2015-03-13 10:16:18,989 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742320_1496 src: /127.0.0.1:64435 dest: /127.0.0.1:60693
2015-03-13 10:16:18,995 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64435, dest: /127.0.0.1:60693, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742320_1496, duration: 4476000
2015-03-13 10:16:18,995 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742320_1496, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:16:18,996 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742320_1496{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:16:18,996 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64434, dest: /127.0.0.1:60696, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742320_1496, duration: 2509000
2015-03-13 10:16:18,996 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742320_1496, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:18,996 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742320_1496{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:16:18,997 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64433, dest: /127.0.0.1:60686, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742320_1496, duration: 3539000
2015-03-13 10:16:18,997 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742320_1496, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:18,997 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742320_1496{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:16:18,998 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:16:18,998 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.jar
2015-03-13 10:16:18,999 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.jar	dst=null	perm=null
2015-03-13 10:16:18,999 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:16:19,000 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:16:19,001 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:16:19,001 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:16:19,002 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:16:19,002 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:16:19,003 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:16:19,003 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:16:19,004 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:16:19,004 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:16:19,005 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs-sparse.txt	dst=null	perm=null
2015-03-13 10:16:19,005 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:16:19,006 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs-sparse.txt	dst=null	perm=null
2015-03-13 10:16:19,007 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:16:19,008 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:16:19,009 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.split
2015-03-13 10:16:19,009 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.split	dst=null	perm=null
2015-03-13 10:16:19,010 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073742321_1497{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:16:19,011 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742321_1497 src: /127.0.0.1:64436 dest: /127.0.0.1:60693
2015-03-13 10:16:19,013 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742321_1497 src: /127.0.0.1:64437 dest: /127.0.0.1:60689
2015-03-13 10:16:19,014 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742321_1497 src: /127.0.0.1:64438 dest: /127.0.0.1:60686
2015-03-13 10:16:19,015 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742321_1497 src: /127.0.0.1:64439 dest: /127.0.0.1:60696
2015-03-13 10:16:19,017 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64439, dest: /127.0.0.1:60696, bytes: 1807, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742321_1497, duration: 1619000
2015-03-13 10:16:19,017 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742321_1497, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:16:19,018 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742321_1497{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:16:19,018 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64438, dest: /127.0.0.1:60686, bytes: 1807, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742321_1497, duration: 1981000
2015-03-13 10:16:19,018 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742321_1497, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:19,018 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742321_1497{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:16:19,019 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64437, dest: /127.0.0.1:60689, bytes: 1807, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742321_1497, duration: 2862000
2015-03-13 10:16:19,019 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742321_1497, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:19,019 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742321_1497{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:16:19,019 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64436, dest: /127.0.0.1:60693, bytes: 1807, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742321_1497, duration: 3222000
2015-03-13 10:16:19,019 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742321_1497, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:19,020 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742321_1497{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:16:19,021 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:16:19,022 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:16:19,024 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:16:19,025 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073742322_1498{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:16:19,026 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742322_1498 src: /127.0.0.1:64440 dest: /127.0.0.1:60686
2015-03-13 10:16:19,027 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742322_1498 src: /127.0.0.1:64441 dest: /127.0.0.1:60693
2015-03-13 10:16:19,029 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742322_1498 src: /127.0.0.1:64442 dest: /127.0.0.1:60689
2015-03-13 10:16:19,032 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64442, dest: /127.0.0.1:60689, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742322_1498, duration: 1101000
2015-03-13 10:16:19,032 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742322_1498, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:16:19,032 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742322_1498{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:16:19,032 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64441, dest: /127.0.0.1:60693, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742322_1498, duration: 1431000
2015-03-13 10:16:19,032 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742322_1498, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:19,033 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742322_1498{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:16:19,033 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64440, dest: /127.0.0.1:60686, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742322_1498, duration: 2204000
2015-03-13 10:16:19,033 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742322_1498, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:19,034 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742322_1498{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:16:19,035 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:16:19,035 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:16:19,036 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:16:19,038 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:16:19,039 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:16:19,039 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:16:19,040 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:16:19,044 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742323_1499{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:16:19,046 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742323_1499 src: /127.0.0.1:64443 dest: /127.0.0.1:60686
2015-03-13 10:16:19,047 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742323_1499 src: /127.0.0.1:64444 dest: /127.0.0.1:60696
2015-03-13 10:16:19,048 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742323_1499 src: /127.0.0.1:64445 dest: /127.0.0.1:60693
2015-03-13 10:16:19,050 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64445, dest: /127.0.0.1:60693, bytes: 98298, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742323_1499, duration: 1531000
2015-03-13 10:16:19,051 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742323_1499, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:16:19,051 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742323_1499{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:16:19,051 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64444, dest: /127.0.0.1:60696, bytes: 98298, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742323_1499, duration: 1870000
2015-03-13 10:16:19,051 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742323_1499, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:19,051 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742323_1499{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:16:19,052 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64443, dest: /127.0.0.1:60686, bytes: 98298, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742323_1499, duration: 2589000
2015-03-13 10:16:19,052 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742323_1499, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:19,052 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742323_1499{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:16:19,053 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:16:19,053 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0041
2015-03-13 10:16:19,054 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041	dst=null	perm=null
2015-03-13 10:16:19,054 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.xml	dst=null	perm=null
2015-03-13 10:16:19,055 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.xml	dst=null	perm=null
2015-03-13 10:16:19,055 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.jar	dst=null	perm=null
2015-03-13 10:16:19,056 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.jar	dst=null	perm=null
2015-03-13 10:16:19,056 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.split	dst=null	perm=null
2015-03-13 10:16:19,057 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.split	dst=null	perm=null
2015-03-13 10:16:19,057 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:16:19,058 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:16:19,059 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:16:19,060 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:16:19,060 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:16:19,061 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:16:19,061 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:16:19,062 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:16:19,063 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 41 submitted by user soberoi
2015-03-13 10:16:19,063 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0041
2015-03-13 10:16:19,063 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	IP=10.1.1.144	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1426266260362_0041
2015-03-13 10:16:19,063 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0041
2015-03-13 10:16:19,063 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0041 State change from NEW to NEW_SAVING
2015-03-13 10:16:19,063 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0041 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:16:19,063 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0041_000001
2015-03-13 10:16:19,063 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0041_000001 State change from NEW to SUBMITTED
2015-03-13 10:16:19,064 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0041 from user: soberoi activated in queue: default
2015-03-13 10:16:19,064 INFO  capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0041 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:16:19,064 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0041 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:16:19,064 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0041 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:16:19,064 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0041_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:16:19,064 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0041_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:16:19,069 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0041 State change from SUBMITTED to ACCEPTED
2015-03-13 10:16:19,071 INFO  mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0041/
2015-03-13 10:16:19,071 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1426266260362_0041
2015-03-13 10:16:19,071 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0041/
2015-03-13 10:16:19,175 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:19,176 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0041_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:16:19,176 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0041	CONTAINERID=container_1426266260362_0041_01_000001
2015-03-13 10:16:19,177 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0041_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:4096, vCores:2> used and <memory:0, vCores:6> available
2015-03-13 10:16:19,177 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0041 container=Container: [ContainerId: container_1426266260362_0041_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0041_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:19,177 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:16:19,177 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0041_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:16:19,177 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:19,180 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0041 AttemptId: appattempt_1426266260362_0041_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0041_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ]
2015-03-13 10:16:19,180 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0041_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:16:19,180 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0041_000001
2015-03-13 10:16:19,180 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0041_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:16:19,180 INFO  amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0041_000001
2015-03-13 10:16:19,181 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0041_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] for AM appattempt_1426266260362_0041_000001
2015-03-13 10:16:19,181 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0041_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-03-13 10:16:19,184 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0041_000001 (auth:SIMPLE)
2015-03-13 10:16:19,185 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0041_01_000001 by user soberoi
2015-03-13 10:16:19,185 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0041
2015-03-13 10:16:19,185 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0041	CONTAINERID=container_1426266260362_0041_01_000001
2015-03-13 10:16:19,185 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0041 transitioned from NEW to INITING
2015-03-13 10:16:19,185 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0041_01_000001 to application application_1426266260362_0041
2015-03-13 10:16:19,186 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0041 transitioned from INITING to RUNNING
2015-03-13 10:16:19,186 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0041_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] for AM appattempt_1426266260362_0041_000001
2015-03-13 10:16:19,186 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0041_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:16:19,186 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0041_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:16:19,186 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0041
2015-03-13 10:16:19,186 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:16:19,186 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:16:19,186 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:16:19,186 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:16:19,187 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0041_01_000001
2015-03-13 10:16:19,203 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0041_01_000001.tokens. Credentials list: 
2015-03-13 10:16:19,218 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:16:19,291 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0041_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0041/container_1426266260362_0041_01_000001.tokens
2015-03-13 10:16:19,291 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0041 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0041
2015-03-13 10:16:19,320 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60696 to replicate blk_1073742320_1496 to datanode(s) 127.0.0.1:60689
2015-03-13 10:16:19,320 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073742307_1483, blk_1073742308_1484, blk_1073742309_1485, blk_1073742311_1487, blk_1073742315_1491]
2015-03-13 10:16:19,321 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073742307_1483, blk_1073742308_1484, blk_1073742309_1485, blk_1073742310_1486, blk_1073742311_1487, blk_1073742315_1491]
2015-03-13 10:16:19,350 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.jar	dst=null	perm=null
2015-03-13 10:16:19,351 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.jar	dst=null	perm=null
2015-03-13 10:16:19,352 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.jar	dst=null	perm=null
2015-03-13 10:16:19,358 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64431, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_998637880_22103, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742320_1496, duration: 481000
2015-03-13 10:16:19,379 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:16:19,396 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:16:19,396 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:16:19,397 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:16:19,403 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64431, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_998637880_22103, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742322_1498, duration: 123000
2015-03-13 10:16:19,415 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:16:19,428 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742321_1497
2015-03-13 10:16:19,428 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742316_1492
2015-03-13 10:16:19,429 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742323_1499
2015-03-13 10:16:19,429 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742313_1489
2015-03-13 10:16:19,430 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742319_1495
2015-03-13 10:16:19,430 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742318_1494
2015-03-13 10:16:19,436 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.split	dst=null	perm=null
2015-03-13 10:16:19,436 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.split	dst=null	perm=null
2015-03-13 10:16:19,437 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.split	dst=null	perm=null
2015-03-13 10:16:19,443 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64431, bytes: 1823, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_998637880_22103, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742321_1497, duration: 190000
2015-03-13 10:16:19,455 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:16:19,472 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.xml	dst=null	perm=null
2015-03-13 10:16:19,472 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.xml	dst=null	perm=null
2015-03-13 10:16:19,473 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.xml	dst=null	perm=null
2015-03-13 10:16:19,479 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64431, bytes: 99066, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_998637880_22103, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742323_1499, duration: 312000
2015-03-13 10:16:19,491 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:16:19,491 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0041_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:16:19,516 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0041_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:16:19,516 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:16:19,584 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0041/container_1426266260362_0041_01_000001/default_container_executor.sh]
2015-03-13 10:16:19,813 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742307_1483 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir2/blk_1073742307 for deletion
2015-03-13 10:16:19,813 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742308_1484 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir57/blk_1073742308 for deletion
2015-03-13 10:16:19,813 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742309_1485 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir2/blk_1073742309 for deletion
2015-03-13 10:16:19,813 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742310_1486 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir57/blk_1073742310 for deletion
2015-03-13 10:16:19,813 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742311_1487 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir2/blk_1073742311 for deletion
2015-03-13 10:16:19,813 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742308_1484 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir57/blk_1073742308
2015-03-13 10:16:19,813 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742315_1491 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir57/blk_1073742315 for deletion
2015-03-13 10:16:19,813 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742307_1483 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir2/blk_1073742307
2015-03-13 10:16:19,813 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742310_1486 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir57/blk_1073742310
2015-03-13 10:16:19,814 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742309_1485 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir2/blk_1073742309
2015-03-13 10:16:19,814 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742315_1491 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir57/blk_1073742315
2015-03-13 10:16:19,814 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742311_1487 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir2/blk_1073742311
2015-03-13 10:16:19,829 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742320_1496
2015-03-13 10:16:19,836 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742307_1483 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742307 for deletion
2015-03-13 10:16:19,836 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742308_1484 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742308 for deletion
2015-03-13 10:16:19,836 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742309_1485 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742309 for deletion
2015-03-13 10:16:19,836 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742311_1487 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742311 for deletion
2015-03-13 10:16:19,836 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742315_1491 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742315 for deletion
2015-03-13 10:16:19,836 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742307_1483 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742307
2015-03-13 10:16:19,836 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742308_1484 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742308
2015-03-13 10:16:19,837 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742309_1485 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742309
2015-03-13 10:16:19,837 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742311_1487 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742311
2015-03-13 10:16:19,837 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742315_1491 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742315
2015-03-13 10:16:20,176 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:20,176 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:20,176 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0041_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:16:20,251 INFO  datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-318492837-10.1.1.144-60696-1426266259571, infoPort=60697, ipcPort=60698, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073742320_1496 to 127.0.0.1:60689 
2015-03-13 10:16:20,252 INFO  datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073742320_1496 (numBytes=254067) to /127.0.0.1:60689
2015-03-13 10:16:20,252 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742320_1496 src: /127.0.0.1:64449 dest: /127.0.0.1:60689
2015-03-13 10:16:20,253 INFO  datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073742320_1496 src: /127.0.0.1:64449 dest: /127.0.0.1:60689 of size 254067
2015-03-13 10:16:20,254 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742320_1496 size 254067
2015-03-13 10:16:21,133 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:16:21,153 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/COMMIT_STARTED	dst=null	perm=null
2015-03-13 10:16:21,154 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/COMMIT_SUCCESS	dst=null	perm=null
2015-03-13 10:16:21,155 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/COMMIT_FAIL	dst=null	perm=null
2015-03-13 10:16:21,179 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:21,179 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:21,207 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041	dst=null	perm=null
2015-03-13 10:16:21,208 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:16:21,209 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:16:21,480 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:16:21,486 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:16:21,544 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:64451, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-483536161_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742322_1498, duration: 129000
2015-03-13 10:16:22,180 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:22,180 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:22,323 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073742307_1483, blk_1073742308_1484, blk_1073742309_1485, blk_1073742310_1486, blk_1073742311_1487, blk_1073742315_1491]
2015-03-13 10:16:22,323 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073742307_1483, blk_1073742308_1484, blk_1073742310_1486]
2015-03-13 10:16:22,331 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0041_000001 (auth:SIMPLE)
2015-03-13 10:16:22,333 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0041_000001
2015-03-13 10:16:22,333 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi	IP=10.1.1.144	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1426266260362_0041	APPATTEMPTID=appattempt_1426266260362_0041_000001
2015-03-13 10:16:22,333 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0041_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:16:22,333 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0041 State change from ACCEPTED to RUNNING
2015-03-13 10:16:22,356 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job_1426266260362_0041_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:16:22,368 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:16:22,444 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job_1426266260362_0041_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:16:22,481 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742318_1494
2015-03-13 10:16:22,482 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742321_1497
2015-03-13 10:16:22,482 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742317_1493
2015-03-13 10:16:22,484 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742320_1496
2015-03-13 10:16:22,484 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742322_1498
2015-03-13 10:16:22,484 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742314_1490
2015-03-13 10:16:22,582 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job_1426266260362_0041_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742324_1500{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:16:22,623 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742324_1500 src: /127.0.0.1:64457 dest: /127.0.0.1:60696
2015-03-13 10:16:22,624 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742324_1500 src: /127.0.0.1:64458 dest: /127.0.0.1:60693
2015-03-13 10:16:22,627 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742324_1500 src: /127.0.0.1:64459 dest: /127.0.0.1:60689
2015-03-13 10:16:22,637 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64459, dest: /127.0.0.1:60689, bytes: 91099, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-483536161_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742324_1500, duration: 7303000
2015-03-13 10:16:22,637 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742324_1500, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:16:22,638 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64458, dest: /127.0.0.1:60693, bytes: 91099, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-483536161_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742324_1500, duration: 7452000
2015-03-13 10:16:22,638 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742324_1500{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:16:22,638 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742324_1500, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:22,639 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64457, dest: /127.0.0.1:60696, bytes: 91099, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-483536161_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742324_1500, duration: 8630000
2015-03-13 10:16:22,639 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742324_1500, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:22,639 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742324_1500{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:16:22,640 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742324_1500{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:16:22,644 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job_1426266260362_0041_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-483536161_1
2015-03-13 10:16:23,032 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742307_1483 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir30/blk_1073742307 for deletion
2015-03-13 10:16:23,032 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742308_1484 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir56/blk_1073742308 for deletion
2015-03-13 10:16:23,033 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742309_1485 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir30/blk_1073742309 for deletion
2015-03-13 10:16:23,033 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742310_1486 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir56/blk_1073742310 for deletion
2015-03-13 10:16:23,033 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742311_1487 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir56/blk_1073742311 for deletion
2015-03-13 10:16:23,033 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742315_1491 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir56/blk_1073742315 for deletion
2015-03-13 10:16:23,033 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742307_1483 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir30/blk_1073742307
2015-03-13 10:16:23,033 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742308_1484 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir56/blk_1073742308
2015-03-13 10:16:23,033 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742309_1485 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir30/blk_1073742309
2015-03-13 10:16:23,033 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742310_1486 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir56/blk_1073742310
2015-03-13 10:16:23,034 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742311_1487 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir56/blk_1073742311
2015-03-13 10:16:23,034 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742315_1491 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir56/blk_1073742315
2015-03-13 10:16:23,182 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:23,183 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:23,252 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742307_1483 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742307 for deletion
2015-03-13 10:16:23,252 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742308_1484 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir39/blk_1073742308 for deletion
2015-03-13 10:16:23,253 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742310_1486 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742310 for deletion
2015-03-13 10:16:23,253 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742307_1483 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742307
2015-03-13 10:16:23,253 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742308_1484 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir39/blk_1073742308
2015-03-13 10:16:23,253 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742310_1486 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742310
2015-03-13 10:16:23,428 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742322_1498
2015-03-13 10:16:23,428 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742321_1497
2015-03-13 10:16:23,430 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742320_1496
2015-03-13 10:16:23,586 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0041_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:16:23,586 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0041	CONTAINERID=container_1426266260362_0041_01_000002
2015-03-13 10:16:23,586 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0041_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:16:23,587 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0041 container=Container: [ContainerId: container_1426266260362_0041_01_000002, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0041_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:23,587 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:16:23,587 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:23,587 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0041_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:16:23,587 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0041	CONTAINERID=container_1426266260362_0041_01_000003
2015-03-13 10:16:23,588 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0041_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:16:23,588 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0041 container=Container: [ContainerId: container_1426266260362_0041_01_000003, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0041_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:23,588 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:16:23,588 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:23,589 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0041_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:16:23,589 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0041	CONTAINERID=container_1426266260362_0041_01_000004
2015-03-13 10:16:23,589 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0041_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:16:23,589 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0041 container=Container: [ContainerId: container_1426266260362_0041_01_000004, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0041_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:23,589 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:16:23,590 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:23,590 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0041_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:16:23,590 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0041	CONTAINERID=container_1426266260362_0041_01_000005
2015-03-13 10:16:23,590 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0041_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:16:23,590 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0041 container=Container: [ContainerId: container_1426266260362_0041_01_000005, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0041_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:23,590 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:16:23,590 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:23,635 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742323_1499
2015-03-13 10:16:23,673 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0041_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:16:23,673 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0041	CONTAINERID=container_1426266260362_0041_01_000006
2015-03-13 10:16:23,673 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0041_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:16:23,673 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0041 container=Container: [ContainerId: container_1426266260362_0041_01_000006, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0041_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:23,673 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7
2015-03-13 10:16:23,673 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:23,699 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742323_1499
2015-03-13 10:16:23,700 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742324_1500
2015-03-13 10:16:23,700 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742322_1498
2015-03-13 10:16:23,701 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742321_1497
2015-03-13 10:16:23,981 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0040_01_000001 succeeded 
2015-03-13 10:16:23,982 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0040_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:16:23,982 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0040_01_000001
2015-03-13 10:16:23,988 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0040/container_1426266260362_0040_01_000001
2015-03-13 10:16:23,989 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0040/container_1426266260362_0040_01_000001
2015-03-13 10:16:23,989 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0040/container_1426266260362_0040_01_000001
2015-03-13 10:16:23,989 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0040/container_1426266260362_0040_01_000001
2015-03-13 10:16:23,989 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0040	CONTAINERID=container_1426266260362_0040_01_000001
2015-03-13 10:16:23,989 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0040_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:16:23,989 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0040_01_000001 from application application_1426266260362_0040
2015-03-13 10:16:23,989 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:16:23,990 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0040
2015-03-13 10:16:24,104 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742320_1496
2015-03-13 10:16:24,185 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 40 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:16:24,185 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0040_01_000001
2015-03-13 10:16:24,185 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:24,186 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0040_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:16:24,186 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0040_000001
2015-03-13 10:16:24,186 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0040_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:16:24,186 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0040_000001 State change from FINISHING to FINISHED
2015-03-13 10:16:24,186 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0040	CONTAINERID=container_1426266260362_0040_01_000001
2015-03-13 10:16:24,187 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0040 State change from FINISHING to FINISHED
2015-03-13 10:16:24,187 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0040_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:16:24,187 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:7168, vCores:6> numContainers=6 user=soberoi user-resources=<memory:7168, vCores:6>
2015-03-13 10:16:24,187 INFO  amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0040_000001
2015-03-13 10:16:24,187 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0040_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:24,187 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:24,187 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6
2015-03-13 10:16:24,187 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1426266260362_0040
2015-03-13 10:16:24,188 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0040_000001 released container container_1426266260362_0040_01_000001 on node: host: 10.1.1.144:60711 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:16:24,188 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0040,name=[5AEBF4A4F39C4981A72307A2E47929FB/93F21464717B4FE5B4F0DD3DD04467D7] lower/(1/1) ...dedpipesplatform/samepipe,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0040/jobhistory/job/job_1426266260362_0040,appMasterHost=Edinburgh.local,startTime=1426266962450,finishTime=1426266977836,finalStatus=SUCCEEDED
2015-03-13 10:16:24,188 INFO  capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0040_000001 is done. finalState=FINISHED
2015-03-13 10:16:24,188 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0040 requests cleared
2015-03-13 10:16:24,188 INFO  capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0040 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:16:24,188 INFO  capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0040 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:16:24,190 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0040_000001 (auth:SIMPLE)
2015-03-13 10:16:24,191 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0040_01_000001
2015-03-13 10:16:24,368 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0041_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:16:24,368 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0041_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:16:24,368 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0041_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:16:24,368 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0041_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:16:24,369 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0041_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:16:24,398 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.jar	dst=null	perm=null
2015-03-13 10:16:24,399 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.jar	dst=null	perm=null
2015-03-13 10:16:24,407 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.xml	dst=null	perm=null
2015-03-13 10:16:24,408 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.xml	dst=null	perm=null
2015-03-13 10:16:24,411 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:16:24,412 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:16:24,416 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:16:24,418 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:16:24,419 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:16:24,420 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:16:24,477 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0041_000001 (auth:SIMPLE)
2015-03-13 10:16:24,477 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0041_000001 (auth:SIMPLE)
2015-03-13 10:16:24,480 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0041_01_000002 by user soberoi
2015-03-13 10:16:24,480 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0041_01_000004 by user soberoi
2015-03-13 10:16:24,480 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0041
2015-03-13 10:16:24,480 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0041	CONTAINERID=container_1426266260362_0041_01_000004
2015-03-13 10:16:24,481 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0041_01_000005 by user soberoi
2015-03-13 10:16:24,480 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0041_01_000006 by user soberoi
2015-03-13 10:16:24,481 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0041_01_000003 by user soberoi
2015-03-13 10:16:24,481 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0041
2015-03-13 10:16:24,481 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0041	CONTAINERID=container_1426266260362_0041_01_000003
2015-03-13 10:16:24,481 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0041 transitioned from NEW to INITING
2015-03-13 10:16:24,481 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0041	CONTAINERID=container_1426266260362_0041_01_000005
2015-03-13 10:16:24,481 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0041_01_000004 to application application_1426266260362_0041
2015-03-13 10:16:24,480 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0041	CONTAINERID=container_1426266260362_0041_01_000002
2015-03-13 10:16:24,481 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0041 transitioned from NEW to INITING
2015-03-13 10:16:24,482 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0041_01_000002 to application application_1426266260362_0041
2015-03-13 10:16:24,482 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0041_01_000005 to application application_1426266260362_0041
2015-03-13 10:16:24,482 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0041_01_000003 to application application_1426266260362_0041
2015-03-13 10:16:24,482 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0041 transitioned from INITING to RUNNING
2015-03-13 10:16:24,481 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0041_01_000006 to application application_1426266260362_0041
2015-03-13 10:16:24,482 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0041_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:16:24,482 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0041 transitioned from INITING to RUNNING
2015-03-13 10:16:24,481 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0041	CONTAINERID=container_1426266260362_0041_01_000006
2015-03-13 10:16:24,482 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0041_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:16:24,483 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0041_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:16:24,483 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0041
2015-03-13 10:16:24,483 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0041
2015-03-13 10:16:24,483 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:16:24,483 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0041_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:16:24,483 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0041
2015-03-13 10:16:24,483 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0041_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:16:24,483 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:16:24,483 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:16:24,483 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0041
2015-03-13 10:16:24,483 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0041
2015-03-13 10:16:24,483 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0041_01_000006
2015-03-13 10:16:24,483 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:16:24,484 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0041
2015-03-13 10:16:24,484 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:16:24,484 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:16:24,484 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0041
2015-03-13 10:16:24,484 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0041
2015-03-13 10:16:24,484 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:16:24,484 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0041
2015-03-13 10:16:24,484 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0041
2015-03-13 10:16:24,485 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0041
2015-03-13 10:16:24,485 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:16:24,485 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0041
2015-03-13 10:16:24,485 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0041
2015-03-13 10:16:24,485 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0041
2015-03-13 10:16:24,485 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:16:24,485 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0041
2015-03-13 10:16:24,485 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0041_01_000004
2015-03-13 10:16:24,486 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0041_01_000005
2015-03-13 10:16:24,486 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0041_01_000003
2015-03-13 10:16:24,487 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0041_01_000002
2015-03-13 10:16:24,506 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1426266260362_0041_01_000005.tokens. Credentials list: 
2015-03-13 10:16:24,506 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426266260362_0041_01_000006.tokens. Credentials list: 
2015-03-13 10:16:24,506 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0041_01_000002.tokens. Credentials list: 
2015-03-13 10:16:24,507 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426266260362_0041_01_000004.tokens. Credentials list: 
2015-03-13 10:16:24,507 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0041_01_000003.tokens. Credentials list: 
2015-03-13 10:16:24,526 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:16:24,526 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:16:24,588 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:24,588 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:24,588 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:24,589 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:24,589 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0040 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:16:24,589 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0041_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:16:24,589 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0041_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:16:24,589 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0041_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:16:24,589 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0041_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:16:24,589 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0040
2015-03-13 10:16:24,589 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0040 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:16:24,589 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0040, with delay of 10800 seconds
2015-03-13 10:16:24,590 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0040
2015-03-13 10:16:24,589 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0040
2015-03-13 10:16:24,590 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0040
2015-03-13 10:16:24,590 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0040
2015-03-13 10:16:24,605 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1426266260362_0041_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0041/container_1426266260362_0041_01_000005.tokens
2015-03-13 10:16:24,605 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426266260362_0041_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0041/container_1426266260362_0041_01_000006.tokens
2015-03-13 10:16:24,606 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0041 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0041
2015-03-13 10:16:24,606 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0041 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0041
2015-03-13 10:16:24,675 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:24,675 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.jar	dst=null	perm=null
2015-03-13 10:16:24,676 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.jar	dst=null	perm=null
2015-03-13 10:16:24,676 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0040 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:16:24,676 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0041_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:16:24,676 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0040
2015-03-13 10:16:24,676 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0040 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:16:24,677 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0040, with delay of 10800 seconds
2015-03-13 10:16:24,677 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.jar	dst=null	perm=null
2015-03-13 10:16:24,676 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0040
2015-03-13 10:16:24,677 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0040
2015-03-13 10:16:24,677 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0040
2015-03-13 10:16:24,677 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0040
2015-03-13 10:16:24,677 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.jar	dst=null	perm=null
2015-03-13 10:16:24,678 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.jar	dst=null	perm=null
2015-03-13 10:16:24,678 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.jar	dst=null	perm=null
2015-03-13 10:16:24,685 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:64467, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1958403228_22248, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742320_1496, duration: 517000
2015-03-13 10:16:24,686 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:64468, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_155181223_22249, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742320_1496, duration: 447000
2015-03-13 10:16:24,707 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:16:24,707 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:16:24,726 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.xml	dst=null	perm=null
2015-03-13 10:16:24,726 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.xml	dst=null	perm=null
2015-03-13 10:16:24,726 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.xml	dst=null	perm=null
2015-03-13 10:16:24,726 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.xml	dst=null	perm=null
2015-03-13 10:16:24,727 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.xml	dst=null	perm=null
2015-03-13 10:16:24,727 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.xml	dst=null	perm=null
2015-03-13 10:16:24,733 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:64468, bytes: 99066, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1958403228_22248, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742323_1499, duration: 229000
2015-03-13 10:16:24,734 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64469, bytes: 99066, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_155181223_22249, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742323_1499, duration: 267000
2015-03-13 10:16:24,747 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:16:24,748 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0041_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:16:24,747 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0041_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:16:24,748 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0041_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:16:24,748 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0041_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:16:24,748 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0041_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:16:24,747 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:16:24,796 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0041_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:16:24,797 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:16:24,808 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0041_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:16:24,809 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:16:24,809 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0041_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:16:24,809 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:16:24,809 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0041_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:16:24,809 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:16:24,810 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0041_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:16:24,810 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:16:24,834 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742324_1500
2015-03-13 10:16:24,934 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0041/container_1426266260362_0041_01_000004/default_container_executor.sh]
2015-03-13 10:16:24,941 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0041/container_1426266260362_0041_01_000003/default_container_executor.sh]
2015-03-13 10:16:24,941 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0041/container_1426266260362_0041_01_000006/default_container_executor.sh]
2015-03-13 10:16:24,965 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0041/container_1426266260362_0041_01_000002/default_container_executor.sh]
2015-03-13 10:16:24,971 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0041/container_1426266260362_0041_01_000005/default_container_executor.sh]
2015-03-13 10:16:25,186 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:25,186 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0040 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:16:25,187 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0040
2015-03-13 10:16:25,187 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0040
2015-03-13 10:16:25,187 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0040
2015-03-13 10:16:25,187 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0040
2015-03-13 10:16:25,187 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0040 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:16:25,187 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0040, with delay of 10800 seconds
2015-03-13 10:16:25,187 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0040
2015-03-13 10:16:25,389 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:16:25,591 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:25,592 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:25,592 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:25,592 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:25,678 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:25,782 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:16:25,918 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0041_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0041/container_1426266260362_0041_01_000003.tokens
2015-03-13 10:16:25,919 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0041 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0041
2015-03-13 10:16:26,017 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:16:26,139 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426266260362_0041_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0041/container_1426266260362_0041_01_000004.tokens
2015-03-13 10:16:26,139 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0041 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0041
2015-03-13 10:16:26,187 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:26,262 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:16:26,389 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0041_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0041/container_1426266260362_0041_01_000002.tokens
2015-03-13 10:16:26,390 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0041 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0041
2015-03-13 10:16:26,597 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:26,597 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:26,597 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:26,598 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:26,682 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:26,703 INFO  hs.JobHistory (JobHistory.java:run(178)) - Starting scan to move intermediate done files
2015-03-13 10:16:26,703 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:16:26,704 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:16:26,707 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0031.summary	dst=null	perm=null
2015-03-13 10:16:26,707 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0033.summary	dst=null	perm=null
2015-03-13 10:16:26,707 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0032.summary	dst=null	perm=null
2015-03-13 10:16:26,709 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64474, bytes: 426, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742230_1406, duration: 155000
2015-03-13 10:16:26,709 INFO  jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0032,submitTime=1426266814304,launchTime=1426266817912,firstMapTaskLaunchTime=1426266820074,firstReduceTaskLaunchTime=0,finishTime=1426266829554,resourcesPerMap=1024,resourcesPerReduce=0,numMaps=5,numReduces=0,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=46,reduceSlotSeconds=0,jobName=[DBD09B24EEFF42C28C26CEA20C707FBA/BEF830D517EA448A98DAE15B6614864B] lower*upper/(1/1) ...edpipesplatform/joininner
2015-03-13 10:16:26,709 INFO  jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0033,submitTime=1426266830871,launchTime=1426266834387,firstMapTaskLaunchTime=1426266836556,firstReduceTaskLaunchTime=1426266848484,finishTime=1426266851026,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=5,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=47,reduceSlotSeconds=2,jobName=[2C202E1F11CB4F72A241D80B1FC5F547/2FBAD5263615431A999A5D504C8EA30E] lhs*rhs/(2/2)
2015-03-13 10:16:26,709 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0033.summary]
2015-03-13 10:16:26,709 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:64475, bytes: 458, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742206_1382, duration: 136000
2015-03-13 10:16:26,709 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:64473, bytes: 444, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742220_1396, duration: 155000
2015-03-13 10:16:26,709 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0032.summary]
2015-03-13 10:16:26,709 INFO  jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0031,submitTime=1426266790841,launchTime=1426266794187,firstMapTaskLaunchTime=1426266796340,firstReduceTaskLaunchTime=1426266810298,finishTime=1426266812972,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=6,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=67,reduceSlotSeconds=2,jobName=[362219F930134AB6824D0C362D17B53B/9DE4798541024E2FA2C199E3C3EC73F2] cogrouping/(1/1) ...platform/joinsintocogroup
2015-03-13 10:16:26,710 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0031.summary]
2015-03-13 10:16:26,711 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742230_1406 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60696 
2015-03-13 10:16:26,712 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0033.summary	dst=null	perm=null
2015-03-13 10:16:26,712 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742220_1396 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60689 
2015-03-13 10:16:26,712 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742206_1382 127.0.0.1:60689 127.0.0.1:60686 127.0.0.1:60693 
2015-03-13 10:16:26,712 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0032.summary	dst=null	perm=null
2015-03-13 10:16:26,713 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0031.summary	dst=null	perm=null
2015-03-13 10:16:26,714 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000	dst=null	perm=null
2015-03-13 10:16:26,714 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0033-1426266830871-soberoi-%5B2C202E1F11CB4F72A241D80B1FC5F547%2F2FBAD5263615431A-1426266851026-5-1-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0033-1426266830871-soberoi-%5B2C202E1F11CB4F72A241D80B1FC5F547%2F2FBAD5263615431A-1426266851026-5-1-SUCCEEDED-default.jhist
2015-03-13 10:16:26,714 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000	dst=null	perm=null
2015-03-13 10:16:26,714 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000	dst=null	perm=null
2015-03-13 10:16:26,715 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0031-1426266790841-soberoi-%5B362219F930134AB6824D0C362D17B53B%2F9DE4798541024E2F-1426266812972-6-1-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0031-1426266790841-soberoi-%5B362219F930134AB6824D0C362D17B53B%2F9DE4798541024E2F-1426266812972-6-1-SUCCEEDED-default.jhist
2015-03-13 10:16:26,715 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0032-1426266814304-soberoi-%5BDBD09B24EEFF42C28C26CEA20C707FBA%2FBEF830D517EA448A-1426266829554-5-0-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0032-1426266814304-soberoi-%5BDBD09B24EEFF42C28C26CEA20C707FBA%2FBEF830D517EA448A-1426266829554-5-0-SUCCEEDED-default.jhist
2015-03-13 10:16:26,716 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0033-1426266830871-soberoi-%5B2C202E1F11CB4F72A241D80B1FC5F547%2F2FBAD5263615431A-1426266851026-5-1-SUCCEEDED-default.jhist	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0033-1426266830871-soberoi-%5B2C202E1F11CB4F72A241D80B1FC5F547%2F2FBAD5263615431A-1426266851026-5-1-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:16:26,716 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0032-1426266814304-soberoi-%5BDBD09B24EEFF42C28C26CEA20C707FBA%2FBEF830D517EA448A-1426266829554-5-0-SUCCEEDED-default.jhist	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0032-1426266814304-soberoi-%5BDBD09B24EEFF42C28C26CEA20C707FBA%2FBEF830D517EA448A-1426266829554-5-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:16:26,716 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0033_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0033_conf.xml
2015-03-13 10:16:26,716 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0031-1426266790841-soberoi-%5B362219F930134AB6824D0C362D17B53B%2F9DE4798541024E2F-1426266812972-6-1-SUCCEEDED-default.jhist	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0031-1426266790841-soberoi-%5B362219F930134AB6824D0C362D17B53B%2F9DE4798541024E2F-1426266812972-6-1-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:16:26,716 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0032_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0032_conf.xml
2015-03-13 10:16:26,717 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0031_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0031_conf.xml
2015-03-13 10:16:26,717 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0033_conf.xml	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0033_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:16:26,717 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0031_conf.xml	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0031_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:16:26,717 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0032_conf.xml	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0032_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:16:26,718 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0034.summary	dst=null	perm=null
2015-03-13 10:16:26,718 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0035.summary	dst=null	perm=null
2015-03-13 10:16:26,718 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0036.summary	dst=null	perm=null
2015-03-13 10:16:26,719 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64474, bytes: 452, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742268_1444, duration: 167000
2015-03-13 10:16:26,719 INFO  jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0036,submitTime=1426266883457,launchTime=1426266887210,firstMapTaskLaunchTime=1426266889380,firstReduceTaskLaunchTime=1426266904327,finishTime=1426266906903,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=7,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=89,reduceSlotSeconds=2,jobName=[965FB86188914C2F858E802B0FA30893/02B21DDD5990483A85D5008DAA74B1FB] null/(1/2) ...JoinMergeGroupBy/hashjoin
2015-03-13 10:16:26,719 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0036.summary]
2015-03-13 10:16:26,720 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:64476, bytes: 440, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742243_1419, duration: 136000
2015-03-13 10:16:26,720 INFO  jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0034,submitTime=1426266852273,launchTime=1426266855496,firstMapTaskLaunchTime=1426266857663,firstReduceTaskLaunchTime=0,finishTime=1426266867317,resourcesPerMap=1024,resourcesPerReduce=0,numMaps=5,numReduces=0,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=47,reduceSlotSeconds=0,jobName=[2C202E1F11CB4F72A241D80B1FC5F547/EE2F3C2ED5D34A1D84F91DFB78AE0629] lhs*rhs/(1/2) ...orm/samepipearoundgroupby
2015-03-13 10:16:26,720 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0034.summary]
2015-03-13 10:16:26,720 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:64477, bytes: 408, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742258_1434, duration: 117000
2015-03-13 10:16:26,720 INFO  jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0035,submitTime=1426266868668,launchTime=1426266872301,firstMapTaskLaunchTime=1426266874470,firstReduceTaskLaunchTime=0,finishTime=1426266882201,resourcesPerMap=1024,resourcesPerReduce=0,numMaps=4,numReduces=0,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=30,reduceSlotSeconds=0,jobName=[965FB86188914C2F858E802B0FA30893/960BB94BC14B45F0A71D960D1EB660C1] null/(2/2)
2015-03-13 10:16:26,720 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0035.summary]
2015-03-13 10:16:26,720 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742268_1444 127.0.0.1:60693 127.0.0.1:60689 127.0.0.1:60686 
2015-03-13 10:16:26,720 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0036.summary	dst=null	perm=null
2015-03-13 10:16:26,721 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742243_1419 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60689 
2015-03-13 10:16:26,721 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0034.summary	dst=null	perm=null
2015-03-13 10:16:26,721 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742258_1434 127.0.0.1:60689 127.0.0.1:60686 127.0.0.1:60696 
2015-03-13 10:16:26,722 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0035.summary	dst=null	perm=null
2015-03-13 10:16:26,722 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000	dst=null	perm=null
2015-03-13 10:16:26,723 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000	dst=null	perm=null
2015-03-13 10:16:26,723 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0036-1426266883457-soberoi-%5B965FB86188914C2F858E802B0FA30893%2F02B21DDD5990483A-1426266906903-7-1-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0036-1426266883457-soberoi-%5B965FB86188914C2F858E802B0FA30893%2F02B21DDD5990483A-1426266906903-7-1-SUCCEEDED-default.jhist
2015-03-13 10:16:26,724 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000	dst=null	perm=null
2015-03-13 10:16:26,724 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0034-1426266852273-soberoi-%5B2C202E1F11CB4F72A241D80B1FC5F547%2FEE2F3C2ED5D34A1D-1426266867317-5-0-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0034-1426266852273-soberoi-%5B2C202E1F11CB4F72A241D80B1FC5F547%2FEE2F3C2ED5D34A1D-1426266867317-5-0-SUCCEEDED-default.jhist
2015-03-13 10:16:26,724 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0035-1426266868668-soberoi-%5B965FB86188914C2F858E802B0FA30893%2F960BB94BC14B45F0-1426266882201-4-0-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0035-1426266868668-soberoi-%5B965FB86188914C2F858E802B0FA30893%2F960BB94BC14B45F0-1426266882201-4-0-SUCCEEDED-default.jhist
2015-03-13 10:16:26,725 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0036-1426266883457-soberoi-%5B965FB86188914C2F858E802B0FA30893%2F02B21DDD5990483A-1426266906903-7-1-SUCCEEDED-default.jhist	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0036-1426266883457-soberoi-%5B965FB86188914C2F858E802B0FA30893%2F02B21DDD5990483A-1426266906903-7-1-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:16:26,725 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0036_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0036_conf.xml
2015-03-13 10:16:26,725 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0035-1426266868668-soberoi-%5B965FB86188914C2F858E802B0FA30893%2F960BB94BC14B45F0-1426266882201-4-0-SUCCEEDED-default.jhist	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0035-1426266868668-soberoi-%5B965FB86188914C2F858E802B0FA30893%2F960BB94BC14B45F0-1426266882201-4-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:16:26,725 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0034-1426266852273-soberoi-%5B2C202E1F11CB4F72A241D80B1FC5F547%2FEE2F3C2ED5D34A1D-1426266867317-5-0-SUCCEEDED-default.jhist	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0034-1426266852273-soberoi-%5B2C202E1F11CB4F72A241D80B1FC5F547%2FEE2F3C2ED5D34A1D-1426266867317-5-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:16:26,725 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0035_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0035_conf.xml
2015-03-13 10:16:26,725 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0034_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0034_conf.xml
2015-03-13 10:16:26,726 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0036_conf.xml	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0036_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:16:26,726 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0035_conf.xml	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0035_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:16:26,726 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0034_conf.xml	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0034_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:16:26,726 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0037.summary	dst=null	perm=null
2015-03-13 10:16:26,726 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0038.summary	dst=null	perm=null
2015-03-13 10:16:26,727 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0039.summary	dst=null	perm=null
2015-03-13 10:16:26,727 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64474, bytes: 438, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742281_1457, duration: 140000
2015-03-13 10:16:26,727 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:64473, bytes: 459, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742304_1480, duration: 126000
2015-03-13 10:16:26,727 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:64475, bytes: 436, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742294_1470, duration: 168000
2015-03-13 10:16:26,728 INFO  jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0038,submitTime=1426266924582,launchTime=1426266928067,firstMapTaskLaunchTime=1426266930230,firstReduceTaskLaunchTime=0,finishTime=1426266939781,resourcesPerMap=1024,resourcesPerReduce=0,numMaps=5,numReduces=0,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=46,reduceSlotSeconds=0,jobName=[FC79050368284AF1AC994EB228EC647C/242AE46A7EE3460A8532FA8CFD175492] lhs/(1/1) ...edpipesplatform/samepipe3
2015-03-13 10:16:26,728 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0038.summary]
2015-03-13 10:16:26,728 INFO  jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0037,submitTime=1426266908181,launchTime=1426266911327,firstMapTaskLaunchTime=1426266913489,firstReduceTaskLaunchTime=0,finishTime=1426266923264,resourcesPerMap=1024,resourcesPerReduce=0,numMaps=5,numReduces=0,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=47,reduceSlotSeconds=0,jobName=[60EF8DB99DB643778E218C05CBD6D765/03EFE4BB2CF14F0FB64A6222933EBA4B] lower/(1/1) ...edpipesplatform/samepipe2
2015-03-13 10:16:26,728 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0037.summary]
2015-03-13 10:16:26,728 INFO  jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0039,submitTime=1426266941114,launchTime=1426266944499,firstMapTaskLaunchTime=1426266946651,firstReduceTaskLaunchTime=1426266958584,finishTime=1426266961154,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=5,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=47,reduceSlotSeconds=2,jobName=[FA8781853FB04941B8AA098B1F63BAFB/18DEFF8DBE63483784F9BD9728EB5657] lower*upper/(1/1) ...pipesplatform/joingroupby
2015-03-13 10:16:26,728 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0039.summary]
2015-03-13 10:16:26,729 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742294_1470 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60689 
2015-03-13 10:16:26,729 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0038.summary	dst=null	perm=null
2015-03-13 10:16:26,729 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742304_1480 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60686 
2015-03-13 10:16:26,729 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0039.summary	dst=null	perm=null
2015-03-13 10:16:26,729 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742281_1457 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60693 
2015-03-13 10:16:26,730 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0037.summary	dst=null	perm=null
2015-03-13 10:16:26,731 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000	dst=null	perm=null
2015-03-13 10:16:26,734 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000	dst=null	perm=null
2015-03-13 10:16:26,734 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000	dst=null	perm=null
2015-03-13 10:16:26,734 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0039-1426266941114-soberoi-%5BFA8781853FB04941B8AA098B1F63BAFB%2F18DEFF8DBE634837-1426266961154-5-1-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0039-1426266941114-soberoi-%5BFA8781853FB04941B8AA098B1F63BAFB%2F18DEFF8DBE634837-1426266961154-5-1-SUCCEEDED-default.jhist
2015-03-13 10:16:26,734 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0038-1426266924582-soberoi-%5BFC79050368284AF1AC994EB228EC647C%2F242AE46A7EE3460A-1426266939781-5-0-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0038-1426266924582-soberoi-%5BFC79050368284AF1AC994EB228EC647C%2F242AE46A7EE3460A-1426266939781-5-0-SUCCEEDED-default.jhist
2015-03-13 10:16:26,735 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0037-1426266908181-soberoi-%5B60EF8DB99DB643778E218C05CBD6D765%2F03EFE4BB2CF14F0F-1426266923264-5-0-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0037-1426266908181-soberoi-%5B60EF8DB99DB643778E218C05CBD6D765%2F03EFE4BB2CF14F0F-1426266923264-5-0-SUCCEEDED-default.jhist
2015-03-13 10:16:26,736 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0039-1426266941114-soberoi-%5BFA8781853FB04941B8AA098B1F63BAFB%2F18DEFF8DBE634837-1426266961154-5-1-SUCCEEDED-default.jhist	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0039-1426266941114-soberoi-%5BFA8781853FB04941B8AA098B1F63BAFB%2F18DEFF8DBE634837-1426266961154-5-1-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:16:26,736 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0038-1426266924582-soberoi-%5BFC79050368284AF1AC994EB228EC647C%2F242AE46A7EE3460A-1426266939781-5-0-SUCCEEDED-default.jhist	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0038-1426266924582-soberoi-%5BFC79050368284AF1AC994EB228EC647C%2F242AE46A7EE3460A-1426266939781-5-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:16:26,736 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0039_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0039_conf.xml
2015-03-13 10:16:26,736 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0037-1426266908181-soberoi-%5B60EF8DB99DB643778E218C05CBD6D765%2F03EFE4BB2CF14F0F-1426266923264-5-0-SUCCEEDED-default.jhist	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0037-1426266908181-soberoi-%5B60EF8DB99DB643778E218C05CBD6D765%2F03EFE4BB2CF14F0F-1426266923264-5-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:16:26,736 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0038_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0038_conf.xml
2015-03-13 10:16:26,736 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0037_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0037_conf.xml
2015-03-13 10:16:26,737 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0039_conf.xml	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0039_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:16:26,737 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0037_conf.xml	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0037_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:16:26,737 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0038_conf.xml	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0038_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:16:26,737 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0040.summary	dst=null	perm=null
2015-03-13 10:16:26,738 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64474, bytes: 438, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742317_1493, duration: 125000
2015-03-13 10:16:26,739 INFO  jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0040,submitTime=1426266962450,launchTime=1426266966282,firstMapTaskLaunchTime=1426266968421,firstReduceTaskLaunchTime=0,finishTime=1426266977720,resourcesPerMap=1024,resourcesPerReduce=0,numMaps=5,numReduces=0,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=45,reduceSlotSeconds=0,jobName=[5AEBF4A4F39C4981A72307A2E47929FB/93F21464717B4FE5B4F0DD3DD04467D7] lower/(1/1) ...dedpipesplatform/samepipe
2015-03-13 10:16:26,739 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0040.summary]
2015-03-13 10:16:26,739 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742317_1493 127.0.0.1:60686 127.0.0.1:60693 127.0.0.1:60689 
2015-03-13 10:16:26,740 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0040.summary	dst=null	perm=null
2015-03-13 10:16:26,740 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000	dst=null	perm=null
2015-03-13 10:16:26,741 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0040-1426266962450-soberoi-%5B5AEBF4A4F39C4981A72307A2E47929FB%2F93F21464717B4FE5-1426266977720-5-0-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0040-1426266962450-soberoi-%5B5AEBF4A4F39C4981A72307A2E47929FB%2F93F21464717B4FE5-1426266977720-5-0-SUCCEEDED-default.jhist
2015-03-13 10:16:26,744 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0040-1426266962450-soberoi-%5B5AEBF4A4F39C4981A72307A2E47929FB%2F93F21464717B4FE5-1426266977720-5-0-SUCCEEDED-default.jhist	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0040-1426266962450-soberoi-%5B5AEBF4A4F39C4981A72307A2E47929FB%2F93F21464717B4FE5-1426266977720-5-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:16:26,745 INFO  hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0040_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0040_conf.xml
2015-03-13 10:16:26,746 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename options=0 	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0040_conf.xml	dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0040_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:16:27,188 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:27,493 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742324_1500
2015-03-13 10:16:27,598 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:27,598 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:27,599 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:27,599 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:27,683 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:28,193 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:28,329 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073742258_1434, blk_1073742243_1419, blk_1073742294_1470, blk_1073742230_1406, blk_1073742268_1444, blk_1073742220_1396, blk_1073742317_1493, blk_1073742206_1382]
2015-03-13 10:16:28,329 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073742304_1480, blk_1073742258_1434, blk_1073742294_1470, blk_1073742230_1406, blk_1073742281_1457, blk_1073742220_1396]
2015-03-13 10:16:28,599 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:28,599 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:28,600 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:28,600 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:28,688 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:28,822 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742258_1434 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir2/blk_1073742258 for deletion
2015-03-13 10:16:28,822 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742243_1419 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742243 for deletion
2015-03-13 10:16:28,823 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742230_1406 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742230 for deletion
2015-03-13 10:16:28,823 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742294_1470 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir2/blk_1073742294 for deletion
2015-03-13 10:16:28,823 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742243_1419 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742243
2015-03-13 10:16:28,823 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742258_1434 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir2/blk_1073742258
2015-03-13 10:16:28,823 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742220_1396 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742220 for deletion
2015-03-13 10:16:28,823 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742268_1444 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir57/blk_1073742268 for deletion
2015-03-13 10:16:28,823 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742230_1406 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742230
2015-03-13 10:16:28,823 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742317_1493 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir57/blk_1073742317 for deletion
2015-03-13 10:16:28,823 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742220_1396 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742220
2015-03-13 10:16:28,823 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742206_1382 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742206 for deletion
2015-03-13 10:16:28,823 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742294_1470 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir2/blk_1073742294
2015-03-13 10:16:28,824 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742268_1444 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir57/blk_1073742268
2015-03-13 10:16:28,824 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742206_1382 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742206
2015-03-13 10:16:28,824 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742317_1493 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir57/blk_1073742317
2015-03-13 10:16:29,194 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:29,265 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742304_1480 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir39/blk_1073742304 for deletion
2015-03-13 10:16:29,265 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742258_1434 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742258 for deletion
2015-03-13 10:16:29,265 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742230_1406 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742230 for deletion
2015-03-13 10:16:29,265 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742294_1470 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir39/blk_1073742294 for deletion
2015-03-13 10:16:29,265 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742281_1457 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742281 for deletion
2015-03-13 10:16:29,265 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742304_1480 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir39/blk_1073742304
2015-03-13 10:16:29,265 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742220_1396 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742220 for deletion
2015-03-13 10:16:29,265 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742258_1434 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742258
2015-03-13 10:16:29,265 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742230_1406 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742230
2015-03-13 10:16:29,266 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742281_1457 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742281
2015-03-13 10:16:29,266 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742294_1470 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir39/blk_1073742294
2015-03-13 10:16:29,266 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742220_1396 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742220
2015-03-13 10:16:29,600 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:29,600 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:29,600 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:29,601 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:29,691 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:30,197 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:30,601 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:30,601 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:30,601 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:30,602 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:30,695 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:31,200 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:31,333 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073742304_1480, blk_1073742243_1419, blk_1073742294_1470, blk_1073742281_1457, blk_1073742268_1444, blk_1073742220_1396, blk_1073742317_1493, blk_1073742206_1382]
2015-03-13 10:16:31,333 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073742304_1480, blk_1073742258_1434, blk_1073742243_1419, blk_1073742230_1406, blk_1073742281_1457, blk_1073742268_1444, blk_1073742317_1493, blk_1073742206_1382]
2015-03-13 10:16:31,602 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:31,602 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:31,602 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:31,603 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:31,695 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:31,846 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742304_1480 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742304 for deletion
2015-03-13 10:16:31,846 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742258_1434 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742258 for deletion
2015-03-13 10:16:31,846 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742243_1419 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742243 for deletion
2015-03-13 10:16:31,846 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742304_1480 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742304
2015-03-13 10:16:31,846 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742230_1406 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742230 for deletion
2015-03-13 10:16:31,846 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742281_1457 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742281 for deletion
2015-03-13 10:16:31,846 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742268_1444 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742268 for deletion
2015-03-13 10:16:31,846 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742258_1434 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742258
2015-03-13 10:16:31,846 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742317_1493 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir58/blk_1073742317 for deletion
2015-03-13 10:16:31,847 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742206_1382 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742206 for deletion
2015-03-13 10:16:31,847 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742268_1444 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742268
2015-03-13 10:16:31,847 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742243_1419 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742243
2015-03-13 10:16:31,847 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742230_1406 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742230
2015-03-13 10:16:31,847 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742281_1457 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742281
2015-03-13 10:16:31,847 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742317_1493 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir58/blk_1073742317
2015-03-13 10:16:31,848 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742206_1382 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742206
2015-03-13 10:16:32,039 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742304_1480 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742304 for deletion
2015-03-13 10:16:32,039 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742243_1419 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742243 for deletion
2015-03-13 10:16:32,039 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742294_1470 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir56/blk_1073742294 for deletion
2015-03-13 10:16:32,040 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742304_1480 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742304
2015-03-13 10:16:32,040 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742243_1419 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742243
2015-03-13 10:16:32,040 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742281_1457 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742281 for deletion
2015-03-13 10:16:32,040 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742220_1396 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742220 for deletion
2015-03-13 10:16:32,040 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742268_1444 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742268 for deletion
2015-03-13 10:16:32,040 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742294_1470 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir56/blk_1073742294
2015-03-13 10:16:32,040 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742317_1493 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742317 for deletion
2015-03-13 10:16:32,040 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742220_1396 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742220
2015-03-13 10:16:32,040 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742206_1382 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742206 for deletion
2015-03-13 10:16:32,040 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742281_1457 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742281
2015-03-13 10:16:32,040 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742268_1444 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742268
2015-03-13 10:16:32,041 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742206_1382 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742206
2015-03-13 10:16:32,041 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742317_1493 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742317
2015-03-13 10:16:32,205 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:32,608 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:32,608 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:32,609 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:32,609 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:32,695 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.split	dst=null	perm=null
2015-03-13 10:16:32,698 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:32,827 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.split	dst=null	perm=null
2015-03-13 10:16:32,856 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.split	dst=null	perm=null
2015-03-13 10:16:32,876 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.split	dst=null	perm=null
2015-03-13 10:16:32,908 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:64486, bytes: 1307, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0041_m_000002_0_-820462982_1, offset: 512, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742321_1497, duration: 136000
2015-03-13 10:16:32,944 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job.split	dst=null	perm=null
2015-03-13 10:16:33,022 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:64490, bytes: 791, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0041_m_000004_0_-1169288541_1, offset: 1024, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742321_1497, duration: 153000
2015-03-13 10:16:33,022 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:64489, bytes: 1823, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0041_m_000000_0_347394422_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742321_1497, duration: 115000
2015-03-13 10:16:33,059 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs-sparse.txt	dst=null	perm=null
2015-03-13 10:16:33,065 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:64493, bytes: 87, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0041_m_000002_0_-820462982_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742209_1385, duration: 144000
2015-03-13 10:16:33,074 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:64491, bytes: 1823, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0041_m_000001_0_-1005917036_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742321_1497, duration: 156000
2015-03-13 10:16:33,090 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/_temporary/1/_temporary/attempt_1426266260362_0041_m_000002_0/part-00002	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:16:33,114 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:64492, bytes: 791, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0041_m_000003_0_2062441771_1, offset: 1024, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742321_1497, duration: 147000
2015-03-13 10:16:33,125 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs-sparse.txt	dst=null	perm=null
2015-03-13 10:16:33,134 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:64494, bytes: 87, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0041_m_000004_0_-1169288541_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742209_1385, duration: 151000
2015-03-13 10:16:33,138 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs-sparse.txt	dst=null	perm=null
2015-03-13 10:16:33,160 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/_temporary/1/_temporary/attempt_1426266260362_0041_m_000004_0/part-00004	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:16:33,168 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/_temporary/1/_temporary/attempt_1426266260362_0041_m_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:16:33,182 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs-sparse.txt	dst=null	perm=null
2015-03-13 10:16:33,186 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:64491, bytes: 87, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0041_m_000001_0_-1005917036_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742209_1385, duration: 168000
2015-03-13 10:16:33,206 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:33,208 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs-sparse.txt	dst=null	perm=null
2015-03-13 10:16:33,212 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:64495, bytes: 87, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0041_m_000003_0_2062441771_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742209_1385, duration: 164000
2015-03-13 10:16:33,246 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/_temporary/1/_temporary/attempt_1426266260362_0041_m_000003_0/part-00003	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:16:33,305 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/_temporary/1/_temporary/attempt_1426266260362_0041_m_000001_0/part-00001	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:16:33,530 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs-sparse.txt	dst=null	perm=null
2015-03-13 10:16:33,539 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs-sparse.txt	dst=null	perm=null
2015-03-13 10:16:33,542 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs-sparse.txt	dst=null	perm=null
2015-03-13 10:16:33,551 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:64496, bytes: 52, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0041_m_000004_0_-1169288541_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742210_1386, duration: 153000
2015-03-13 10:16:33,568 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs-sparse.txt	dst=null	perm=null
2015-03-13 10:16:33,576 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/_temporary/1/_temporary/attempt_1426266260362_0041_m_000004_0/part-00004 is closed by DFSClient_attempt_1426266260362_0041_m_000004_0_-1169288541_1
2015-03-13 10:16:33,584 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/_temporary/1/_temporary/attempt_1426266260362_0041_m_000004_0	dst=null	perm=null
2015-03-13 10:16:33,590 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/_temporary/1/_temporary/attempt_1426266260362_0041_m_000004_0	dst=null	perm=null
2015-03-13 10:16:33,591 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/_temporary/1/task_1426266260362_0041_m_000004	dst=null	perm=null
2015-03-13 10:16:33,594 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/_temporary/1/_temporary/attempt_1426266260362_0041_m_000004_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/_temporary/1/task_1426266260362_0041_m_000004	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:16:33,601 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs-sparse.txt	dst=null	perm=null
2015-03-13 10:16:33,604 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs-sparse.txt	dst=null	perm=null
2015-03-13 10:16:33,605 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs-sparse.txt	dst=null	perm=null
2015-03-13 10:16:33,609 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:64497, bytes: 52, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0041_m_000000_0_347394422_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742210_1386, duration: 174000
2015-03-13 10:16:33,609 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:33,610 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:33,610 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:33,610 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:33,614 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0041_01_000006
2015-03-13 10:16:33,614 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0041	CONTAINERID=container_1426266260362_0041_01_000006
2015-03-13 10:16:33,614 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0041_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:16:33,615 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0041_01_000006
2015-03-13 10:16:33,615 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:64489, bytes: 87, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0041_m_000000_0_347394422_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742209_1385, duration: 184000
2015-03-13 10:16:33,615 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:16:33,619 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs-sparse.txt	dst=null	perm=null
2015-03-13 10:16:33,627 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0041_01_000006 is : 143
2015-03-13 10:16:33,628 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job_1426266260362_0041_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073742325_1501{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:16:33,630 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742325_1501 src: /127.0.0.1:64498 dest: /127.0.0.1:60689
2015-03-13 10:16:33,631 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742325_1501 src: /127.0.0.1:64499 dest: /127.0.0.1:60696
2015-03-13 10:16:33,633 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742325_1501 src: /127.0.0.1:64500 dest: /127.0.0.1:60686
2015-03-13 10:16:33,636 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs-sparse.txt	dst=null	perm=null
2015-03-13 10:16:33,637 INFO  hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job_1426266260362_0041_1.jhist for DFSClient_NONMAPREDUCE_-483536161_1
2015-03-13 10:16:33,639 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0041_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:16:33,639 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0041/container_1426266260362_0041_01_000006
2015-03-13 10:16:33,640 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0041/container_1426266260362_0041_01_000006
2015-03-13 10:16:33,640 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0041/container_1426266260362_0041_01_000006
2015-03-13 10:16:33,640 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0041/container_1426266260362_0041_01_000006
2015-03-13 10:16:33,639 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0041	CONTAINERID=container_1426266260362_0041_01_000006
2015-03-13 10:16:33,641 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0041_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:16:33,641 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0041_01_000006 from application application_1426266260362_0041
2015-03-13 10:16:33,641 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:16:33,641 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0041
2015-03-13 10:16:33,645 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64501, bytes: 52, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0041_m_000002_0_-820462982_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742210_1386, duration: 140000
2015-03-13 10:16:33,654 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/_temporary/1/_temporary/attempt_1426266260362_0041_m_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073742326_1502{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:16:33,674 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/_temporary/1/_temporary/attempt_1426266260362_0041_m_000002_0/part-00002. BP-1005356445-10.1.1.144-1426266257849 blk_1073742327_1503{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:16:33,720 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742327_1503 src: /127.0.0.1:64503 dest: /127.0.0.1:60686
2015-03-13 10:16:33,721 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742327_1503 src: /127.0.0.1:64504 dest: /127.0.0.1:60696
2015-03-13 10:16:33,722 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742326_1502 src: /127.0.0.1:64502 dest: /127.0.0.1:60693
2015-03-13 10:16:33,723 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742327_1503 src: /127.0.0.1:64505 dest: /127.0.0.1:60689
2015-03-13 10:16:33,723 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742326_1502 src: /127.0.0.1:64506 dest: /127.0.0.1:60686
2015-03-13 10:16:33,725 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742326_1502 src: /127.0.0.1:64507 dest: /127.0.0.1:60696
2015-03-13 10:16:33,732 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs-sparse.txt	dst=null	perm=null
2015-03-13 10:16:33,733 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64507, dest: /127.0.0.1:60696, bytes: 127, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0041_m_000000_0_347394422_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742326_1502, duration: 7058000
2015-03-13 10:16:33,733 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742326_1502, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:16:33,734 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742326_1502{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:16:33,734 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64506, dest: /127.0.0.1:60686, bytes: 127, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0041_m_000000_0_347394422_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742326_1502, duration: 7640000
2015-03-13 10:16:33,734 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742326_1502, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:33,734 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64505, dest: /127.0.0.1:60689, bytes: 28, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0041_m_000002_0_-820462982_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742327_1503, duration: 10021000
2015-03-13 10:16:33,734 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742326_1502{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:16:33,735 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64502, dest: /127.0.0.1:60693, bytes: 127, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0041_m_000000_0_347394422_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742326_1502, duration: 8456000
2015-03-13 10:16:33,735 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742326_1502, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:33,735 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64504, dest: /127.0.0.1:60696, bytes: 28, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0041_m_000002_0_-820462982_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742327_1503, duration: 10557000
2015-03-13 10:16:33,735 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742327_1503, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:33,734 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742327_1503, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:16:33,735 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742327_1503{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:16:33,736 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742326_1502{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:16:33,736 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64503, dest: /127.0.0.1:60686, bytes: 28, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0041_m_000002_0_-820462982_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742327_1503, duration: 11544000
2015-03-13 10:16:33,736 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742327_1503, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:33,737 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742327_1503{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:16:33,737 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742327_1503{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:16:33,742 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/_temporary/1/_temporary/attempt_1426266260362_0041_m_000002_0/part-00002 is closed by DFSClient_attempt_1426266260362_0041_m_000002_0_-820462982_1
2015-03-13 10:16:33,742 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/_temporary/1/_temporary/attempt_1426266260362_0041_m_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0041_m_000000_0_347394422_1
2015-03-13 10:16:33,747 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs-sparse.txt	dst=null	perm=null
2015-03-13 10:16:33,752 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs-sparse.txt	dst=null	perm=null
2015-03-13 10:16:33,752 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/_temporary/1/_temporary/attempt_1426266260362_0041_m_000000_0	dst=null	perm=null
2015-03-13 10:16:33,758 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/_temporary/1/_temporary/attempt_1426266260362_0041_m_000000_0	dst=null	perm=null
2015-03-13 10:16:33,758 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:64508, bytes: 52, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0041_m_000003_0_2062441771_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742210_1386, duration: 144000
2015-03-13 10:16:33,759 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/_temporary/1/task_1426266260362_0041_m_000000	dst=null	perm=null
2015-03-13 10:16:33,763 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/_temporary/1/_temporary/attempt_1426266260362_0041_m_000000_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/_temporary/1/task_1426266260362_0041_m_000000	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:16:33,763 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/_temporary/1/_temporary/attempt_1426266260362_0041_m_000002_0	dst=null	perm=null
2015-03-13 10:16:33,770 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/_temporary/1/_temporary/attempt_1426266260362_0041_m_000002_0	dst=null	perm=null
2015-03-13 10:16:33,775 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0041_01_000002
2015-03-13 10:16:33,775 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0041	CONTAINERID=container_1426266260362_0041_01_000002
2015-03-13 10:16:33,775 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0041_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:16:33,775 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0041_01_000002
2015-03-13 10:16:33,776 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:16:33,776 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:33,776 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:33,776 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:33,778 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/_temporary/1/task_1426266260362_0041_m_000002	dst=null	perm=null
2015-03-13 10:16:33,788 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0041_01_000002 is : 143
2015-03-13 10:16:33,790 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/_temporary/1/_temporary/attempt_1426266260362_0041_m_000002_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/_temporary/1/task_1426266260362_0041_m_000002	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:16:33,800 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0041_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:16:33,800 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0041/container_1426266260362_0041_01_000002
2015-03-13 10:16:33,801 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0041/container_1426266260362_0041_01_000002
2015-03-13 10:16:33,801 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0041/container_1426266260362_0041_01_000002
2015-03-13 10:16:33,801 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0041/container_1426266260362_0041_01_000002
2015-03-13 10:16:33,801 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0041	CONTAINERID=container_1426266260362_0041_01_000002
2015-03-13 10:16:33,802 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0041_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:16:33,802 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0041_01_000002 from application application_1426266260362_0041
2015-03-13 10:16:33,802 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:16:33,802 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0041
2015-03-13 10:16:33,806 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/_temporary/1/_temporary/attempt_1426266260362_0041_m_000003_0/part-00003. BP-1005356445-10.1.1.144-1426266257849 blk_1073742328_1504{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:16:33,807 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0041_01_000004
2015-03-13 10:16:33,807 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0041	CONTAINERID=container_1426266260362_0041_01_000004
2015-03-13 10:16:33,807 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0041_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:16:33,807 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:16:33,807 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0041_01_000004
2015-03-13 10:16:33,807 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0041_01_000002
2015-03-13 10:16:33,807 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:33,808 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:16:33,808 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:33,808 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0041_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:16:33,808 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0041_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:16:33,808 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0041	CONTAINERID=container_1426266260362_0041_01_000002
2015-03-13 10:16:33,808 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0041_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:16:33,808 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:16:33,809 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0041_01_000002, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:33,809 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:33,809 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:16:33,809 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0041_000001 released container container_1426266260362_0041_01_000002 on node: host: 10.1.1.144:60719 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:16:33,820 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0041_01_000004 is : 143
2015-03-13 10:16:33,832 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0041_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:16:33,832 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0041/container_1426266260362_0041_01_000004
2015-03-13 10:16:33,833 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0041/container_1426266260362_0041_01_000004
2015-03-13 10:16:33,833 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0041/container_1426266260362_0041_01_000004
2015-03-13 10:16:33,834 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0041/container_1426266260362_0041_01_000004
2015-03-13 10:16:33,834 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0041	CONTAINERID=container_1426266260362_0041_01_000004
2015-03-13 10:16:33,834 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0041_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:16:33,835 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0041_01_000004 from application application_1426266260362_0041
2015-03-13 10:16:33,835 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:16:33,835 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0041
2015-03-13 10:16:33,870 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742328_1504 src: /127.0.0.1:64509 dest: /127.0.0.1:60693
2015-03-13 10:16:33,871 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742328_1504 src: /127.0.0.1:64510 dest: /127.0.0.1:60696
2015-03-13 10:16:33,872 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742328_1504 src: /127.0.0.1:64511 dest: /127.0.0.1:60689
2015-03-13 10:16:33,880 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64511, dest: /127.0.0.1:60689, bytes: 29, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0041_m_000003_0_2062441771_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742328_1504, duration: 6070000
2015-03-13 10:16:33,880 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742328_1504, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:16:33,880 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742328_1504{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:16:33,880 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64510, dest: /127.0.0.1:60696, bytes: 29, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0041_m_000003_0_2062441771_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742328_1504, duration: 6596000
2015-03-13 10:16:33,881 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742328_1504, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:33,881 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742328_1504{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:16:33,881 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64509, dest: /127.0.0.1:60693, bytes: 29, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0041_m_000003_0_2062441771_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742328_1504, duration: 7488000
2015-03-13 10:16:33,881 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742328_1504, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:33,882 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742328_1504{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:16:33,888 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/_temporary/1/_temporary/attempt_1426266260362_0041_m_000003_0/part-00003 is closed by DFSClient_attempt_1426266260362_0041_m_000003_0_2062441771_1
2015-03-13 10:16:33,897 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/_temporary/1/_temporary/attempt_1426266260362_0041_m_000003_0	dst=null	perm=null
2015-03-13 10:16:33,898 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs-sparse.txt	dst=null	perm=null
2015-03-13 10:16:33,903 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/_temporary/1/_temporary/attempt_1426266260362_0041_m_000003_0	dst=null	perm=null
2015-03-13 10:16:33,905 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/_temporary/1/task_1426266260362_0041_m_000003	dst=null	perm=null
2015-03-13 10:16:33,909 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/_temporary/1/_temporary/attempt_1426266260362_0041_m_000003_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/_temporary/1/task_1426266260362_0041_m_000003	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:16:33,910 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs-sparse.txt	dst=null	perm=null
2015-03-13 10:16:33,913 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs-sparse.txt	dst=null	perm=null
2015-03-13 10:16:33,921 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0041_01_000005
2015-03-13 10:16:33,921 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0041	CONTAINERID=container_1426266260362_0041_01_000005
2015-03-13 10:16:33,922 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0041_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:16:33,922 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:33,922 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0041_01_000005
2015-03-13 10:16:33,922 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:64512, bytes: 52, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0041_m_000001_0_-1005917036_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742210_1386, duration: 167000
2015-03-13 10:16:33,922 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:16:33,922 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0041_01_000004
2015-03-13 10:16:33,922 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:16:33,923 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0041_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:16:33,923 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0041_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:16:33,937 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0041	CONTAINERID=container_1426266260362_0041_01_000004
2015-03-13 10:16:33,937 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0041_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:16:33,937 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:16:33,937 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0041_01_000004, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:33,937 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:33,937 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:16:33,938 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0041_000001 released container container_1426266260362_0041_01_000004 on node: host: 10.1.1.144:60719 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:16:33,945 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0041_01_000005 is : 143
2015-03-13 10:16:33,953 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0041_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:16:33,954 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0041/container_1426266260362_0041_01_000005
2015-03-13 10:16:33,954 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0041/container_1426266260362_0041_01_000005
2015-03-13 10:16:33,954 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0041/container_1426266260362_0041_01_000005
2015-03-13 10:16:33,955 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0041/container_1426266260362_0041_01_000005
2015-03-13 10:16:33,955 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0041	CONTAINERID=container_1426266260362_0041_01_000005
2015-03-13 10:16:33,955 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0041_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:16:33,955 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0041_01_000005 from application application_1426266260362_0041
2015-03-13 10:16:33,955 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:16:33,955 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0041
2015-03-13 10:16:33,964 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/_temporary/1/_temporary/attempt_1426266260362_0041_m_000001_0/part-00001. BP-1005356445-10.1.1.144-1426266257849 blk_1073742329_1505{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:16:34,005 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742329_1505 src: /127.0.0.1:64513 dest: /127.0.0.1:60693
2015-03-13 10:16:34,006 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742329_1505 src: /127.0.0.1:64514 dest: /127.0.0.1:60696
2015-03-13 10:16:34,007 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742329_1505 src: /127.0.0.1:64515 dest: /127.0.0.1:60686
2015-03-13 10:16:34,014 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64515, dest: /127.0.0.1:60686, bytes: 37, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0041_m_000001_0_-1005917036_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742329_1505, duration: 4699000
2015-03-13 10:16:34,014 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742329_1505, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:16:34,014 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742329_1505{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:16:34,014 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64514, dest: /127.0.0.1:60696, bytes: 37, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0041_m_000001_0_-1005917036_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742329_1505, duration: 5189000
2015-03-13 10:16:34,015 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742329_1505, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:34,015 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742329_1505{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:16:34,015 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64513, dest: /127.0.0.1:60693, bytes: 37, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0041_m_000001_0_-1005917036_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742329_1505, duration: 5835000
2015-03-13 10:16:34,015 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742329_1505, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:34,016 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742329_1505{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:16:34,020 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/_temporary/1/_temporary/attempt_1426266260362_0041_m_000001_0/part-00001 is closed by DFSClient_attempt_1426266260362_0041_m_000001_0_-1005917036_1
2015-03-13 10:16:34,029 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/_temporary/1/_temporary/attempt_1426266260362_0041_m_000001_0	dst=null	perm=null
2015-03-13 10:16:34,034 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/_temporary/1/_temporary/attempt_1426266260362_0041_m_000001_0	dst=null	perm=null
2015-03-13 10:16:34,035 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/_temporary/1/task_1426266260362_0041_m_000001	dst=null	perm=null
2015-03-13 10:16:34,039 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/_temporary/1/_temporary/attempt_1426266260362_0041_m_000001_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/_temporary/1/task_1426266260362_0041_m_000001	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:16:34,050 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0041_01_000003
2015-03-13 10:16:34,050 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0041	CONTAINERID=container_1426266260362_0041_01_000003
2015-03-13 10:16:34,050 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0041_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:16:34,050 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0041_01_000003
2015-03-13 10:16:34,050 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:16:34,051 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:16:34,051 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0041_01_000005
2015-03-13 10:16:34,051 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0041_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:16:34,051 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0041_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:16:34,051 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0041	CONTAINERID=container_1426266260362_0041_01_000005
2015-03-13 10:16:34,051 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0041_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:16:34,051 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:16:34,051 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0041_01_000005, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:34,052 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:34,052 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:16:34,052 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0041_000001 released container container_1426266260362_0041_01_000005 on node: host: 10.1.1.144:60719 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:16:34,054 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:16:34,056 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-483536161_1
2015-03-13 10:16:34,060 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/_temporary/1	dst=null	perm=null
2015-03-13 10:16:34,063 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0041_01_000003 is : 143
2015-03-13 10:16:34,066 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter	dst=null	perm=null
2015-03-13 10:16:34,067 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter	dst=null	perm=null
2015-03-13 10:16:34,068 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/_temporary/1/task_1426266260362_0041_m_000000	dst=null	perm=null
2015-03-13 10:16:34,069 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/part-00000	dst=null	perm=null
2015-03-13 10:16:34,073 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/_temporary/1/task_1426266260362_0041_m_000000/part-00000	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/part-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:16:34,074 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0041_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:16:34,074 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0041/container_1426266260362_0041_01_000003
2015-03-13 10:16:34,075 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0041/container_1426266260362_0041_01_000003
2015-03-13 10:16:34,075 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0041/container_1426266260362_0041_01_000003
2015-03-13 10:16:34,077 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0041/container_1426266260362_0041_01_000003
2015-03-13 10:16:34,077 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter	dst=null	perm=null
2015-03-13 10:16:34,077 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0041	CONTAINERID=container_1426266260362_0041_01_000003
2015-03-13 10:16:34,078 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter	dst=null	perm=null
2015-03-13 10:16:34,078 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0041_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:16:34,078 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0041_01_000003 from application application_1426266260362_0041
2015-03-13 10:16:34,079 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:16:34,079 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0041
2015-03-13 10:16:34,079 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/_temporary/1/task_1426266260362_0041_m_000001	dst=null	perm=null
2015-03-13 10:16:34,080 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/part-00001	dst=null	perm=null
2015-03-13 10:16:34,082 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/_temporary/1/task_1426266260362_0041_m_000001/part-00001	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/part-00001	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:16:34,083 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter	dst=null	perm=null
2015-03-13 10:16:34,084 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter	dst=null	perm=null
2015-03-13 10:16:34,084 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/_temporary/1/task_1426266260362_0041_m_000002	dst=null	perm=null
2015-03-13 10:16:34,086 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/part-00002	dst=null	perm=null
2015-03-13 10:16:34,087 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/_temporary/1/task_1426266260362_0041_m_000002/part-00002	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/part-00002	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:16:34,088 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter	dst=null	perm=null
2015-03-13 10:16:34,089 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter	dst=null	perm=null
2015-03-13 10:16:34,090 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/_temporary/1/task_1426266260362_0041_m_000003	dst=null	perm=null
2015-03-13 10:16:34,092 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/part-00003	dst=null	perm=null
2015-03-13 10:16:34,093 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/_temporary/1/task_1426266260362_0041_m_000003/part-00003	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/part-00003	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:16:34,094 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter	dst=null	perm=null
2015-03-13 10:16:34,095 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter	dst=null	perm=null
2015-03-13 10:16:34,096 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/_temporary/1/task_1426266260362_0041_m_000004	dst=null	perm=null
2015-03-13 10:16:34,097 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/part-00004	dst=null	perm=null
2015-03-13 10:16:34,098 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/_temporary/1/task_1426266260362_0041_m_000004/part-00004	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/part-00004	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:16:34,101 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/_temporary	dst=null	perm=null
2015-03-13 10:16:34,103 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:16:34,105 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-483536161_1
2015-03-13 10:16:34,106 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:16:34,108 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-483536161_1
2015-03-13 10:16:34,109 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742326_1502
2015-03-13 10:16:34,110 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742329_1505
2015-03-13 10:16:34,110 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742328_1504
2015-03-13 10:16:34,118 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64500, dest: /127.0.0.1:60686, bytes: 53379, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-483536161_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742325_1501, duration: 484282000
2015-03-13 10:16:34,119 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742325_1501, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:16:34,121 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742325_1501{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:16:34,121 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64499, dest: /127.0.0.1:60696, bytes: 53379, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-483536161_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742325_1501, duration: 486499000
2015-03-13 10:16:34,121 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742325_1501, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:34,122 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742325_1501{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:16:34,122 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64498, dest: /127.0.0.1:60689, bytes: 53379, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-483536161_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742325_1501, duration: 487973000
2015-03-13 10:16:34,123 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742325_1501, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:34,123 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742325_1501{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:16:34,124 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job_1426266260362_0041_1.jhist is closed by DFSClient_NONMAPREDUCE_-483536161_1
2015-03-13 10:16:34,126 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0041.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:16:34,129 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0041.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742330_1506{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:16:34,131 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742330_1506 src: /127.0.0.1:64516 dest: /127.0.0.1:60686
2015-03-13 10:16:34,132 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742330_1506 src: /127.0.0.1:64517 dest: /127.0.0.1:60693
2015-03-13 10:16:34,133 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742330_1506 src: /127.0.0.1:64518 dest: /127.0.0.1:60689
2015-03-13 10:16:34,136 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64518, dest: /127.0.0.1:60689, bytes: 440, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-483536161_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742330_1506, duration: 1513000
2015-03-13 10:16:34,137 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742330_1506, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:16:34,137 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742330_1506{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:16:34,137 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64517, dest: /127.0.0.1:60693, bytes: 440, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-483536161_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742330_1506, duration: 2036000
2015-03-13 10:16:34,137 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742330_1506, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:34,138 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742330_1506{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:16:34,138 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64516, dest: /127.0.0.1:60686, bytes: 440, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-483536161_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742330_1506, duration: 2911000
2015-03-13 10:16:34,138 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742330_1506, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:34,139 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742330_1506{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:16:34,140 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0041.summary_tmp is closed by DFSClient_NONMAPREDUCE_-483536161_1
2015-03-13 10:16:34,143 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0041.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:16:34,147 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job_1426266260362_0041_1.jhist	dst=null	perm=null
2015-03-13 10:16:34,148 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0041-1426266979063-soberoi-%5B1E4D839F738A46F7A739643C694C0347%2FAB645C0BEEB8493D-1426266994108-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:16:34,151 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job_1426266260362_0041_1.jhist	dst=null	perm=null
2015-03-13 10:16:34,152 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0041-1426266979063-soberoi-%5B1E4D839F738A46F7A739643C694C0347%2FAB645C0BEEB8493D-1426266994108-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:16:34,153 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job_1426266260362_0041_1.jhist	dst=null	perm=null
2015-03-13 10:16:34,155 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0041-1426266979063-soberoi-%5B1E4D839F738A46F7A739643C694C0347%2FAB645C0BEEB8493D-1426266994108-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:16:34,157 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:64519, bytes: 53799, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-483536161_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742325_1501, duration: 178000
2015-03-13 10:16:34,158 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0041-1426266979063-soberoi-%5B1E4D839F738A46F7A739643C694C0347%2FAB645C0BEEB8493D-1426266994108-5-0-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742331_1507{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:16:34,160 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742331_1507 src: /127.0.0.1:64520 dest: /127.0.0.1:60696
2015-03-13 10:16:34,161 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742331_1507 src: /127.0.0.1:64521 dest: /127.0.0.1:60689
2015-03-13 10:16:34,162 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742331_1507 src: /127.0.0.1:64522 dest: /127.0.0.1:60693
2015-03-13 10:16:34,165 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64522, dest: /127.0.0.1:60693, bytes: 53379, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-483536161_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742331_1507, duration: 1628000
2015-03-13 10:16:34,165 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742331_1507, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:16:34,165 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742331_1507{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:16:34,165 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64521, dest: /127.0.0.1:60689, bytes: 53379, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-483536161_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742331_1507, duration: 1972000
2015-03-13 10:16:34,165 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742331_1507, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:34,166 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742331_1507{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:16:34,166 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64520, dest: /127.0.0.1:60696, bytes: 53379, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-483536161_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742331_1507, duration: 2663000
2015-03-13 10:16:34,166 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742331_1507, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:34,166 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742331_1507{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:16:34,168 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0041-1426266979063-soberoi-%5B1E4D839F738A46F7A739643C694C0347%2FAB645C0BEEB8493D-1426266994108-5-0-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-483536161_1
2015-03-13 10:16:34,169 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0041-1426266979063-soberoi-%5B1E4D839F738A46F7A739643C694C0347%2FAB645C0BEEB8493D-1426266994108-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:16:34,170 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job_1426266260362_0041_1_conf.xml	dst=null	perm=null
2015-03-13 10:16:34,171 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0041_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:16:34,172 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job_1426266260362_0041_1_conf.xml	dst=null	perm=null
2015-03-13 10:16:34,173 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0041_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:16:34,174 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041/job_1426266260362_0041_1_conf.xml	dst=null	perm=null
2015-03-13 10:16:34,176 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0041_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:16:34,178 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:64523, bytes: 91811, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-483536161_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742324_1500, duration: 262000
2015-03-13 10:16:34,180 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0041_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742332_1508{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:16:34,182 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742332_1508 src: /127.0.0.1:64524 dest: /127.0.0.1:60696
2015-03-13 10:16:34,183 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742332_1508 src: /127.0.0.1:64525 dest: /127.0.0.1:60686
2015-03-13 10:16:34,184 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742332_1508 src: /127.0.0.1:64526 dest: /127.0.0.1:60689
2015-03-13 10:16:34,188 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64526, dest: /127.0.0.1:60689, bytes: 91099, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-483536161_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742332_1508, duration: 1769000
2015-03-13 10:16:34,188 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742332_1508, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:16:34,188 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742332_1508{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:16:34,188 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64525, dest: /127.0.0.1:60686, bytes: 91099, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-483536161_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742332_1508, duration: 2352000
2015-03-13 10:16:34,188 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742332_1508, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:34,189 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742332_1508{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:16:34,189 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64524, dest: /127.0.0.1:60696, bytes: 91099, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-483536161_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742332_1508, duration: 3077000
2015-03-13 10:16:34,189 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742332_1508, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:34,190 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742332_1508{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:16:34,191 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0041_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-483536161_1
2015-03-13 10:16:34,192 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0041_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:16:34,194 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0041.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0041.summary	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:16:34,196 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0041_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0041_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:16:34,197 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0041-1426266979063-soberoi-%5B1E4D839F738A46F7A739643C694C0347%2FAB645C0BEEB8493D-1426266994108-5-0-SUCCEEDED-default.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0041-1426266979063-soberoi-%5B1E4D839F738A46F7A739643C694C0347%2FAB645C0BEEB8493D-1426266994108-5-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:16:34,205 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0041_000001 State change from RUNNING to FINISHING
2015-03-13 10:16:34,205 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0041
2015-03-13 10:16:34,205 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0041 State change from RUNNING to REMOVING
2015-03-13 10:16:34,205 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0041
2015-03-13 10:16:34,205 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0041 State change from REMOVING to FINISHING
2015-03-13 10:16:34,207 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:34,617 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:16:34,617 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0041_01_000006
2015-03-13 10:16:34,618 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0041_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:16:34,618 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0041_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:16:34,618 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0041	CONTAINERID=container_1426266260362_0041_01_000006
2015-03-13 10:16:34,618 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0041_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:16:34,618 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:16:34,618 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0041_01_000006, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:34,619 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:34,619 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:16:34,619 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0041_000001 released container container_1426266260362_0041_01_000006 on node: host: 10.1.1.144:60715 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:16:34,847 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742328_1504
2015-03-13 10:16:34,848 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742326_1502
2015-03-13 10:16:34,849 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742325_1501
2015-03-13 10:16:34,849 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742329_1505
2015-03-13 10:16:34,849 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742327_1503
2015-03-13 10:16:34,850 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742331_1507
2015-03-13 10:16:34,850 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742332_1508
2015-03-13 10:16:35,055 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:16:35,056 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0041_01_000003
2015-03-13 10:16:35,056 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0041_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:16:35,056 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0041_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:16:35,056 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0041	CONTAINERID=container_1426266260362_0041_01_000003
2015-03-13 10:16:35,057 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0041_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:16:35,057 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:16:35,057 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0041_01_000003, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:35,057 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:35,057 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:16:35,057 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0041_000001 released container container_1426266260362_0041_01_000003 on node: host: 10.1.1.144:60719 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:16:35,212 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:35,217 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742320_1496 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60689 
2015-03-13 10:16:35,217 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742321_1497 127.0.0.1:60693 127.0.0.1:60689 127.0.0.1:60686 127.0.0.1:60696 
2015-03-13 10:16:35,217 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742322_1498 127.0.0.1:60686 127.0.0.1:60693 127.0.0.1:60689 
2015-03-13 10:16:35,218 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742323_1499 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60693 
2015-03-13 10:16:35,218 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742325_1501 127.0.0.1:60689 127.0.0.1:60696 127.0.0.1:60686 
2015-03-13 10:16:35,218 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742324_1500 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60689 
2015-03-13 10:16:35,218 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0041	dst=null	perm=null
2015-03-13 10:16:35,257 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter	dst=null	perm=null
2015-03-13 10:16:35,257 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/_temporary
2015-03-13 10:16:35,257 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/_temporary	dst=null	perm=null
2015-03-13 10:16:35,264 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:16:35,264 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:16:35,265 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:16:35,265 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter	dst=null	perm=null
2015-03-13 10:16:35,266 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter	dst=null	perm=null
2015-03-13 10:16:35,266 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter	dst=null	perm=null
2015-03-13 10:16:35,268 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:16:35,268 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/part-00000	dst=null	perm=null
2015-03-13 10:16:35,270 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:64527, bytes: 131, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742326_1502, duration: 171000
2015-03-13 10:16:35,271 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/part-00001	dst=null	perm=null
2015-03-13 10:16:35,272 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:64527, bytes: 41, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742329_1505, duration: 149000
2015-03-13 10:16:35,272 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/part-00002	dst=null	perm=null
2015-03-13 10:16:35,274 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:64528, bytes: 32, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742327_1503, duration: 175000
2015-03-13 10:16:35,275 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/part-00003	dst=null	perm=null
2015-03-13 10:16:35,276 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:64528, bytes: 33, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742328_1504, duration: 174000
2015-03-13 10:16:35,277 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/part-00004	dst=null	perm=null
2015-03-13 10:16:35,283 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:16:35,283 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:16:35,284 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:16:35,284 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter	dst=null	perm=null
2015-03-13 10:16:35,285 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter	dst=null	perm=null
2015-03-13 10:16:35,285 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter	dst=null	perm=null
2015-03-13 10:16:35,286 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:16:35,287 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/part-00000	dst=null	perm=null
2015-03-13 10:16:35,289 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64529, bytes: 131, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742326_1502, duration: 160000
2015-03-13 10:16:35,290 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/part-00001	dst=null	perm=null
2015-03-13 10:16:35,291 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:64530, bytes: 41, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742329_1505, duration: 157000
2015-03-13 10:16:35,292 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/part-00002	dst=null	perm=null
2015-03-13 10:16:35,293 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64529, bytes: 32, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742327_1503, duration: 143000
2015-03-13 10:16:35,293 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/part-00003	dst=null	perm=null
2015-03-13 10:16:35,294 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:64528, bytes: 33, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742328_1504, duration: 161000
2015-03-13 10:16:35,295 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/part-00004	dst=null	perm=null
2015-03-13 10:16:35,296 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/joininnerouter
2015-03-13 10:16:35,296 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter	dst=null	perm=null
2015-03-13 10:16:35,296 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter	dst=null	perm=null
2015-03-13 10:16:35,297 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter	dst=null	perm=null
2015-03-13 10:16:35,298 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter	dst=null	perm=null
2015-03-13 10:16:35,298 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/part-00000	dst=null	perm=null
2015-03-13 10:16:35,299 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/part-00000	dst=null	perm=null
2015-03-13 10:16:35,300 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64529, bytes: 131, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742326_1502, duration: 171000
2015-03-13 10:16:35,300 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/part-00001	dst=null	perm=null
2015-03-13 10:16:35,301 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/part-00001	dst=null	perm=null
2015-03-13 10:16:35,302 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:64530, bytes: 41, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742329_1505, duration: 148000
2015-03-13 10:16:35,302 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/part-00002	dst=null	perm=null
2015-03-13 10:16:35,303 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/part-00002	dst=null	perm=null
2015-03-13 10:16:35,304 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64529, bytes: 32, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742327_1503, duration: 173000
2015-03-13 10:16:35,305 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/part-00003	dst=null	perm=null
2015-03-13 10:16:35,305 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/part-00003	dst=null	perm=null
2015-03-13 10:16:35,306 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:64530, bytes: 33, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742328_1504, duration: 167000
2015-03-13 10:16:35,307 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/part-00004	dst=null	perm=null
2015-03-13 10:16:35,307 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnerouter/part-00004	dst=null	perm=null
2015-03-13 10:16:35,308 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:16:35,309 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:16:35,317 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:16:35,318 INFO  util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:16:35,318 INFO  planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:16:35,330 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields	dst=null	perm=null
2015-03-13 10:16:35,331 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting
2015-03-13 10:16:35,332 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt"]
2015-03-13 10:16:35,332 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-03-13 10:16:35,332 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields"]
2015-03-13 10:16:35,332 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  parallel execution is enabled: true
2015-03-13 10:16:35,332 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  starting jobs: 1
2015-03-13 10:16:35,332 INFO  flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper]  allocating threads: 1
2015-03-13 10:16:35,333 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (1/1) ...dpipesplatform/difffields
2015-03-13 10:16:35,343 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:16:35,358 INFO  client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:16:35,360 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields	dst=null	perm=null
2015-03-13 10:16:35,360 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:16:35,361 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:16:35,362 INFO  resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 42
2015-03-13 10:16:35,363 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042	dst=null	perm=null
2015-03-13 10:16:35,364 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042	dst=null	perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:16:35,365 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042	dst=null	perm=soberoi:supergroup:rwx------
2015-03-13 10:16:35,365 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.jar	dst=null	perm=null
2015-03-13 10:16:35,366 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:16:35,368 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073742333_1509{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:16:35,369 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742333_1509 src: /127.0.0.1:64532 dest: /127.0.0.1:60686
2015-03-13 10:16:35,370 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742333_1509 src: /127.0.0.1:64533 dest: /127.0.0.1:60696
2015-03-13 10:16:35,371 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742333_1509 src: /127.0.0.1:64534 dest: /127.0.0.1:60689
2015-03-13 10:16:35,376 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64534, dest: /127.0.0.1:60689, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742333_1509, duration: 1921000
2015-03-13 10:16:35,376 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742333_1509, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:16:35,376 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64533, dest: /127.0.0.1:60696, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742333_1509, duration: 2871000
2015-03-13 10:16:35,376 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742333_1509{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:16:35,377 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742333_1509, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:35,377 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64532, dest: /127.0.0.1:60686, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742333_1509, duration: 3732000
2015-03-13 10:16:35,377 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742333_1509, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:35,377 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742333_1509{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:16:35,378 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742333_1509{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:16:35,379 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:16:35,380 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.jar
2015-03-13 10:16:35,380 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.jar	dst=null	perm=null
2015-03-13 10:16:35,381 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.jar	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:16:35,382 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:16:35,382 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:16:35,383 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:16:35,384 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir	dst=null	perm=null
2015-03-13 10:16:35,384 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target	dst=null	perm=null
2015-03-13 10:16:35,385 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi	dst=null	perm=null
2015-03-13 10:16:35,385 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user	dst=null	perm=null
2015-03-13 10:16:35,386 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/	dst=null	perm=null
2015-03-13 10:16:35,387 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:16:35,388 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:16:35,389 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:16:35,389 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:16:35,391 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:16:35,393 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.split	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:16:35,393 INFO  blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.split
2015-03-13 10:16:35,394 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setReplication	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.split	dst=null	perm=null
2015-03-13 10:16:35,394 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073742334_1510{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:16:35,396 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742334_1510 src: /127.0.0.1:64535 dest: /127.0.0.1:60693
2015-03-13 10:16:35,397 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742334_1510 src: /127.0.0.1:64536 dest: /127.0.0.1:60689
2015-03-13 10:16:35,398 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742334_1510 src: /127.0.0.1:64537 dest: /127.0.0.1:60686
2015-03-13 10:16:35,399 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742334_1510 src: /127.0.0.1:64538 dest: /127.0.0.1:60696
2015-03-13 10:16:35,402 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64538, dest: /127.0.0.1:60696, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742334_1510, duration: 1565000
2015-03-13 10:16:35,402 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742334_1510, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:16:35,402 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742334_1510{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:16:35,402 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64537, dest: /127.0.0.1:60686, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742334_1510, duration: 1672000
2015-03-13 10:16:35,402 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742334_1510, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:35,403 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742334_1510{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:16:35,403 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64536, dest: /127.0.0.1:60689, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742334_1510, duration: 2775000
2015-03-13 10:16:35,403 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742334_1510, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:35,403 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742334_1510{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:16:35,404 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64535, dest: /127.0.0.1:60693, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742334_1510, duration: 3019000
2015-03-13 10:16:35,404 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742334_1510, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:35,406 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742334_1510{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:16:35,407 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:16:35,408 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:16:35,410 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.splitmetainfo	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:16:35,410 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073742335_1511{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:16:35,411 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742335_1511 src: /127.0.0.1:64539 dest: /127.0.0.1:60696
2015-03-13 10:16:35,412 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742335_1511 src: /127.0.0.1:64540 dest: /127.0.0.1:60693
2015-03-13 10:16:35,413 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742335_1511 src: /127.0.0.1:64541 dest: /127.0.0.1:60686
2015-03-13 10:16:35,416 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64541, dest: /127.0.0.1:60686, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742335_1511, duration: 1333000
2015-03-13 10:16:35,416 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742335_1511, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:16:35,416 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742335_1511{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:16:35,416 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64540, dest: /127.0.0.1:60693, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742335_1511, duration: 1760000
2015-03-13 10:16:35,417 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742335_1511, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:35,417 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742335_1511{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:16:35,417 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64539, dest: /127.0.0.1:60696, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742335_1511, duration: 2485000
2015-03-13 10:16:35,417 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742335_1511, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:35,418 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742335_1511{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:16:35,419 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:16:35,419 INFO  mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:16:35,420 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:16:35,422 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.xml	dst=null	perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:16:35,423 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:16:35,423 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:16:35,423 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:16:35,427 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742336_1512{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:16:35,429 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742336_1512 src: /127.0.0.1:64542 dest: /127.0.0.1:60693
2015-03-13 10:16:35,430 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742336_1512 src: /127.0.0.1:64543 dest: /127.0.0.1:60696
2015-03-13 10:16:35,431 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742336_1512 src: /127.0.0.1:64544 dest: /127.0.0.1:60689
2015-03-13 10:16:35,434 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64544, dest: /127.0.0.1:60689, bytes: 97608, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742336_1512, duration: 1487000
2015-03-13 10:16:35,434 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742336_1512, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:16:35,434 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742336_1512{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:16:35,435 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64543, dest: /127.0.0.1:60696, bytes: 97608, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742336_1512, duration: 2111000
2015-03-13 10:16:35,435 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742336_1512, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:35,435 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742336_1512{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:16:35,435 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64542, dest: /127.0.0.1:60693, bytes: 97608, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742336_1512, duration: 2974000
2015-03-13 10:16:35,436 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742336_1512, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:35,437 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742336_1512{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:16:35,437 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:16:35,438 INFO  mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0042
2015-03-13 10:16:35,439 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042	dst=null	perm=null
2015-03-13 10:16:35,439 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.xml	dst=null	perm=null
2015-03-13 10:16:35,440 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.xml	dst=null	perm=null
2015-03-13 10:16:35,441 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.jar	dst=null	perm=null
2015-03-13 10:16:35,441 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.jar	dst=null	perm=null
2015-03-13 10:16:35,442 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.split	dst=null	perm=null
2015-03-13 10:16:35,443 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.split	dst=null	perm=null
2015-03-13 10:16:35,444 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:16:35,444 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:16:35,446 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:16:35,446 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:16:35,447 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:16:35,448 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:16:35,448 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:16:35,449 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:16:35,450 INFO  resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 42 submitted by user soberoi
2015-03-13 10:16:35,450 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0042
2015-03-13 10:16:35,450 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	IP=10.1.1.144	OPERATION=Submit Application Request	TARGET=ClientRMService	RESULT=SUCCESS	APPID=application_1426266260362_0042
2015-03-13 10:16:35,450 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0042
2015-03-13 10:16:35,450 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0042 State change from NEW to NEW_SAVING
2015-03-13 10:16:35,450 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0042 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:16:35,451 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0042_000001
2015-03-13 10:16:35,451 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0042_000001 State change from NEW to SUBMITTED
2015-03-13 10:16:35,451 INFO  capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0042 from user: soberoi activated in queue: default
2015-03-13 10:16:35,451 INFO  capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0042 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:16:35,451 INFO  capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0042 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:16:35,451 INFO  impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0042 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:16:35,451 INFO  capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0042_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:16:35,451 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0042_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:16:35,452 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0042 State change from SUBMITTED to ACCEPTED
2015-03-13 10:16:35,453 INFO  mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0042/
2015-03-13 10:16:35,453 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1426266260362_0042
2015-03-13 10:16:35,453 INFO  flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0042/
2015-03-13 10:16:35,622 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0042_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:16:35,622 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0042	CONTAINERID=container_1426266260362_0042_01_000001
2015-03-13 10:16:35,622 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0042_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:16:35,622 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0042 container=Container: [ContainerId: container_1426266260362_0042_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0042_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:35,622 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:16:35,622 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0042_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:16:35,623 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:35,623 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0042 AttemptId: appattempt_1426266260362_0042_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0042_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ]
2015-03-13 10:16:35,624 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0042_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:16:35,624 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0042_000001
2015-03-13 10:16:35,624 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0042_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:16:35,624 INFO  amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0042_000001
2015-03-13 10:16:35,625 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0042_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] for AM appattempt_1426266260362_0042_000001
2015-03-13 10:16:35,625 INFO  amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0042_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 
2015-03-13 10:16:35,627 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0042_000001 (auth:SIMPLE)
2015-03-13 10:16:35,628 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0042_01_000001 by user soberoi
2015-03-13 10:16:35,628 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0042
2015-03-13 10:16:35,628 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0042	CONTAINERID=container_1426266260362_0042_01_000001
2015-03-13 10:16:35,628 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0042 transitioned from NEW to INITING
2015-03-13 10:16:35,628 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0042_01_000001 to application application_1426266260362_0042
2015-03-13 10:16:35,629 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0042 transitioned from INITING to RUNNING
2015-03-13 10:16:35,629 INFO  amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0042_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] for AM appattempt_1426266260362_0042_000001
2015-03-13 10:16:35,629 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0042_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:16:35,629 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0042_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:16:35,629 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0042
2015-03-13 10:16:35,629 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:16:35,629 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:16:35,629 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:16:35,629 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:16:35,630 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0042_01_000001
2015-03-13 10:16:35,639 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426266260362_0042_01_000001.tokens. Credentials list: 
2015-03-13 10:16:35,653 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:16:35,721 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426266260362_0042_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0042/container_1426266260362_0042_01_000001.tokens
2015-03-13 10:16:35,721 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0042 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0042
2015-03-13 10:16:35,783 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.jar	dst=null	perm=null
2015-03-13 10:16:35,783 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.jar	dst=null	perm=null
2015-03-13 10:16:35,784 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.jar	dst=null	perm=null
2015-03-13 10:16:35,789 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64529, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_790305796_22659, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742333_1509, duration: 482000
2015-03-13 10:16:35,807 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:16:35,824 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:16:35,824 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:16:35,825 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:16:35,831 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:64527, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_790305796_22659, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742335_1511, duration: 106000
2015-03-13 10:16:35,843 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:16:35,859 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.split	dst=null	perm=null
2015-03-13 10:16:35,860 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.split	dst=null	perm=null
2015-03-13 10:16:35,860 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.split	dst=null	perm=null
2015-03-13 10:16:35,866 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64529, bytes: 1798, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_790305796_22659, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742334_1510, duration: 130000
2015-03-13 10:16:35,879 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:16:35,895 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.xml	dst=null	perm=null
2015-03-13 10:16:35,895 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.xml	dst=null	perm=null
2015-03-13 10:16:35,896 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.xml	dst=null	perm=null
2015-03-13 10:16:35,901 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:64530, bytes: 98372, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_790305796_22659, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742336_1512, duration: 299000
2015-03-13 10:16:35,914 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:16:35,914 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0042_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:16:35,939 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0042_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:16:35,940 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:16:36,010 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0042/container_1426266260362_0042_01_000001/default_container_executor.sh]
2015-03-13 10:16:36,217 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:36,625 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:36,625 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0042_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:16:37,221 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:37,339 INFO  BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60689 to replicate blk_1073742333_1509 to datanode(s) 127.0.0.1:60693
2015-03-13 10:16:37,339 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073742320_1496, blk_1073742321_1497, blk_1073742322_1498, blk_1073742323_1499, blk_1073742324_1500]
2015-03-13 10:16:37,339 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073742320_1496, blk_1073742321_1497, blk_1073742322_1498, blk_1073742323_1499, blk_1073742325_1501]
2015-03-13 10:16:37,500 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742328_1504
2015-03-13 10:16:37,500 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742327_1503
2015-03-13 10:16:37,501 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742336_1512
2015-03-13 10:16:37,501 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742325_1501
2015-03-13 10:16:37,502 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742334_1510
2015-03-13 10:16:37,502 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742330_1506
2015-03-13 10:16:37,502 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742332_1508
2015-03-13 10:16:37,503 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742331_1507
2015-03-13 10:16:37,597 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging	dst=null	perm=null
2015-03-13 10:16:37,618 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/COMMIT_STARTED	dst=null	perm=null
2015-03-13 10:16:37,619 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/COMMIT_SUCCESS	dst=null	perm=null
2015-03-13 10:16:37,620 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/COMMIT_FAIL	dst=null	perm=null
2015-03-13 10:16:37,626 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:37,669 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042	dst=null	perm=null
2015-03-13 10:16:37,670 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate	dst=null	perm=null
2015-03-13 10:16:37,671 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi	dst=null	perm=null
2015-03-13 10:16:37,706 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742333_1509
2015-03-13 10:16:37,827 INFO  datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-1172757413-10.1.1.144-60689-1426266259165, infoPort=60690, ipcPort=60692, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073742333_1509 to 127.0.0.1:60693 
2015-03-13 10:16:37,828 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742333_1509 src: /127.0.0.1:64549 dest: /127.0.0.1:60693
2015-03-13 10:16:37,828 INFO  datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073742333_1509 (numBytes=254067) to /127.0.0.1:60693
2015-03-13 10:16:37,829 INFO  datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073742333_1509 src: /127.0.0.1:64549 dest: /127.0.0.1:60693 of size 254067
2015-03-13 10:16:37,830 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742333_1509 size 254067
2015-03-13 10:16:37,851 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742320_1496 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir58/blk_1073742320 for deletion
2015-03-13 10:16:37,851 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742321_1497 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742321 for deletion
2015-03-13 10:16:37,851 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742322_1498 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir58/blk_1073742322 for deletion
2015-03-13 10:16:37,851 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742320_1496 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir58/blk_1073742320
2015-03-13 10:16:37,851 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742321_1497 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742321
2015-03-13 10:16:37,851 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742323_1499 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742323 for deletion
2015-03-13 10:16:37,851 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742322_1498 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir58/blk_1073742322
2015-03-13 10:16:37,851 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742325_1501 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742325 for deletion
2015-03-13 10:16:37,852 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742323_1499 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742323
2015-03-13 10:16:37,852 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742325_1501 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742325
2015-03-13 10:16:37,963 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:16:37,969 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.splitmetainfo	dst=null	perm=null
2015-03-13 10:16:38,025 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64550, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1118876827_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742335_1511, duration: 125000
2015-03-13 10:16:38,041 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742320_1496 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir56/blk_1073742320 for deletion
2015-03-13 10:16:38,041 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742321_1497 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir30/blk_1073742321 for deletion
2015-03-13 10:16:38,041 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742322_1498 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir56/blk_1073742322 for deletion
2015-03-13 10:16:38,041 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742323_1499 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir30/blk_1073742323 for deletion
2015-03-13 10:16:38,041 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742321_1497 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir30/blk_1073742321
2015-03-13 10:16:38,041 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742320_1496 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir56/blk_1073742320
2015-03-13 10:16:38,041 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742324_1500 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir56/blk_1073742324 for deletion
2015-03-13 10:16:38,041 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742323_1499 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir30/blk_1073742323
2015-03-13 10:16:38,041 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742322_1498 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir56/blk_1073742322
2015-03-13 10:16:38,042 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742324_1500 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir56/blk_1073742324
2015-03-13 10:16:38,222 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:38,626 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:38,648 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742332_1508
2015-03-13 10:16:38,648 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742334_1510
2015-03-13 10:16:38,649 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742335_1511
2015-03-13 10:16:38,649 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742326_1502
2015-03-13 10:16:38,649 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742329_1505
2015-03-13 10:16:38,649 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742330_1506
2015-03-13 10:16:38,808 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0042_000001 (auth:SIMPLE)
2015-03-13 10:16:38,809 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0042_000001
2015-03-13 10:16:38,809 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi	IP=10.1.1.144	OPERATION=Register App Master	TARGET=ApplicationMasterService	RESULT=SUCCESS	APPID=application_1426266260362_0042	APPATTEMPTID=appattempt_1426266260362_0042_000001
2015-03-13 10:16:38,810 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0042_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:16:38,810 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0042 State change from ACCEPTED to RUNNING
2015-03-13 10:16:38,829 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job_1426266260362_0042_1.jhist	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:16:38,831 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=mkdirs	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/_temporary/1	dst=null	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:16:38,850 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742333_1509
2015-03-13 10:16:38,850 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742327_1503
2015-03-13 10:16:38,898 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job_1426266260362_0042_1_conf.xml	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:16:39,017 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job_1426266260362_0042_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742337_1513{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:16:39,057 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742337_1513 src: /127.0.0.1:64556 dest: /127.0.0.1:60693
2015-03-13 10:16:39,058 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742337_1513 src: /127.0.0.1:64557 dest: /127.0.0.1:60686
2015-03-13 10:16:39,060 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742337_1513 src: /127.0.0.1:64558 dest: /127.0.0.1:60689
2015-03-13 10:16:39,068 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64558, dest: /127.0.0.1:60689, bytes: 90418, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1118876827_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742337_1513, duration: 6213000
2015-03-13 10:16:39,068 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742337_1513, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:16:39,069 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64557, dest: /127.0.0.1:60686, bytes: 90418, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1118876827_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742337_1513, duration: 7001000
2015-03-13 10:16:39,069 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742337_1513, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:39,070 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64556, dest: /127.0.0.1:60693, bytes: 90418, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1118876827_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742337_1513, duration: 8513000
2015-03-13 10:16:39,070 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742337_1513, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:39,071 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742337_1513{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:16:39,071 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742337_1513{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:16:39,072 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742337_1513{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:16:39,076 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job_1426266260362_0042_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-1118876827_1
2015-03-13 10:16:39,116 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742335_1511
2015-03-13 10:16:39,117 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742333_1509
2015-03-13 10:16:39,118 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742337_1513
2015-03-13 10:16:39,227 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:39,321 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742336_1512
2015-03-13 10:16:39,322 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742334_1510
2015-03-13 10:16:39,322 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742330_1506
2015-03-13 10:16:39,323 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742331_1507
2015-03-13 10:16:39,627 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:39,855 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742335_1511
2015-03-13 10:16:39,856 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742333_1509
2015-03-13 10:16:39,856 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742334_1510
2015-03-13 10:16:40,061 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742336_1512
2015-03-13 10:16:40,077 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0042_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:16:40,077 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0042	CONTAINERID=container_1426266260362_0042_01_000002
2015-03-13 10:16:40,077 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0042_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:16:40,077 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0042 container=Container: [ContainerId: container_1426266260362_0042_01_000002, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0042_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:40,078 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:16:40,078 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:40,078 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0042_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:16:40,078 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0042	CONTAINERID=container_1426266260362_0042_01_000003
2015-03-13 10:16:40,078 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0042_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:16:40,078 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0042 container=Container: [ContainerId: container_1426266260362_0042_01_000003, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0042_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:40,078 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:16:40,078 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:40,079 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0042_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:16:40,079 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0042	CONTAINERID=container_1426266260362_0042_01_000004
2015-03-13 10:16:40,079 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0042_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:16:40,079 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0042 container=Container: [ContainerId: container_1426266260362_0042_01_000004, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0042_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:40,079 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:16:40,079 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:40,080 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0042_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:16:40,080 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0042	CONTAINERID=container_1426266260362_0042_01_000005
2015-03-13 10:16:40,080 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0042_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:16:40,080 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0042 container=Container: [ContainerId: container_1426266260362_0042_01_000005, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0042_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:40,080 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:16:40,080 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:40,227 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:40,228 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0042_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:16:40,228 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Allocated Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0042	CONTAINERID=container_1426266260362_0042_01_000006
2015-03-13 10:16:40,228 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0042_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:16:40,228 INFO  capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0042 container=Container: [ContainerId: container_1426266260362_0042_01_000006, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0042_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:40,229 INFO  capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7
2015-03-13 10:16:40,229 INFO  capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:40,246 INFO  launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0041_01_000001 succeeded 
2015-03-13 10:16:40,246 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0041_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:16:40,246 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0041_01_000001
2015-03-13 10:16:40,253 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0041/container_1426266260362_0041_01_000001
2015-03-13 10:16:40,254 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0041/container_1426266260362_0041_01_000001
2015-03-13 10:16:40,254 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Succeeded	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0041	CONTAINERID=container_1426266260362_0041_01_000001
2015-03-13 10:16:40,253 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0041/container_1426266260362_0041_01_000001
2015-03-13 10:16:40,254 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0041_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:16:40,254 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0041_01_000001 from application application_1426266260362_0041
2015-03-13 10:16:40,254 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:16:40,254 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0041
2015-03-13 10:16:40,254 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0041/container_1426266260362_0041_01_000001
2015-03-13 10:16:40,341 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073742320_1496, blk_1073742321_1497, blk_1073742322_1498, blk_1073742324_1500, blk_1073742325_1501]
2015-03-13 10:16:40,341 INFO  hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073742320_1496, blk_1073742321_1497, blk_1073742323_1499, blk_1073742324_1500, blk_1073742325_1501]
2015-03-13 10:16:40,628 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:40,828 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742320_1496 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir57/blk_1073742320 for deletion
2015-03-13 10:16:40,828 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742321_1497 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir57/blk_1073742321 for deletion
2015-03-13 10:16:40,828 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742322_1498 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir2/blk_1073742322 for deletion
2015-03-13 10:16:40,828 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742324_1500 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir2/blk_1073742324 for deletion
2015-03-13 10:16:40,829 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742320_1496 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir57/blk_1073742320
2015-03-13 10:16:40,829 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742325_1501 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742325 for deletion
2015-03-13 10:16:40,829 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742322_1498 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir2/blk_1073742322
2015-03-13 10:16:40,829 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742321_1497 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir57/blk_1073742321
2015-03-13 10:16:40,829 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742324_1500 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir2/blk_1073742324
2015-03-13 10:16:40,829 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742325_1501 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742325
2015-03-13 10:16:40,846 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0042_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:16:40,846 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0042_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:16:40,846 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0042_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:16:40,846 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0042_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:16:40,846 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0042_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:16:40,872 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.jar	dst=null	perm=null
2015-03-13 10:16:40,873 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.jar	dst=null	perm=null
2015-03-13 10:16:40,883 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.xml	dst=null	perm=null
2015-03-13 10:16:40,884 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.xml	dst=null	perm=null
2015-03-13 10:16:40,886 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:16:40,887 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:16:40,892 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:16:40,894 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:16:40,895 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar	dst=null	perm=null
2015-03-13 10:16:40,896 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar	dst=null	perm=null
2015-03-13 10:16:40,971 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0042_000001 (auth:SIMPLE)
2015-03-13 10:16:40,971 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0042_000001 (auth:SIMPLE)
2015-03-13 10:16:40,973 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0042_01_000006 by user soberoi
2015-03-13 10:16:40,974 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0042
2015-03-13 10:16:40,974 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0042	CONTAINERID=container_1426266260362_0042_01_000006
2015-03-13 10:16:40,974 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0042 transitioned from NEW to INITING
2015-03-13 10:16:40,974 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0042_01_000006 to application application_1426266260362_0042
2015-03-13 10:16:40,974 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0042 transitioned from INITING to RUNNING
2015-03-13 10:16:40,975 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0042_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:16:40,975 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0042
2015-03-13 10:16:40,975 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0042
2015-03-13 10:16:40,975 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:16:40,975 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0042
2015-03-13 10:16:40,975 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:16:40,975 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:16:40,975 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0042_01_000006
2015-03-13 10:16:40,976 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0042_01_000002 by user soberoi
2015-03-13 10:16:40,976 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0042
2015-03-13 10:16:40,977 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0042	CONTAINERID=container_1426266260362_0042_01_000002
2015-03-13 10:16:40,977 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0042_01_000004 by user soberoi
2015-03-13 10:16:40,977 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0042	CONTAINERID=container_1426266260362_0042_01_000004
2015-03-13 10:16:40,977 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0042_01_000005 by user soberoi
2015-03-13 10:16:40,977 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0042_01_000003 by user soberoi
2015-03-13 10:16:40,977 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0042	CONTAINERID=container_1426266260362_0042_01_000005
2015-03-13 10:16:40,977 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Start Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0042	CONTAINERID=container_1426266260362_0042_01_000003
2015-03-13 10:16:40,978 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0042 transitioned from NEW to INITING
2015-03-13 10:16:40,978 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0042_01_000002 to application application_1426266260362_0042
2015-03-13 10:16:40,978 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0042_01_000004 to application application_1426266260362_0042
2015-03-13 10:16:40,978 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0042_01_000005 to application application_1426266260362_0042
2015-03-13 10:16:40,978 INFO  application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0042_01_000003 to application application_1426266260362_0042
2015-03-13 10:16:40,978 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0042 transitioned from INITING to RUNNING
2015-03-13 10:16:40,979 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0042_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:16:40,979 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0042_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:16:40,979 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0042_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:16:40,979 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0042_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:16:40,979 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0042
2015-03-13 10:16:40,979 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0042
2015-03-13 10:16:40,979 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:16:40,979 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0042
2015-03-13 10:16:40,979 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:16:40,980 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:16:40,981 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0042
2015-03-13 10:16:40,981 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0042
2015-03-13 10:16:40,981 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:16:40,981 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0042
2015-03-13 10:16:40,981 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0042
2015-03-13 10:16:40,981 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0042
2015-03-13 10:16:40,981 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:16:40,981 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0042
2015-03-13 10:16:40,981 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0042
2015-03-13 10:16:40,981 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0042
2015-03-13 10:16:40,981 INFO  containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:16:40,981 INFO  mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0042
2015-03-13 10:16:40,982 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0042_01_000003
2015-03-13 10:16:40,982 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0042_01_000002
2015-03-13 10:16:40,984 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0042_01_000005
2015-03-13 10:16:40,986 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0042_01_000004
2015-03-13 10:16:40,998 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1426266260362_0042_01_000006.tokens. Credentials list: 
2015-03-13 10:16:41,006 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426266260362_0042_01_000003.tokens. Credentials list: 
2015-03-13 10:16:41,006 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1426266260362_0042_01_000005.tokens. Credentials list: 
2015-03-13 10:16:41,006 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426266260362_0042_01_000002.tokens. Credentials list: 
2015-03-13 10:16:41,006 INFO  localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0042_01_000004.tokens. Credentials list: 
2015-03-13 10:16:41,019 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:16:41,024 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:16:41,077 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:41,077 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:41,077 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:41,078 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:41,078 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0042_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:16:41,078 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0042_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:16:41,078 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0042_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:16:41,078 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0042_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:16:41,101 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1426266260362_0042_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0042/container_1426266260362_0042_01_000006.tokens
2015-03-13 10:16:41,101 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0042 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0042
2015-03-13 10:16:41,105 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1426266260362_0042_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0042/container_1426266260362_0042_01_000005.tokens
2015-03-13 10:16:41,105 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0042 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0042
2015-03-13 10:16:41,176 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.jar	dst=null	perm=null
2015-03-13 10:16:41,177 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.jar	dst=null	perm=null
2015-03-13 10:16:41,178 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.jar	dst=null	perm=null
2015-03-13 10:16:41,182 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.jar	dst=null	perm=null
2015-03-13 10:16:41,183 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.jar	dst=null	perm=null
2015-03-13 10:16:41,184 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.jar	dst=null	perm=null
2015-03-13 10:16:41,186 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:64565, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-762791852_22802, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742333_1509, duration: 363000
2015-03-13 10:16:41,191 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:64566, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-838667344_22805, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742333_1509, duration: 1058000
2015-03-13 10:16:41,207 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:16:41,211 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:16:41,226 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.xml	dst=null	perm=null
2015-03-13 10:16:41,227 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.xml	dst=null	perm=null
2015-03-13 10:16:41,228 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.xml	dst=null	perm=null
2015-03-13 10:16:41,228 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 41 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:16:41,229 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0041_01_000001
2015-03-13 10:16:41,229 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:41,229 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0042_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:16:41,229 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0041_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:16:41,230 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0041_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:16:41,230 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0041	CONTAINERID=container_1426266260362_0041_01_000001
2015-03-13 10:16:41,230 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0041_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:16:41,230 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:7168, vCores:6> numContainers=6 user=soberoi user-resources=<memory:7168, vCores:6>
2015-03-13 10:16:41,230 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0041_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:41,230 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:41,230 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6
2015-03-13 10:16:41,230 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0041_000001 released container container_1426266260362_0041_01_000001 on node: host: 10.1.1.144:60711 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:16:41,230 INFO  resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0041_000001
2015-03-13 10:16:41,230 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0041_000001 State change from FINISHING to FINISHED
2015-03-13 10:16:41,230 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0041 State change from FINISHING to FINISHED
2015-03-13 10:16:41,231 INFO  capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0041_000001 is done. finalState=FINISHED
2015-03-13 10:16:41,231 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0041 requests cleared
2015-03-13 10:16:41,231 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi	OPERATION=Application Finished - Succeeded	TARGET=RMAppManager	RESULT=SUCCESS	APPID=application_1426266260362_0041
2015-03-13 10:16:41,231 INFO  resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0041,name=[1E4D839F738A46F7A739643C694C0347/AB645C0BEEB8493DBB6EB2A6FDE6F845] lower*upper/(1/1) ...esplatform/joininnerouter,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0041/jobhistory/job/job_1426266260362_0041,appMasterHost=Edinburgh.local,startTime=1426266979063,finishTime=1426266994205,finalStatus=SUCCEEDED
2015-03-13 10:16:41,231 INFO  capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0041 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:16:41,231 INFO  capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0041 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:16:41,231 INFO  amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0041_000001
2015-03-13 10:16:41,233 INFO  ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0041_000001 (auth:SIMPLE)
2015-03-13 10:16:41,234 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.xml	dst=null	perm=null
2015-03-13 10:16:41,234 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0041_01_000001
2015-03-13 10:16:41,235 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.xml	dst=null	perm=null
2015-03-13 10:16:41,236 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.xml	dst=null	perm=null
2015-03-13 10:16:41,236 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:64566, bytes: 98372, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-762791852_22802, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742336_1512, duration: 205000
2015-03-13 10:16:41,243 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:64568, bytes: 98372, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-838667344_22805, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742336_1512, duration: 266000
2015-03-13 10:16:41,252 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:16:41,252 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0042_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:16:41,257 INFO  localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:16:41,257 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0042_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:16:41,258 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0042_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:16:41,258 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0042_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:16:41,258 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0042_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:16:41,275 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742320_1496 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir39/blk_1073742320 for deletion
2015-03-13 10:16:41,275 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742321_1497 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742321 for deletion
2015-03-13 10:16:41,275 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742323_1499 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir39/blk_1073742323 for deletion
2015-03-13 10:16:41,275 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742324_1500 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742324 for deletion
2015-03-13 10:16:41,276 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742325_1501 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir39/blk_1073742325 for deletion
2015-03-13 10:16:41,276 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742320_1496 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir39/blk_1073742320
2015-03-13 10:16:41,277 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742323_1499 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir39/blk_1073742323
2015-03-13 10:16:41,277 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742325_1501 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir39/blk_1073742325
2015-03-13 10:16:41,277 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742321_1497 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742321
2015-03-13 10:16:41,277 INFO  impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742324_1500 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742324
2015-03-13 10:16:41,299 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0042_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:16:41,299 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:16:41,306 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0042_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:16:41,306 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:16:41,307 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0042_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:16:41,307 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:16:41,307 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0042_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:16:41,307 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:16:41,308 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0042_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:16:41,308 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:16:41,453 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0042/container_1426266260362_0042_01_000003/default_container_executor.sh]
2015-03-13 10:16:41,453 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0042/container_1426266260362_0042_01_000002/default_container_executor.sh]
2015-03-13 10:16:41,459 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0042/container_1426266260362_0042_01_000006/default_container_executor.sh]
2015-03-13 10:16:41,459 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0042/container_1426266260362_0042_01_000005/default_container_executor.sh]
2015-03-13 10:16:41,461 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0042/container_1426266260362_0042_01_000004/default_container_executor.sh]
2015-03-13 10:16:41,629 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:41,629 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0041 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:16:41,630 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0041
2015-03-13 10:16:41,630 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0041 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:16:41,630 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0041, with delay of 10800 seconds
2015-03-13 10:16:41,630 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0041
2015-03-13 10:16:41,631 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0041
2015-03-13 10:16:41,631 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0041
2015-03-13 10:16:41,631 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0041
2015-03-13 10:16:41,859 INFO  scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate... 
2015-03-13 10:16:42,081 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:42,081 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:42,081 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:42,081 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:42,082 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0041 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:16:42,082 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0041
2015-03-13 10:16:42,082 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0041
2015-03-13 10:16:42,082 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0041
2015-03-13 10:16:42,082 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0041
2015-03-13 10:16:42,083 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0041
2015-03-13 10:16:42,082 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0041 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:16:42,083 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0041, with delay of 10800 seconds
2015-03-13 10:16:42,230 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:42,230 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0041 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:16:42,230 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0041
2015-03-13 10:16:42,230 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0041
2015-03-13 10:16:42,230 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0041
2015-03-13 10:16:42,231 INFO  application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0041 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:16:42,231 INFO  loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0041, with delay of 10800 seconds
2015-03-13 10:16:42,231 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0041
2015-03-13 10:16:42,231 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0041
2015-03-13 10:16:42,287 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:16:42,405 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426266260362_0042_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0042/container_1426266260362_0042_01_000002.tokens
2015-03-13 10:16:42,406 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0042 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0042
2015-03-13 10:16:42,508 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:16:42,630 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:42,647 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0042_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0042/container_1426266260362_0042_01_000004.tokens
2015-03-13 10:16:42,647 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0042 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0042
2015-03-13 10:16:42,712 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742337_1513
2015-03-13 10:16:42,750 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:16:42,885 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426266260362_0042_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0042/container_1426266260362_0042_01_000003.tokens
2015-03-13 10:16:42,885 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0042 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0042
2015-03-13 10:16:43,086 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:43,087 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:43,087 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:43,087 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:43,230 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:43,633 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:43,859 INFO  datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742337_1513
2015-03-13 10:16:44,088 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:44,089 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:44,089 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:44,089 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:44,232 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:44,638 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:45,092 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:45,092 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:45,092 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:45,093 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:45,233 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:45,641 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:46,095 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:46,095 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:46,096 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:46,096 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:46,236 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:46,645 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:47,098 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:47,099 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:47,099 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:47,099 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:47,240 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:47,647 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:48,102 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:48,102 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:48,102 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:48,102 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:48,245 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:48,648 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:49,103 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:49,103 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:49,104 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:49,104 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:49,250 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:49,411 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.split	dst=null	perm=null
2015-03-13 10:16:49,415 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.split	dst=null	perm=null
2015-03-13 10:16:49,426 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.split	dst=null	perm=null
2015-03-13 10:16:49,470 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.split	dst=null	perm=null
2015-03-13 10:16:49,613 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:64582, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0042_m_000003_0_1980825488_1, offset: 1024, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742334_1510, duration: 173000
2015-03-13 10:16:49,614 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:64581, bytes: 1282, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0042_m_000002_0_-1639547575_1, offset: 512, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742334_1510, duration: 159000
2015-03-13 10:16:49,621 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job.split	dst=null	perm=null
2015-03-13 10:16:49,622 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:64583, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0042_m_000001_0_1792432798_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742334_1510, duration: 179000
2015-03-13 10:16:49,649 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:64584, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0042_m_000004_0_1061138509_1, offset: 1024, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742334_1510, duration: 174000
2015-03-13 10:16:49,651 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:49,735 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:16:49,739 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64587, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0042_m_000002_0_-1639547575_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 204000
2015-03-13 10:16:49,752 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:16:49,757 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64588, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0042_m_000003_0_1980825488_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 141000
2015-03-13 10:16:49,760 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/_temporary/1/_temporary/attempt_1426266260362_0042_m_000002_0/part-00002	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:16:49,760 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:16:49,767 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64589, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0042_m_000001_0_1792432798_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 169000
2015-03-13 10:16:49,774 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64586, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0042_m_000000_0_-106193521_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742334_1510, duration: 172000
2015-03-13 10:16:49,776 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:16:49,780 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64590, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0042_m_000004_0_1061138509_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 152000
2015-03-13 10:16:49,780 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/_temporary/1/_temporary/attempt_1426266260362_0042_m_000003_0/part-00003	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:16:49,796 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/_temporary/1/_temporary/attempt_1426266260362_0042_m_000001_0/part-00001	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:16:49,807 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/_temporary/1/_temporary/attempt_1426266260362_0042_m_000004_0/part-00004	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:16:49,959 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt	dst=null	perm=null
2015-03-13 10:16:49,984 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/_temporary/1/_temporary/attempt_1426266260362_0042_m_000000_0/part-00000	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:16:50,106 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:50,106 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:50,106 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:50,106 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:50,158 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:16:50,166 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:16:50,169 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:16:50,173 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64591, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0042_m_000001_0_1792432798_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 151000
2015-03-13 10:16:50,189 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:16:50,194 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:16:50,201 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/_temporary/1/_temporary/attempt_1426266260362_0042_m_000001_0/part-00001. BP-1005356445-10.1.1.144-1426266257849 blk_1073742338_1514{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:16:50,206 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:16:50,209 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:16:50,213 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:16:50,213 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:64593, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0042_m_000003_0_1980825488_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 151000
2015-03-13 10:16:50,221 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:16:50,222 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:16:50,226 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:16:50,230 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64594, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0042_m_000002_0_-1639547575_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 146000
2015-03-13 10:16:50,232 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:16:50,236 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:64595, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0042_m_000004_0_1061138509_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 134000
2015-03-13 10:16:50,244 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742338_1514 src: /127.0.0.1:64592 dest: /127.0.0.1:60686
2015-03-13 10:16:50,245 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742338_1514 src: /127.0.0.1:64596 dest: /127.0.0.1:60693
2015-03-13 10:16:50,247 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742338_1514 src: /127.0.0.1:64597 dest: /127.0.0.1:60696
2015-03-13 10:16:50,254 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:50,255 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64597, dest: /127.0.0.1:60696, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0042_m_000001_0_1792432798_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742338_1514, duration: 6530000
2015-03-13 10:16:50,255 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742338_1514, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:16:50,256 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742338_1514{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:16:50,256 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64596, dest: /127.0.0.1:60693, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0042_m_000001_0_1792432798_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742338_1514, duration: 7517000
2015-03-13 10:16:50,256 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742338_1514, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:50,256 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742338_1514{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:16:50,257 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64592, dest: /127.0.0.1:60686, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0042_m_000001_0_1792432798_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742338_1514, duration: 8472000
2015-03-13 10:16:50,257 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742338_1514, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:50,257 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742338_1514{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:16:50,258 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/_temporary/1/_temporary/attempt_1426266260362_0042_m_000002_0/part-00002. BP-1005356445-10.1.1.144-1426266257849 blk_1073742339_1515{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:16:50,264 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/_temporary/1/_temporary/attempt_1426266260362_0042_m_000001_0/part-00001 is closed by DFSClient_attempt_1426266260362_0042_m_000001_0_1792432798_1
2015-03-13 10:16:50,264 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/_temporary/1/_temporary/attempt_1426266260362_0042_m_000004_0/part-00004 is closed by DFSClient_attempt_1426266260362_0042_m_000004_0_1061138509_1
2015-03-13 10:16:50,275 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/_temporary/1/_temporary/attempt_1426266260362_0042_m_000004_0	dst=null	perm=null
2015-03-13 10:16:50,277 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/_temporary/1/_temporary/attempt_1426266260362_0042_m_000001_0	dst=null	perm=null
2015-03-13 10:16:50,283 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/_temporary/1/_temporary/attempt_1426266260362_0042_m_000004_0	dst=null	perm=null
2015-03-13 10:16:50,284 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/_temporary/1/_temporary/attempt_1426266260362_0042_m_000001_0	dst=null	perm=null
2015-03-13 10:16:50,284 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/_temporary/1/task_1426266260362_0042_m_000004	dst=null	perm=null
2015-03-13 10:16:50,285 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/_temporary/1/task_1426266260362_0042_m_000001	dst=null	perm=null
2015-03-13 10:16:50,288 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/_temporary/1/_temporary/attempt_1426266260362_0042_m_000004_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/_temporary/1/task_1426266260362_0042_m_000004	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:16:50,291 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/_temporary/1/_temporary/attempt_1426266260362_0042_m_000001_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/_temporary/1/task_1426266260362_0042_m_000001	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:16:50,301 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742339_1515 src: /127.0.0.1:64598 dest: /127.0.0.1:60693
2015-03-13 10:16:50,303 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742339_1515 src: /127.0.0.1:64599 dest: /127.0.0.1:60689
2015-03-13 10:16:50,304 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742339_1515 src: /127.0.0.1:64600 dest: /127.0.0.1:60686
2015-03-13 10:16:50,313 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0042_01_000003
2015-03-13 10:16:50,313 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0042_01_000006
2015-03-13 10:16:50,313 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0042	CONTAINERID=container_1426266260362_0042_01_000006
2015-03-13 10:16:50,313 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0042_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:16:50,314 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0042_01_000003
2015-03-13 10:16:50,313 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0042	CONTAINERID=container_1426266260362_0042_01_000003
2015-03-13 10:16:50,314 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0042_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:16:50,314 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0042_01_000006
2015-03-13 10:16:50,314 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:16:50,314 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:50,315 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:16:50,315 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:50,315 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:50,327 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0042_01_000003 is : 143
2015-03-13 10:16:50,328 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0042_01_000006 is : 143
2015-03-13 10:16:50,339 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64600, dest: /127.0.0.1:60686, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0042_m_000002_0_-1639547575_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742339_1515, duration: 33444000
2015-03-13 10:16:50,339 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742339_1515, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:16:50,340 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64599, dest: /127.0.0.1:60689, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0042_m_000002_0_-1639547575_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742339_1515, duration: 34377000
2015-03-13 10:16:50,340 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742339_1515, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:50,341 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0042_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:16:50,341 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742339_1515{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:16:50,341 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64598, dest: /127.0.0.1:60693, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0042_m_000002_0_-1639547575_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742339_1515, duration: 35646000
2015-03-13 10:16:50,342 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0042/container_1426266260362_0042_01_000006
2015-03-13 10:16:50,342 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742339_1515, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:50,342 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0042	CONTAINERID=container_1426266260362_0042_01_000006
2015-03-13 10:16:50,342 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0042_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:16:50,342 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0042/container_1426266260362_0042_01_000006
2015-03-13 10:16:50,341 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0042_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:16:50,342 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742339_1515{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:16:50,343 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0042/container_1426266260362_0042_01_000006
2015-03-13 10:16:50,343 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0042	CONTAINERID=container_1426266260362_0042_01_000003
2015-03-13 10:16:50,343 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0042_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:16:50,343 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0042_01_000003 from application application_1426266260362_0042
2015-03-13 10:16:50,343 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0042/container_1426266260362_0042_01_000003
2015-03-13 10:16:50,342 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0042/container_1426266260362_0042_01_000006
2015-03-13 10:16:50,343 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0042/container_1426266260362_0042_01_000003
2015-03-13 10:16:50,344 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0042/container_1426266260362_0042_01_000003
2015-03-13 10:16:50,344 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742339_1515{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:16:50,342 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0042_01_000006 from application application_1426266260362_0042
2015-03-13 10:16:50,345 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:16:50,345 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0042
2015-03-13 10:16:50,344 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0042/container_1426266260362_0042_01_000003
2015-03-13 10:16:50,343 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:16:50,345 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0042
2015-03-13 10:16:50,345 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job_1426266260362_0042_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073742340_1516{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:16:50,347 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742340_1516 src: /127.0.0.1:64601 dest: /127.0.0.1:60696
2015-03-13 10:16:50,348 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742340_1516 src: /127.0.0.1:64602 dest: /127.0.0.1:60693
2015-03-13 10:16:50,350 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742340_1516 src: /127.0.0.1:64603 dest: /127.0.0.1:60689
2015-03-13 10:16:50,353 INFO  hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job_1426266260362_0042_1.jhist for DFSClient_NONMAPREDUCE_-1118876827_1
2015-03-13 10:16:50,355 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/_temporary/1/_temporary/attempt_1426266260362_0042_m_000002_0/part-00002 is closed by DFSClient_attempt_1426266260362_0042_m_000002_0_-1639547575_1
2015-03-13 10:16:50,360 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/_temporary/1/_temporary/attempt_1426266260362_0042_m_000003_0/part-00003. BP-1005356445-10.1.1.144-1426266257849 blk_1073742341_1517{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:16:50,366 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/_temporary/1/_temporary/attempt_1426266260362_0042_m_000002_0	dst=null	perm=null
2015-03-13 10:16:50,399 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/_temporary/1/_temporary/attempt_1426266260362_0042_m_000002_0	dst=null	perm=null
2015-03-13 10:16:50,400 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/_temporary/1/task_1426266260362_0042_m_000002	dst=null	perm=null
2015-03-13 10:16:50,404 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/_temporary/1/_temporary/attempt_1426266260362_0042_m_000002_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/_temporary/1/task_1426266260362_0042_m_000002	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:16:50,404 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742341_1517 src: /127.0.0.1:64604 dest: /127.0.0.1:60689
2015-03-13 10:16:50,405 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742341_1517 src: /127.0.0.1:64605 dest: /127.0.0.1:60696
2015-03-13 10:16:50,406 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742341_1517 src: /127.0.0.1:64606 dest: /127.0.0.1:60693
2015-03-13 10:16:50,415 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64606, dest: /127.0.0.1:60693, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0042_m_000003_0_1980825488_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742341_1517, duration: 7312000
2015-03-13 10:16:50,415 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742341_1517, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:16:50,416 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742341_1517{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:16:50,416 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64605, dest: /127.0.0.1:60696, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0042_m_000003_0_1980825488_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742341_1517, duration: 7892000
2015-03-13 10:16:50,416 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742341_1517, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:50,416 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742341_1517{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:16:50,416 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64604, dest: /127.0.0.1:60689, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0042_m_000003_0_1980825488_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742341_1517, duration: 8550000
2015-03-13 10:16:50,417 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742341_1517, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:50,417 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742341_1517{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:16:50,427 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0042_01_000004
2015-03-13 10:16:50,427 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0042	CONTAINERID=container_1426266260362_0042_01_000004
2015-03-13 10:16:50,427 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0042_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:16:50,427 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0042_01_000004
2015-03-13 10:16:50,427 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:50,428 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:16:50,428 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0042_01_000003
2015-03-13 10:16:50,428 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:16:50,428 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:50,428 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0042_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:16:50,428 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0042_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:16:50,428 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0042	CONTAINERID=container_1426266260362_0042_01_000003
2015-03-13 10:16:50,429 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0042_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:16:50,429 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:16:50,429 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0042_01_000003, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:50,429 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:50,429 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:16:50,429 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0042_000001 released container container_1426266260362_0042_01_000003 on node: host: 10.1.1.144:60719 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:16:50,439 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0042_01_000004 is : 143
2015-03-13 10:16:50,445 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/_temporary/1/_temporary/attempt_1426266260362_0042_m_000003_0/part-00003 is closed by DFSClient_attempt_1426266260362_0042_m_000003_0_1980825488_1
2015-03-13 10:16:50,452 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0042_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:16:50,452 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0042/container_1426266260362_0042_01_000004
2015-03-13 10:16:50,452 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0042/container_1426266260362_0042_01_000004
2015-03-13 10:16:50,453 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0042/container_1426266260362_0042_01_000004
2015-03-13 10:16:50,453 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0042/container_1426266260362_0042_01_000004
2015-03-13 10:16:50,453 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0042	CONTAINERID=container_1426266260362_0042_01_000004
2015-03-13 10:16:50,453 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0042_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:16:50,454 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0042_01_000004 from application application_1426266260362_0042
2015-03-13 10:16:50,454 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:16:50,454 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0042
2015-03-13 10:16:50,457 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/_temporary/1/_temporary/attempt_1426266260362_0042_m_000003_0	dst=null	perm=null
2015-03-13 10:16:50,463 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/_temporary/1/_temporary/attempt_1426266260362_0042_m_000003_0	dst=null	perm=null
2015-03-13 10:16:50,464 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/_temporary/1/task_1426266260362_0042_m_000003	dst=null	perm=null
2015-03-13 10:16:50,468 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/_temporary/1/_temporary/attempt_1426266260362_0042_m_000003_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/_temporary/1/task_1426266260362_0042_m_000003	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:16:50,478 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0042_01_000005
2015-03-13 10:16:50,478 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0042	CONTAINERID=container_1426266260362_0042_01_000005
2015-03-13 10:16:50,478 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0042_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:16:50,478 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:50,478 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:16:50,478 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0042_01_000005
2015-03-13 10:16:50,478 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0042_01_000004
2015-03-13 10:16:50,479 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:16:50,479 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0042_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:16:50,479 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0042_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:16:50,479 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0042	CONTAINERID=container_1426266260362_0042_01_000004
2015-03-13 10:16:50,479 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0042_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:16:50,479 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:16:50,479 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0042_01_000004, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:50,479 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:50,480 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:16:50,480 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0042_000001 released container container_1426266260362_0042_01_000004 on node: host: 10.1.1.144:60719 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:16:50,490 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0042_01_000005 is : 143
2015-03-13 10:16:50,501 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0042_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:16:50,501 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0042/container_1426266260362_0042_01_000005
2015-03-13 10:16:50,501 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0042/container_1426266260362_0042_01_000005
2015-03-13 10:16:50,501 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0042/container_1426266260362_0042_01_000005
2015-03-13 10:16:50,502 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0042/container_1426266260362_0042_01_000005
2015-03-13 10:16:50,502 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0042	CONTAINERID=container_1426266260362_0042_01_000005
2015-03-13 10:16:50,502 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0042_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:16:50,502 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0042_01_000005 from application application_1426266260362_0042
2015-03-13 10:16:50,503 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:16:50,503 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0042
2015-03-13 10:16:50,523 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:16:50,532 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:16:50,535 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt	dst=null	perm=null
2015-03-13 10:16:50,539 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64586, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0042_m_000000_0_-106193521_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 145000
2015-03-13 10:16:50,543 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64586, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0042_m_000000_0_-106193521_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 162000
2015-03-13 10:16:50,560 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/_temporary/1/_temporary/attempt_1426266260362_0042_m_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073742342_1518{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:16:50,605 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742342_1518 src: /127.0.0.1:64607 dest: /127.0.0.1:60686
2015-03-13 10:16:50,606 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742342_1518 src: /127.0.0.1:64608 dest: /127.0.0.1:60689
2015-03-13 10:16:50,607 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742342_1518 src: /127.0.0.1:64609 dest: /127.0.0.1:60696
2015-03-13 10:16:50,615 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64609, dest: /127.0.0.1:60696, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0042_m_000000_0_-106193521_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742342_1518, duration: 6357000
2015-03-13 10:16:50,615 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742342_1518, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:16:50,617 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64608, dest: /127.0.0.1:60689, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0042_m_000000_0_-106193521_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742342_1518, duration: 7460000
2015-03-13 10:16:50,617 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742342_1518, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:50,619 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64607, dest: /127.0.0.1:60686, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0042_m_000000_0_-106193521_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742342_1518, duration: 9690000
2015-03-13 10:16:50,619 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742342_1518, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:50,620 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742342_1518{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:16:50,621 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742342_1518{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:16:50,622 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742342_1518{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:16:50,629 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/_temporary/1/_temporary/attempt_1426266260362_0042_m_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0042_m_000000_0_-106193521_1
2015-03-13 10:16:50,637 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/_temporary/1/_temporary/attempt_1426266260362_0042_m_000000_0	dst=null	perm=null
2015-03-13 10:16:50,643 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/_temporary/1/_temporary/attempt_1426266260362_0042_m_000000_0	dst=null	perm=null
2015-03-13 10:16:50,644 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/_temporary/1/task_1426266260362_0042_m_000000	dst=null	perm=null
2015-03-13 10:16:50,647 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/_temporary/1/_temporary/attempt_1426266260362_0042_m_000000_0	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/_temporary/1/task_1426266260362_0042_m_000000	perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:16:50,651 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:50,655 INFO  containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0042_01_000002
2015-03-13 10:16:50,655 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	IP=10.1.1.144	OPERATION=Stop Container Request	TARGET=ContainerManageImpl	RESULT=SUCCESS	APPID=application_1426266260362_0042	CONTAINERID=container_1426266260362_0042_01_000002
2015-03-13 10:16:50,655 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0042_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:16:50,655 INFO  launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0042_01_000002
2015-03-13 10:16:50,656 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:16:50,656 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:16:50,656 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0042_01_000005
2015-03-13 10:16:50,656 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0042_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:16:50,656 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0042_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:16:50,656 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0042	CONTAINERID=container_1426266260362_0042_01_000005
2015-03-13 10:16:50,656 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0042_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:16:50,657 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:16:50,657 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0042_01_000005, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:50,657 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:50,657 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:16:50,657 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0042_000001 released container container_1426266260362_0042_01_000005 on node: host: 10.1.1.144:60719 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:16:50,660 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/COMMIT_STARTED	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:16:50,662 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-1118876827_1
2015-03-13 10:16:50,666 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/_temporary/1	dst=null	perm=null
2015-03-13 10:16:50,670 WARN  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0042_01_000002 is : 143
2015-03-13 10:16:50,673 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields	dst=null	perm=null
2015-03-13 10:16:50,675 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields	dst=null	perm=null
2015-03-13 10:16:50,675 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/_temporary/1/task_1426266260362_0042_m_000000	dst=null	perm=null
2015-03-13 10:16:50,677 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/part-00000	dst=null	perm=null
2015-03-13 10:16:50,680 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/_temporary/1/task_1426266260362_0042_m_000000/part-00000	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/part-00000	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:16:50,683 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0042_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:16:50,683 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields	dst=null	perm=null
2015-03-13 10:16:50,683 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0042/container_1426266260362_0042_01_000002
2015-03-13 10:16:50,684 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0042/container_1426266260362_0042_01_000002
2015-03-13 10:16:50,684 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields	dst=null	perm=null
2015-03-13 10:16:50,685 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0042/container_1426266260362_0042_01_000002
2015-03-13 10:16:50,685 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/_temporary/1/task_1426266260362_0042_m_000001	dst=null	perm=null
2015-03-13 10:16:50,686 INFO  nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0042/container_1426266260362_0042_01_000002
2015-03-13 10:16:50,686 INFO  nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi	OPERATION=Container Finished - Killed	TARGET=ContainerImpl	RESULT=SUCCESS	APPID=application_1426266260362_0042	CONTAINERID=container_1426266260362_0042_01_000002
2015-03-13 10:16:50,687 INFO  container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0042_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:16:50,687 INFO  application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0042_01_000002 from application application_1426266260362_0042
2015-03-13 10:16:50,687 INFO  monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:16:50,687 INFO  containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0042
2015-03-13 10:16:50,687 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/part-00001	dst=null	perm=null
2015-03-13 10:16:50,689 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/_temporary/1/task_1426266260362_0042_m_000001/part-00001	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/part-00001	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:16:50,690 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields	dst=null	perm=null
2015-03-13 10:16:50,691 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields	dst=null	perm=null
2015-03-13 10:16:50,692 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/_temporary/1/task_1426266260362_0042_m_000002	dst=null	perm=null
2015-03-13 10:16:50,695 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/part-00002	dst=null	perm=null
2015-03-13 10:16:50,698 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/_temporary/1/task_1426266260362_0042_m_000002/part-00002	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/part-00002	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:16:50,699 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields	dst=null	perm=null
2015-03-13 10:16:50,700 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields	dst=null	perm=null
2015-03-13 10:16:50,701 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/_temporary/1/task_1426266260362_0042_m_000003	dst=null	perm=null
2015-03-13 10:16:50,702 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/part-00003	dst=null	perm=null
2015-03-13 10:16:50,704 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/_temporary/1/task_1426266260362_0042_m_000003/part-00003	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/part-00003	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:16:50,704 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields	dst=null	perm=null
2015-03-13 10:16:50,705 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields	dst=null	perm=null
2015-03-13 10:16:50,706 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/_temporary/1/task_1426266260362_0042_m_000004	dst=null	perm=null
2015-03-13 10:16:50,707 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/part-00004	dst=null	perm=null
2015-03-13 10:16:50,710 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/_temporary/1/task_1426266260362_0042_m_000004/part-00004	dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/part-00004	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:16:50,713 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/_temporary	dst=null	perm=null
2015-03-13 10:16:50,716 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:16:50,717 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-1118876827_1
2015-03-13 10:16:50,719 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/COMMIT_SUCCESS	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:16:50,721 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-1118876827_1
2015-03-13 10:16:50,736 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64603, dest: /127.0.0.1:60689, bytes: 53306, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1118876827_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742340_1516, duration: 385155000
2015-03-13 10:16:50,736 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742340_1516, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:16:50,737 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742340_1516{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:16:50,738 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64602, dest: /127.0.0.1:60693, bytes: 53306, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1118876827_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742340_1516, duration: 386467000
2015-03-13 10:16:50,738 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742340_1516, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:50,739 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742340_1516{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:16:50,739 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64601, dest: /127.0.0.1:60696, bytes: 53306, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1118876827_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742340_1516, duration: 387912000
2015-03-13 10:16:50,739 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742340_1516, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:50,740 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742340_1516{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:16:50,741 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job_1426266260362_0042_1.jhist is closed by DFSClient_NONMAPREDUCE_-1118876827_1
2015-03-13 10:16:50,744 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0042.summary_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:16:50,747 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0042.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742343_1519{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:16:50,748 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742343_1519 src: /127.0.0.1:64610 dest: /127.0.0.1:60686
2015-03-13 10:16:50,749 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742343_1519 src: /127.0.0.1:64611 dest: /127.0.0.1:60696
2015-03-13 10:16:50,751 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742343_1519 src: /127.0.0.1:64612 dest: /127.0.0.1:60689
2015-03-13 10:16:50,753 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64612, dest: /127.0.0.1:60689, bytes: 440, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1118876827_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742343_1519, duration: 1080000
2015-03-13 10:16:50,753 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742343_1519, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:16:50,754 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742343_1519{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:16:50,754 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64611, dest: /127.0.0.1:60696, bytes: 440, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1118876827_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742343_1519, duration: 1716000
2015-03-13 10:16:50,754 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742343_1519, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:50,754 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742343_1519{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:16:50,754 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64610, dest: /127.0.0.1:60686, bytes: 440, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1118876827_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742343_1519, duration: 2394000
2015-03-13 10:16:50,754 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742343_1519, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:50,755 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742343_1519{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:16:50,757 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0042.summary_tmp is closed by DFSClient_NONMAPREDUCE_-1118876827_1
2015-03-13 10:16:50,760 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0042.summary_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:16:50,764 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job_1426266260362_0042_1.jhist	dst=null	perm=null
2015-03-13 10:16:50,765 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0042-1426266995450-soberoi-%5B2A55BD1E7FCD49BCBDD011F8B6099930%2F3E006FBC5D024046-1426267010722-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:16:50,767 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job_1426266260362_0042_1.jhist	dst=null	perm=null
2015-03-13 10:16:50,768 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0042-1426266995450-soberoi-%5B2A55BD1E7FCD49BCBDD011F8B6099930%2F3E006FBC5D024046-1426267010722-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=null
2015-03-13 10:16:50,769 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job_1426266260362_0042_1.jhist	dst=null	perm=null
2015-03-13 10:16:50,772 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0042-1426266995450-soberoi-%5B2A55BD1E7FCD49BCBDD011F8B6099930%2F3E006FBC5D024046-1426267010722-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:16:50,774 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:64613, bytes: 53726, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1118876827_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742340_1516, duration: 168000
2015-03-13 10:16:50,776 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0042-1426266995450-soberoi-%5B2A55BD1E7FCD49BCBDD011F8B6099930%2F3E006FBC5D024046-1426267010722-5-0-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742344_1520{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:16:50,778 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742344_1520 src: /127.0.0.1:64614 dest: /127.0.0.1:60686
2015-03-13 10:16:50,779 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742344_1520 src: /127.0.0.1:64615 dest: /127.0.0.1:60689
2015-03-13 10:16:50,780 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742344_1520 src: /127.0.0.1:64616 dest: /127.0.0.1:60696
2015-03-13 10:16:50,783 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64616, dest: /127.0.0.1:60696, bytes: 53306, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1118876827_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742344_1520, duration: 1691000
2015-03-13 10:16:50,783 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742344_1520, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:16:50,784 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742344_1520{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:16:50,784 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64615, dest: /127.0.0.1:60689, bytes: 53306, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1118876827_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742344_1520, duration: 2303000
2015-03-13 10:16:50,784 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742344_1520, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:50,784 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742344_1520{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:16:50,785 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64614, dest: /127.0.0.1:60686, bytes: 53306, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1118876827_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742344_1520, duration: 3077000
2015-03-13 10:16:50,785 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742344_1520, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:50,785 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742344_1520{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:16:50,787 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0042-1426266995450-soberoi-%5B2A55BD1E7FCD49BCBDD011F8B6099930%2F3E006FBC5D024046-1426267010722-5-0-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-1118876827_1
2015-03-13 10:16:50,789 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0042-1426266995450-soberoi-%5B2A55BD1E7FCD49BCBDD011F8B6099930%2F3E006FBC5D024046-1426267010722-5-0-SUCCEEDED-default.jhist_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:16:50,790 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job_1426266260362_0042_1_conf.xml	dst=null	perm=null
2015-03-13 10:16:50,791 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0042_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:16:50,792 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job_1426266260362_0042_1_conf.xml	dst=null	perm=null
2015-03-13 10:16:50,793 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0042_conf.xml_tmp	dst=null	perm=null
2015-03-13 10:16:50,794 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042/job_1426266260362_0042_1_conf.xml	dst=null	perm=null
2015-03-13 10:16:50,796 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=create	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0042_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:16:50,798 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:64617, bytes: 91126, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1118876827_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742337_1513, duration: 232000
2015-03-13 10:16:50,800 INFO  hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0042_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742345_1521{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:16:50,801 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742345_1521 src: /127.0.0.1:64618 dest: /127.0.0.1:60693
2015-03-13 10:16:50,803 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742345_1521 src: /127.0.0.1:64619 dest: /127.0.0.1:60686
2015-03-13 10:16:50,804 INFO  datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742345_1521 src: /127.0.0.1:64620 dest: /127.0.0.1:60696
2015-03-13 10:16:50,806 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64620, dest: /127.0.0.1:60696, bytes: 90418, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1118876827_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742345_1521, duration: 1479000
2015-03-13 10:16:50,806 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742345_1521, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:16:50,807 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742345_1521{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:16:50,807 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64619, dest: /127.0.0.1:60686, bytes: 90418, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1118876827_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742345_1521, duration: 1879000
2015-03-13 10:16:50,807 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742345_1521, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:50,807 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742345_1521{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:16:50,807 INFO  DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:64618, dest: /127.0.0.1:60693, bytes: 90418, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1118876827_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742345_1521, duration: 2595000
2015-03-13 10:16:50,808 INFO  datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742345_1521, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:16:50,808 INFO  BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742345_1521{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:16:50,809 INFO  hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0042_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-1118876827_1
2015-03-13 10:16:50,811 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=setPermission	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0042_conf.xml_tmp	dst=null	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:16:50,812 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0042.summary_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0042.summary	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:16:50,813 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0042_conf.xml_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0042_conf.xml	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:16:50,815 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=rename	src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0042-1426266995450-soberoi-%5B2A55BD1E7FCD49BCBDD011F8B6099930%2F3E006FBC5D024046-1426267010722-5-0-SUCCEEDED-default.jhist_tmp	dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0042-1426266995450-soberoi-%5B2A55BD1E7FCD49BCBDD011F8B6099930%2F3E006FBC5D024046-1426267010722-5-0-SUCCEEDED-default.jhist	perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:16:50,821 INFO  attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0042_000001 State change from RUNNING to FINISHING
2015-03-13 10:16:50,822 INFO  rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0042
2015-03-13 10:16:50,822 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0042 State change from RUNNING to REMOVING
2015-03-13 10:16:50,822 INFO  recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0042
2015-03-13 10:16:50,822 INFO  rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0042 State change from REMOVING to FINISHING
2015-03-13 10:16:51,320 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:16:51,320 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0042_01_000006
2015-03-13 10:16:51,321 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0042_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:16:51,321 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0042_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:16:51,321 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0042	CONTAINERID=container_1426266260362_0042_01_000006
2015-03-13 10:16:51,321 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0042_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:16:51,321 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:16:51,321 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0042_01_000006, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:51,321 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:51,321 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:16:51,321 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0042_000001 released container container_1426266260362_0042_01_000006 on node: host: 10.1.1.144:60711 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:16:51,653 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:16:51,657 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 42 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:16:51,657 INFO  nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0042_01_000002
2015-03-13 10:16:51,658 INFO  rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0042_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:16:51,658 INFO  fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0042_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:16:51,658 INFO  resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi	OPERATION=AM Released Container	TARGET=SchedulerApp	RESULT=SUCCESS	APPID=application_1426266260362_0042	CONTAINERID=container_1426266260362_0042_01_000002
2015-03-13 10:16:51,658 INFO  fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0042_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:16:51,658 INFO  capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:16:51,658 INFO  capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0042_01_000002, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:51,658 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:16:51,658 INFO  capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:16:51,658 INFO  capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0042_000001 released container container_1426266260362_0042_01_000002 on node: host: 10.1.1.144:60719 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:16:51,831 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742333_1509 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60693 
2015-03-13 10:16:51,831 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742334_1510 127.0.0.1:60693 127.0.0.1:60689 127.0.0.1:60686 127.0.0.1:60696 
2015-03-13 10:16:51,831 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742335_1511 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60686 
2015-03-13 10:16:51,831 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742336_1512 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60689 
2015-03-13 10:16:51,831 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742340_1516 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60689 
2015-03-13 10:16:51,831 INFO  BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742337_1513 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60689 
2015-03-13 10:16:51,832 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=delete	src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0042	dst=null	perm=null
2015-03-13 10:16:51,869 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields	dst=null	perm=null
2015-03-13 10:16:51,870 INFO  util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/_temporary
2015-03-13 10:16:51,870 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/_temporary	dst=null	perm=null
2015-03-13 10:16:51,885 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:16:51,885 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:16:51,885 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:16:51,886 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields	dst=null	perm=null
2015-03-13 10:16:51,887 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields	dst=null	perm=null
2015-03-13 10:16:51,887 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields	dst=null	perm=null
2015-03-13 10:16:51,888 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:16:51,889 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/part-00000	dst=null	perm=null
2015-03-13 10:16:51,891 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:64622, bytes: 20, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742342_1518, duration: 185000
2015-03-13 10:16:51,891 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/part-00001	dst=null	perm=null
2015-03-13 10:16:51,893 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:64623, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742338_1514, duration: 158000
2015-03-13 10:16:51,893 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/part-00002	dst=null	perm=null
2015-03-13 10:16:51,895 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:64624, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742339_1515, duration: 160000
2015-03-13 10:16:51,895 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/part-00003	dst=null	perm=null
2015-03-13 10:16:51,896 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:64622, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742341_1517, duration: 113000
2015-03-13 10:16:51,897 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/part-00004	dst=null	perm=null
2015-03-13 10:16:51,903 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:16:51,904 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:16:51,904 INFO  Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:16:51,905 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields	dst=null	perm=null
2015-03-13 10:16:51,906 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields	dst=null	perm=null
2015-03-13 10:16:51,906 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields	dst=null	perm=null
2015-03-13 10:16:51,907 INFO  mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:16:51,908 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/part-00000	dst=null	perm=null
2015-03-13 10:16:51,909 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:64622, bytes: 20, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742342_1518, duration: 172000
2015-03-13 10:16:51,909 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/part-00001	dst=null	perm=null
2015-03-13 10:16:51,911 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64625, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742338_1514, duration: 163000
2015-03-13 10:16:51,911 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/part-00002	dst=null	perm=null
2015-03-13 10:16:51,912 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64625, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742339_1515, duration: 128000
2015-03-13 10:16:51,913 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/part-00003	dst=null	perm=null
2015-03-13 10:16:51,914 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:64622, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742341_1517, duration: 148000
2015-03-13 10:16:51,914 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/part-00004	dst=null	perm=null
2015-03-13 10:16:51,914 INFO  cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/difffields
2015-03-13 10:16:51,915 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields	dst=null	perm=null
2015-03-13 10:16:51,915 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields	dst=null	perm=null
2015-03-13 10:16:51,916 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields	dst=null	perm=null
2015-03-13 10:16:51,916 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=listStatus	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields	dst=null	perm=null
2015-03-13 10:16:51,917 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/part-00000	dst=null	perm=null
2015-03-13 10:16:51,918 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/part-00000	dst=null	perm=null
2015-03-13 10:16:51,919 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64625, bytes: 20, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742342_1518, duration: 131000
2015-03-13 10:16:51,919 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/part-00001	dst=null	perm=null
2015-03-13 10:16:51,920 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/part-00001	dst=null	perm=null
2015-03-13 10:16:51,921 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64625, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742338_1514, duration: 167000
2015-03-13 10:16:51,921 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/part-00002	dst=null	perm=null
2015-03-13 10:16:51,922 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/part-00002	dst=null	perm=null
2015-03-13 10:16:51,923 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:64625, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742339_1515, duration: 130000
2015-03-13 10:16:51,924 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/part-00003	dst=null	perm=null
2015-03-13 10:16:51,924 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/part-00003	dst=null	perm=null
2015-03-13 10:16:51,926 INFO  DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:64624, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742341_1517, duration: 164000
2015-03-13 10:16:51,926 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=getfileinfo	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/part-00004	dst=null	perm=null
2015-03-13 10:16:51,927 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true	ugi=soberoi (auth:SIMPLE)	ip=/127.0.0.1	cmd=open	src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/difffields/part-00004	dst=null	perm=null

Standard error

Mar 13, 2015 10:04:22 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class
Mar 13, 2015 10:04:22 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class
Mar 13, 2015 10:04:22 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Mar 13, 2015 10:04:22 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Mar 13, 2015 10:04:22 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Mar 13, 2015 10:04:22 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Mar 13, 2015 10:04:23 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
Mar 13, 2015 10:04:23 AM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
Mar 13, 2015 10:04:23 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
Mar 13, 2015 10:04:23 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Mar 13, 2015 10:04:23 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
Mar 13, 2015 10:04:23 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Mar 13, 2015 10:04:23 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Mar 13, 2015 10:04:23 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Mar 13, 2015 10:04:23 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
Mar 13, 2015 10:04:23 AM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
Mar 13, 2015 10:04:24 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
Mar 13, 2015 10:04:24 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Mar 13, 2015 10:04:24 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
Mar 13, 2015 10:04:24 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Mar 13, 2015 10:04:24 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Mar 13, 2015 10:04:24 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Mar 13, 2015 10:04:24 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
Mar 13, 2015 10:04:24 AM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
Mar 13, 2015 10:04:25 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
Mar 13, 2015 10:04:25 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Mar 13, 2015 10:04:25 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
Mar 13, 2015 10:04:25 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Mar 13, 2015 10:04:25 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Mar 13, 2015 10:04:25 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Mar 13, 2015 10:04:25 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
Mar 13, 2015 10:04:25 AM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.
Mar 13, 2015 10:04:26 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class
Mar 13, 2015 10:04:26 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
Mar 13, 2015 10:04:26 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class
Mar 13, 2015 10:04:26 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
Mar 13, 2015 10:04:26 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton"
Mar 13, 2015 10:04:26 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
Mar 13, 2015 10:04:26 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton"
Mar 13, 2015 10:04:26 AM com.google.inject.servlet.GuiceFilter setPipeline
WARNING: Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected.